Senior Data Engineer (AWS)
Offer summary

(Summary generated by AI based on the full job description)

The project focuses on evolving a Microsoft-based analytics data platform as part of data modernization. Key stack includes Microsoft Fabric or Databricks, Apache Spark, Delta Lake and Python. Responsibilities cover designing, optimizing and operating large, cost-aware Spark and Delta Lake workloads, building and tuning pipelines, diagnosing performance with Spark UI and Delta statistics, managing Fabric capacity and compute sizing, creating reusable Python libraries, and designing operational pipelines with monitoring and failure recovery. Required production experience with Fabric/Databricks, deep Spark troubleshooting (shuffle skew, spill, OOM, AQE, join strategies), Delta optimizations (liquid clustering, Z-order, OPTIMIZE) and Python library development.

new

Senior Data Engineer (AWS)

Company: Capgemini Polska

from: 20 November 2026
to: 20 December 2026
salary not specifiedcontract of employment (full-time)
Offer parameters
level:senior
working mode:hybrid
Gdańsk, Oliwa
Gdańsk, Oliwaaleja Grunwaldzka 472DView on map

Requirements

Expected technologies

Apache Spark
Microsoft Azure
Python

Our requirements

  • Microsoft Fabric or Databricks production engineering
  • Apache Spark and Spark UI troubleshooting
  • Shuffle skew, spill, OOM, task-duration analysis, AQE, join strategy, and predicate pushdown
  • Delta Lake optimization: liquid clustering, partitioning, Z-order, file sizing, OPTIMIZE, statistics, VACUUM, and incremental MERGE
  • Fabric capacity economics: CU-seconds, bursting, smoothing, throttling stages, pool configuration, node sizing, concurrency, and workload isolation
  • Production Python library development, packaging, validation, logging, testing, versioning, and documentation
  • Operational pipeline design: idempotency, watermarks, quarantine, monitoring, failure recovery, and SLA awareness

Your responsibilities

  • Design, optimize, and operate reliable, large-scale, cost-aware Spark and Delta Lake workloads.
  • Build and optimize Spark pipelines on Microsoft Fabric or Databricks. Diagnose performance using Spark UI and Delta statistics. Manage Delta Lake design, Fabric capacity consumption, compute sizing, throttling exposure, and operational reliability. Create reusable Python libraries and Spark modules for ingestion, governance, security, monitoring, and optimization.
  • Demonstrated production troubleshooting and capacity-economics experience, not only notebook or ETL development.
  • Measures workload behavior before changing infrastructure; optimizes code and configuration before increasing compute; documents pool sizing, throttling risk, and operational requirements; explains capacity behavior to platform and engineering teams.
Company

About the project

Our client is expanding its data platform team as part of its ongoing data modernization initiatives. They are looking to add Data Engineer to support the evolution of the Microsoft-based analytics and data platform.
Empoloyee will need to be able to provide overlap with the customer's US Eastern Time working hours, including availability through approximately 4:30 PM ET.

What we offer

  • Well-being culture: medical care with Medicover, private life insurance, and sports card. But we went one step further by creating our own Capgemini Helpline offering therapeutical support if needed and the educational podcast "Let's talk about wellbeing" which you can listen to on Spotify.
  • Access to over 70 training tracks with certification opportunities (e.g., GenAI, Architects, Google) on our NEXT platform. Dive into a world of knowledge with free access to Education First languages platform, TED Talks and Udemy Business materials and trainings.
  • Continuous feedback and ongoing performance discussions thanks to our performance management tool GetSuccess supported by a transparent performance management policy.
  • Enjoy hybrid working modelonboarding that fits your life - after completing , connect work from a modern office with ergonomic work from home, thanks to home office package (including laptop, monitor, and chair). Ask your recruiter about the details.

Benefits

  • sharing the costs of sports activities
  • private medical care
  • life insurance
  • no dress code
  • parking space for employees
  • extra social benefits
  • redeployment package
  • employee referral program
  • charity initiatives
  • access to courses e.g. Excel, VBA, RPA, Customer Care
  • unlimited access to Udemy Business
  • free chat/call with a therapist

Recruitment stages

  • 1.
    Interview with the recruiter
  • 2.
    Competency Tests/Language Verification
  • 3.
    Video call with a manager
  • 4.
    Final Decision

Capgemini Polska

Capgemini is a global leader in partnering with companies to transform and manage their business by harnessing the power of technology. The Group is guided everyday by its purpose of unleashing human energy through technology for an inclusive and sustainable future. It is a responsible and diverse organization of over 360,000 team members globally in more than 50 countries. With its strong 55-year heritage and deep industry expertise, Capgemini is trusted by its clients to address the entire breadth of their business needs, from strategy and design to operations, fueled by the fast evolving and innovative world of cloud, data, AI, connectivity, software, digital engineering and platforms.

This is how we work

Senior Data Engineer (AWS)
I apply to:
Capgemini Polska
Gdańsk, Oliwa
Pracodawca zbiera zgłoszenia przez swój system.
Przejdziesz na zewnętrzny formularz.

By clicking "Aplikuj" you confirm that you've read and accepted our Terms and Conditions.



This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Need more information?

  • Make sure the body of the offer doesn’t already include what you’re looking for.
  • Ask a question if you need more information you’re interested in.
  • We’ll forward your question to the employer and aim to provide a response within 3 business days.

Share this offer