Senior / Lead Data Software Engineer (Python, Spark, Azure)
Offer summary

(Summary generated by AI based on the full job description)

The project focuses on a scalable ML platform enhancing portfolio model development with advanced data governance and AI. Key technologies include Azure Databricks, PySpark, Delta tables, Java Spark, Terraform. Responsibilities cover migration to Azure-native, optimizing over 500 ETL/ELT jobs, ML model tuning, managing 12 TB data, automation, and regulatory compliance support. Knowledge of Docker, Kubernetes, CI/CD is required.

new

Senior / Lead Data Software Engineer (Python, Spark, Azure)

Company: EPAM Systems (Poland) sp. z o.o.

from: 4 September 2026
to: 4 October 2026
salary not specifiedB2B contract (full-time)
salary not specifiedcontract of employment
Offer parameters
level:expert
working mode:hybrid
Wrocław, Krzyki
Wrocław, KrzykiGenerała Romualda Traugutta 43View on map

Requirements

Expected technologies

Pytest
Spark
Microsoft Azure
PySpark
Docker
Kubernetes
Terraform Cloud
Gtilab

Our requirements

  • Proficiency in Python and Spark with at least 3 years in data engineering roles
  • Strong experience with Azure Databricks and PySpark
  • Proven expertise in designing and implementing ETL/ELT solutions
  • Experience migrating big data platforms to Azure-native services
  • Proficiency with Delta tables for model tuning
  • Knowledge of data governance and regulatory compliance frameworks
  • Familiarity with Docker, Kubernetes (AKS), and Terraform for infrastructure automation
  • Ability to manage large data volumes with high efficiency
  • Excellent problem-solving and analytical skills
  • Strong communication and collaboration abilities
  • English proficiency at B2 level or higher

Your responsibilities

  • Migrate and optimize over 500 data jobs using Azure Databricks optimization techniques
  • Manage and process 12 TB of data efficiently across platforms
  • Tune machine learning models for Azure environments using Java Spark and Delta tables
  • Update and maintain libraries to address security vulnerabilities
  • Develop and maintain ETL/ELT pipelines using PySpark and related technologies
  • Collaborate with cross-functional teams to integrate GenAI capabilities into data workflows
  • Monitor data quality and implement improvements to ensure accuracy and reliability
  • Automate deployment and operational tasks using Terraform and GitLab CI/CD
  • Support data governance initiatives to comply with regulatory standards
  • Troubleshoot and resolve performance issues in data processing systems
  • Document system processes and provide technical guidance to junior engineers
  • Implement best practices for code quality and data security
  • Participate in code reviews and knowledge sharing sessions
  • Optimize costs associated with data storage and processing

About the project

We are seeking a Senior/Lead Data Software Engineer to join our team working on a scalable, ML-ready platform that enhances portfolio model development and deployment with advanced data governance and AI capabilities.
You will play a key role in migrating from an IaaS Big Data platform to Azure-native Databricks, optimizing data workflows and improving data quality. Join us to contribute to innovative solutions that boost client services and regulatory compliance.

This is how we organize our work

This is how we work

agile

This is how we work on a project

  • Continuous Deployment
  • Continuous Integration
  • documentation
  • issue tracking tools

What we offer

We gather like-minded people:
  • Top tech minds driving innovation in AI, cloud and digital platform modernization
  • Supportive team and agile, startup-like culture
  • Hybrid by design mode and opportunity to work remotely within Poland
  • Chance to work abroad for up to 60 days annually
  • Business-driven relocation opportunities
  • We provide growth opportunities:
  • Career development programs
  • Thought leadership, mentoring, soft skills and well-being programs
  • Certification (Anthropic, Gemini, GCP, Azure, AWS)
  • English classes
  • We cover it all:
  • Stable pay
  • Participation in the Employee Stock Purchase Plan with a 15% discount
  • Benefits package (health insurance, multisport, shopping vouchers)
  • Referral bonuses up to $2,000
  • Offices featuring entertainment and relaxation zones, table tennis and football, free snacks, coffee and more
  • Corporate, social and well-being events
  • Please, note:
  • Benefits listed above are available to employees only
  • We are open for working with Contractors. Terms of B2B cooperation agreements are agreed individually
  • We will reach out to selected candidates exclusively
  • Development opportunities we offer

    • conferences in Poland
    • development budget
    • external training
    • industry-specific e-learning platforms
    • intracompany training
    • mentoring
    • soft skills training
    • space for experimenting
    • support of IT events
    • technical knowledge exchange within the company

    Recruitment stages

    • 1.
      Recruiter Interview (30 min)
    • 2.
      Technical Interview (90 min)
    • 3.
      Manager Interview (60 min)
    • 4.
      Meeting with the Project Team or Client (60 min, optional)
    • 5.
      Welcome Aboard!

    EPAM Systems (Poland) sp. z o.o.

    EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential
    Senior / Lead Data Software Engineer (Python, Spark, Azure)
    I apply to:
    EPAM Systems (Poland) sp. z o.o.
    Wrocław, Krzyki
    Pracodawca zbiera zgłoszenia przez swój system.
    Przejdziesz na zewnętrzny formularz.

    By clicking "Aplikuj" you confirm that you've read and accepted our Terms and Conditions.



    This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

    Need more information?

    • Make sure the body of the offer doesn’t already include what you’re looking for.
    • Ask a question if you need more information you’re interested in.
    • We’ll forward your question to the employer and aim to provide a response within 3 business days.

    Share this offer