Senior Data Engineer (Databricks)

Our requirements

• At least 5 years of commercial experience implementing, developing, or maintaining Big Data systems.
• Strong programming skills in Python: writing a clean code, OOP design.
• Experience in designing and implementing data governance and data management processes.
• Familiarity with Big Data technologies like Airflow or Dagster, Databricks, Spark, Azure Event Hub or Kafka.
• Experience implementing and deploying solutions in cloud environments (with a preference for Azure).
• Knowledge of how to build and deploy Power BI reports and dashboards for data visualization.
• Excellent understanding of dimensional data and data modeling techniques.
• Excellent communication skills and consulting experience with direct interaction with clients.
• Ability to work independently and take ownership of project deliverables.
• Master’s or Ph.D. in Computer Science, Data Science, Mathematics, Physics, or a related field.

Your responsibilities

• Design scalable data processing pipelines for streaming and batch processing using Big Data technologies like Databricks, Airflow and/or Dagster.
• Contribute to the development of CI/CD and MLOps processes.
• Develop applications to aggregate, process, and analyze data from diverse sources.
• Collaborate with the Data Science team on Machine Learning projects, including text/image analysis and predictive model building.
• Develop and organize data transformations using Databricks/DBT and Apache Airflow.
• Translate business requirements into technical solutions and ensure optimal performance and quality.

About the project

This is how we organize our work

What we offer

• Work in a supportive team of passionate enthusiasts of AI & Big Data.
• Engage with top-tier global enterprises and cutting-edge startups on international projects.
• Enjoy flexible work arrangements, allowing you to work remotely or from modern offices and coworking spaces.
• Accelerate your professional growth through career paths, knowledge-sharing initiatives, language classes, and sponsored training or conferences, including a partnership with Databricks, which offers industry-leading training materials and certifications.
• Choose your preferred form of cooperation - B2B or a contract of mandate - and enjoy 20 fully paid days off.
• Participate in team-building events and utilize the integration budget.
• Celebrate work anniversaries, birthdays, and milestones.
• Access medical and sports packages, eye care, and well-being support services, including psychotherapy and coaching.
• Get full work equipment for optimal productivity, including a laptop and other necessary devices.
• With our backing, you can boost your personal brand by speaking at conferences, writing for our blog, or participating in meetups.
• Experience a smooth onboarding with a dedicated buddy, and start your journey in our friendly, supportive, and autonomous culture.

Development opportunities we offer

• assistance in preparation to public speeches
• conferences abroad
• conferences in Poland
• development budget
• external training
• industry-specific e-learning platforms
• intracompany training
• soft skills training
• substantive support from technological leaders
• support of IT events
• technical knowledge exchange within the company
• time for development of your ideas

Benefits

• sharing the costs of sports activities
• private medical care
• sharing the costs of foreign language classes
• sharing the costs of professional training & courses
• remote work opportunities
• flexible working time
• fruits
• integration events
• no dress code
• video games at work
• christmas gifts
• birthday celebration
• employee referral program
• Reimbursement for prescription glasses or contact lenses

Recruitment stages

• 1.
  Let's get to know each other (45 min)
• 2.
  Technical Interview (1 h)
• 3.
  Management Interview (1 h)

Addepto