Lead Data Engineer (AWS+Snowflake)

Our requirements

• Ability to work partially within the U.S. time zone (during onboarding: calls up to 9:30 PM CET 3x a week; later: up to 6/7:00 PM CET.)
• Team Lead experience (or leadership potential and readiness) to lead the team and serve as the primary client contact
• 6 + years of experience as a Data Engineer/Data Scientist
• Proficiency in SQL, Python, AWS (Lambda, Airflow, Redshift)
• Solid knowledge of the Snowflake ecosystem (knowledge of SnowPipes, Streams, Views, performance tuning, data modeling, ELT pipelines, data visualizations, and standard DWH concepts, and experience implementing complex SQL stored procedures)

Optional

• Working experience of AI concepts such as Generative AI chatbots, Cortex Analyst, agent training, various LLMs, and prompt engineering
• Working knowledge of Databricks
• Expertise in building and maintaining APIs; Swagger/OpenAPI spec, Node, and Next.js

Your responsibilities

• Working with a wide range of AWS services to integrate and deploy cloud components
• Building data pipelines for processing financial data delivered directly to Redshift
• Designing and maintaining scalable data pipelines
• Assessing downstream impacts on processing flows
• Performing root cause analysis and implementing preventive measures
• Implement and enforce data security measures to protect sensitive data, including personally identifiable information (PII) and financial data
• Leverage SQL and Python programming proficiency to extract, transform, clean, and interpret large data volumes (200BIL+ records)
• Set technical priorities for the team and provide support in resolving complex incidents
• Collaborate with the client's technical leads to streamline processes and optimize overall work efficiency
• Report work progress, milestones, and updates directly to the client-side manager

About the project

This is how we organize our work

This is how we work on a project

• Continuous Deployment
• Continuous Integration
• DevOps

What we offer

• Private medical care
• Multisport card
• Friendly, informal atmosphere, and direct contact with everyone in the company
• Modern technologies

Benefits

• sharing the costs of sports activities
• private medical care
• remote work opportunities
• flexible working time
• extra social benefits
• baby layette
• school layette
• employee referral program
• charity initiatives
• Gift vouchers for kids (birthdays, Christmas, Child's Day)

Recruitment stages

• 1.
  HR call (max 15 min.)
• 2.
  Technical interview with the Acaisoft team (max 45 min.)
• 3.
  Call with our Client (+/- 60 min.)

ACAISOFT POLAND Sp. z o.o.