Lead Cybersecurity Data Engineer

Technologies we use

About the project

Your responsibilities

• Ingestion and provisioning of raw datasets, enriched tables, and/or curated, re-usable data assets to enable Cybersecurity use cases.
• Driving improvements in the reliability and frequency of data ingestion including increasing real-time coverage.
• Identifying and onboarding data sources using existing schemas and, where required, conducting exploratory data analysis to investigate and determine new schemas.
• Extract Translate and Load (ETL) workflows, using both advanced data manipulation tools and programmatically manipulating data throughout our data flows, ensuring data is available at each stage in the data flow, and in the form needed for each system, service, and customer along said data flow.
• Designing and implementing data pipelines that will collect data from disparate sources across the enterprise, and from external sources, transport said data, and deliver it to our data platform.

Our requirements

• Demonstrable experience of Linux administration and scripting (preferably Red Hat Systems).
• Experience with Python, Spark, SQL, Databricks, Azure Function App, Azure DevOps and Terraform.
• Understanding of hardware and software principles and storage technologies (SSD, HDD, NVMe), CPU architectures, and Memory & Operating system principles (especially network stack fundamentals).
• Understanding of network protocols and network design.
• Designing, building, and maintaining data pipelines and ETL workflows across disparate datasets.
• Experience in applying data engineering methods to the cyber security domain.
• Bachelor’s degree in any Science, Technology, Engineering field accompanied with data, technology and/or programming experience also considered.
• Proficiency in programming languages such as Python, Java, C#, or similar preferred.
• Experience with server, operating system, and infrastructure technologies such as Nginx/Apache, CosmosDB, Linux, Bash, PowerShell, Prometheus, Grafana, Elasticsearch).
• Experience operating in highly regulated industry, e.g., Financial Services advantageous.

What we offer

• Competitive salary
• Annual performance-based bonus
• Additional bonuses for recognition awards
• Multisport card
• Private medical care
• Life insurance
• One-time reimbursement of home office set-up (up to 800 PLN)
• Corporate parties & events
• CSR initiatives
• Nursery discounts
• Financial support with trainings and education
• Social fund
• Flexible working hours
• Free parking

Benefits

• sharing the costs of sports activities
• private medical care
• sharing the costs of professional training & courses
• life insurance
• flexible working time
• integration events
• corporate sports team
• doctor’s duty hours in the office
• retirement pension plan
• corporate library
• no dress code
• coffee / tea
• parking space for employees
• leisure zone
• extra social benefits
• employee referral program
• opportunity to obtain permits and licenses
• charity initiatives
• family picnics
• extra leave
• In-office gym

Recruitment stages

• 1.
  Online assessment
• 2.
  Phone interview
• 3.
  Job interview
• 4.
  Welcome to HSBC!

HSBC Service Delivery (Polska) Sp. z o.o.