Senior Data Engineer / Data Architect – Azure Data Explorer, IoT streaming (Freelance)
Offer summary

(Summary generated by AI based on the full job description)

Project concerns an environmental monitoring platform for industry with a working IoT streaming PoC on Azure to be taken to production. Technologies used include Azure Data Explorer (Kusto), Event Hubs / IoT Hub, Azure Functions, Blob Storage, Python and Terraform. Responsibilities include taking over the PoC and delivering production pipeline, building the stream processor into ADX, designing cascade rollups and time-window aggregations (raw/Bronze → Silver → aggregates), implementing reprocessing, ADX table modelling and optimisation, and collaborating with PM, ADX specialist, client engineering and DevOps. Required experience covers 2–3 data pipeline projects delivered to production and KQL/ADX production experience for large data volumes. Offer includes remote work and flexible hours.

quick applyyou can start ASAP

Senior Data Engineer / Data Architect – Azure Data Explorer, IoT streaming (Freelance)

Company: STARTUP DEVELOPMENT HOUSE sp. z o.o.

from: 22 October 2026
to: 21 November 2026
160 - 200 złnet (+ VAT)/ hr.B2B contract (additional / temporary, part time)
Salary details
basic salary
Offer parameters
level:senior
working mode:remote
Warszawa, Śródmieście
Warszawa, ŚródmieścieAleje Jerozolimskie 81View on map

Requirements

Expected technologies

Azure Data Explorer
KQL
Python
Terraform

Optional technologies

PostgreSQL
PostGIS
TypeScript
NestJS

Our requirements

Must-have:
  • At least 2–3 data pipeline projects taken from zero to production in the role of architect or lead data engineer, with Azure Data Explorer in production in at least one of them.
  • Experience:
  • Senior experience in data engineering (around 5+ years), including IoT streams and time-series data
  • Broad, hands-on experience with Azure data services
  • Tech skills:
  • Azure Data Explorer (Kusto) and KQL: table modelling, update policies, materialized views, retention policies, query optimisation for large volumes
  • Streaming ingestion on Azure: IoT Hub, Event Hubs, parsing functions (e.g. Azure Functions), Blob Storage
  • Layered data architecture (raw/Bronze → Silver → aggregates), designing rollups and time-window aggregations
  • Python
  • Terraform
  • Soft skills:
  • Independence – you can own a production pipeline end to end without hand-holding
  • At least B2 in English – we work internationally, so that's a must
  • Strong collaboration and communication skills – you'll work with several teams
  • Attention to detail
  • Optional
  • Environmental data (spectra, multi-parameter data, interval and event data)
  • Preparing data for ML (e.g. anomaly detection) and near-real-time queries
  • PostgreSQL/PostGIS and spatial data
  • Edge devices / edge computing
  • TypeScript/NestJS
  • Your responsibilities

    • Take over the PoC and bring it to production – the data semantics are already defined, so you can focus on the pipeline.
    • Build the stream processor from Event Hubs to Azure Data Explorer.
    • Design and schedule the cascade of rollups and time-window aggregations (raw/Bronze → Silver → aggregates).
    • Implement reprocessing of data after configuration changes.
    • Model and optimise ADX tables, update policies, materialized views, retention policies and queries for large data volumes.
    • Work closely with our PM, our ADX specialist, the client's engineering team and our DevOps.

    About the project

    We connect talented freelancers with cutting-edge projects, offering a platform for you to showcase your expertise and thrive in a collaborative environment.
    Currently we are looking for a Senior Data Engineer with architect skills to join an environmental monitoring platform for industry. You'll take over a working proof of concept of a streaming IoT measurement pipeline on Azure and bring it to production – from edge devices, through the raw layer, to read-optimised data and rollups in Azure Data Explorer.
    📍 Location: Remote/Warsaw Office
    Start: November

    This is how we organize our work

    This is how we work

    in houseyou have influence on the choice of tools and technologiesyou have influence on the technological solutions appliedyou have influence on the productagile

    This is how we work on a project

    • code review
    • design patterns
    • DDD
    • event modeling
    • DevOps
    • documentation
    • issue tracking tools
    • functional tests
    • integration tests
    • regression tests
    • testing environments
    • unit tests
    • manual tests

    How to apply

    Along with your CV, please send a short description of 2–3 data pipelines you took to production. For each one: your role, scope, stack, data scale, what went wrong and what you would do differently – plus a link or reference if possible.
    Company

    Development opportunities we offer

    • mentoring
    • space for experimenting
    • technical knowledge exchange within the company
    • time for development of your ideas

    Benefits

    • remote work opportunities
    • flexible working time

    Recruitment stages

    • 1.
      First call 🤙
    • 2.
      Tech interview 👥
    • 3.
      Offer

    STARTUP DEVELOPMENT HOUSE sp. z o.o.

    At Startup House we deliver end-to-end AI software for enterprises like Siemens, PwC and Toyota.
    Senior Data Engineer / Data Architect – Azure Data Explorer, IoT streaming (Freelance)
    160–200 zł / hr. (B2B)
    I apply to:
    STARTUP DEVELOPMENT HOUSE sp. z o.o.
    Warszawa, Śródmieście

    Need more information?

    • Make sure the body of the offer doesn’t already include what you’re looking for.
    • Ask a question if you need more information you’re interested in.
    • We’ll forward your question to the employer and aim to provide a response within 3 business days.

    Share this offer