Senior AI Engineer with .NET

Our requirements

• 6+ years of hands-on engineering experience, with at least 3 years focused on production AI and LLM applications.
• Strong .NET and C# background. Main day-to-day language for building AI services, RAG pipelines, agents, and evaluation tooling.
• Strong, demonstrable experience integrating with LLM APIs and SDKs in production.
• Hands-on experience with prompt engineering, RAG architectures, and LLM orchestration.
• Strong, demonstrable experience designing and operating LLM evaluation frameworks in production. Accuracy metrics, hallucination detection, regression testing, ground truth dataset design, and output monitoring.
• Hands-on experience with Azure AI Foundry or comparable evaluation and monitoring platforms.
• Solid software engineering fundamentals. API design, testing, version control, CI/CD.
• Strong communication. Able to engage with clinicians and non-technical stakeholders on what model evaluation means in practice.
• Fluent English (working language of the team).

Optional

• Hands-on experience with Semantic Kernel or comparable agentic frameworks for building multi-step reasoning, tool use, and conversational agents in production.

Your responsibilities

• Building RAG pipelines using Azure AI Search and Semantic Kernel, contributing to core implementation alongside the Tech Lead.
• Owning the evaluation framework for model outputs across the full system — accuracy metrics, hallucination detection, clinical safety checks, regression testing across versions — using Azure AI Foundry evals and custom C# tooling.
• Designing and maintaining ground truth datasets for evaluation, in collaboration with clinicians and content partners.
• Building production monitoring for model outputs using Azure Monitor and Application Insights — drift detection, quality regressions, anomaly alerts.
• Integrating with the Corti C# SDK for real-time output capture and evaluation pipelines.
• Defining clean API contracts within the .NET and Angular platform on Azure.
• Pairing with the architecture-focused Senior AI Engineer on day-to-day implementation, and sharing knowledge with the in-house engineering team.

About the project

This is how we work on a project

• Continuous Deployment
• Continuous Integration
• documentation
• issue tracking tools
• regression tests
• testing environments

What we offer

• Opportunity to shape the AI architecture of a Medical Device Class IIa module used by millions of European users.
• Work alongside a strong in‑house engineering team and a dedicated second Senior AI Engineer focused on quality and evaluation.
• Significant technical ownership and influence over integration, orchestration and certification activities (MDR, AI Act alignment).
• Hands‑on exposure to state‑of‑the‑art LLM platforms, agent frameworks and Azure‑based production environments.
• Professional responsibility that combines implementation, architecture leadership and cross‑functional collaboration.
• Remote work
• Unique TEAL culture, relationship- and respect-driven community, non-corporate atmosphere.
• Agile approach and no bureaucracy.
• Outstanding integration trips to various places in Europe for all employees.
• Activities to support your well-being and health.
• Luxmed Gold Extended medical care and Multisport Plus benefit.

Benefits

• sharing the costs of sports activities
• private medical care
• sharing the costs of professional training & courses
• remote work opportunities
• flexible working time
• integration events

YOUR ITEAMS sp. z o.o.