Software Engineer III - Agent Quality and Efficiency Optimization

Our requirements

• Bachelor’s degree or equivalent practical experience.
• 2 years of experience with software development in one or more programming languages such as Go, C++ or Python, or 1 year of experience with an advanced degree.
• 2 years of experience with machine learning, large language models (LLMs), or applied AI.

Optional

• Master's degree or PhD in Computer Science, Machine Learning, or a related technical field.
• Experience building, deploying, or optimizing LLM applications or agentic frameworks (e.g., Agent Development Kit, LangGraph, LangChain).
• Experience with one or more of the following: model serving optimization, inference caching, model routing or LLM cost and latency profiling.
• Experience instrumenting, benchmarking, or evaluating ML systems in production.
• Experience with technical leadership, mentoring engineers, or driving cross-team engineering initiatives.

Your responsibilities

• Design, build, and ship agent optimization systems that turn multiple sources of insights (like eval results, production traces, etc.) into persistent improvements, auto-formed skills, recipes for prompt and tool tuning, per-task cost and quality telemetry, smart model routing, durable and deferred execution, and continuous optimization, across the Agent Development Kit and Vertex AI serving stack.
• Measure quality, cost, and latency per task, and use that data to drive engineering work.
• Shape the team's optimization roadmap, and help set technical direction for how enterprise agents get better and cheaper over time.
• Build benchmark optimization techniques on both open source benchmarks and real first-party and enterprise agent workloads to prove quality and efficiency wins hold up together.

About the project

Benefits

• sharing the costs of sports activities
• private medical care
• sharing the costs of foreign language classes
• sharing the costs of professional training & courses
• life insurance
• remote work opportunities
• fruits
• corporate products and services at discounted prices
• integration events
• dental care
• corporate gym
• corporate sports team
• retirement pension plan
• saving & investment scheme
• corporate library
• no dress code
• coffee / tea
• drinks
• parking space for employees
• leisure zone
• extra social benefits
• meal passes
• redeployment package
• employee referral program
• opportunity to obtain permits and licenses
• charity initiatives
• extra leave