Senior Staff Software Engineer, AI Agent Platform, Vertex

Our requirements

• Bachelor’s degree or equivalent practical experience.
• 8 years of experience in software development.
• 7 years of experience leading technical project strategy, ML design, and working with ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).
• 5 years of experience in systems architecture and large-scale serving infrastructure.
• Experience delivering technical solutions in a changing environment.
• Experience working in multinational or internationalised (i18n) organisations on global initiatives.

Optional

• Master’s degree or PhD in Engineering, Computer Science, or a related technical field.
• 8 years of experience with data structures and algorithms.
• 5 years of experience in a technical leadership role leading project teams and setting technical direction.
• 3 years of experience working in a complex, matrix organisations involving cross-functional, cross-timezone or cross-business projects.
• Experience in serving Generative AI models using inference frameworks or hardware accelerators (e.g., GPUs, TPUs).

Your responsibilities

• Architect, develop, and maintain robust, horizontally scalable APIs and backend infrastructure tailored specifically for Generative AI workloads.
• Optimize the routing, load balancing, quota management, and data plane mechanisms that connect user API requests to backend ML serving clusters across massive fleets of TPUs and GPUs.
• Prototype and launch new API products rapidly in a fast-paced, highly collaborative environment, rapidly to expose the latest advancements in Google's foundation models.
• Collaborate closely with ML researchers, ML serving teams, and product managers to translate complex AI capabilities into intuitive, highly reliable enterprise-grade APIs.
• Define and implement best practices for API security, high availability, fault tolerance, and comprehensive observability across distributed systems.

About the project

Benefits

• sharing the costs of sports activities
• private medical care
• sharing the costs of foreign language classes
• sharing the costs of professional training & courses
• life insurance
• remote work opportunities
• fruits
• corporate products and services at discounted prices
• integration events
• dental care
• corporate gym
• corporate sports team
• retirement pension plan
• saving & investment scheme
• corporate library
• no dress code
• coffee / tea
• drinks
• parking space for employees
• leisure zone
• extra social benefits
• meal passes
• redeployment package
• employee referral program
• opportunity to obtain permits and licenses
• charity initiatives
• extra leave