Opening. This role is a premier opportunity to lead the shift toward personalized, high-utility alignment that sets the global bar for human-AI collaboration.
What you'll do
You will be responsible for the "intelligence and soul" of the Gemini experience. You will define the evaluation frameworks that measure response quality and lead cross-functional efforts to tune the model's output for Critical User Journeys.
- Define the Quality Bar: Develop and maintain North Star metrics for Response Quality, defining "helpfulness" across text, code, and multimodal modalities.
- Cohort-Specific Optimization: Identify the needs of Critical User Cohorts (e.g., power users vs. casual seekers), analyze performance gaps, and prioritize model tuning to address them.
- Own User Journey Excellence: Ensure the model provides a frictionless, accurate, and delightful experience for the most vital user journeys.
- Implicit Alignment & Tuning: Partner with Research and Data Operations to steer model outputs through SFT (Supervised Fine-Tuning) and RLHF, translating qualitative feedback into structured data strategies.
- Evaluation Strategy: Design and scale sophisticated human-in-the-loop and "LLM-as-a-judge" evaluation pipelines to understand model performance in Side-by-Side (SxS) testing.
What you need
- 6+ years of progressive experience in product management, including at least 5 years in senior roles leading consumer products
- Track record of building consumer products with millions of users that people genuinely love
- Experience with AI or ML-powered products and a perspective on how AI will change consumer software
- Comfort with ambiguity and the ability to define product direction in a fast-moving, novel space
- User-obsessed mindset with a habit of talking to users directly and frequently
