Senior Product Data Scientist, Google Home Quality and Intelligence
- linkCopy link
- emailEmail a friend
Minimum qualifications:
- Bachelor's degree in Statistics, Mathematics, Data Science, Engineering, Physics, Economics, or a related quantitative field.
- 8 years of experience using analytics to solve product or business problems, performing statistical analysis, and coding (e.g., Python, R, SQL) or 5 years of experience with a Master's degree.
- Experience in causal inference analysis.
Preferred qualifications:
- Master's degree in Statistics, Mathematics, Data Science, Engineering, Physics, Economics, or a related quantitative field.
- Experience in large language model (LLM) quality assessment and evaluation, including human evals and LLM-as-judge autoraters.
About the job
Google Home is transitioning from a reactive tool, driven by voice commands and simple logic, to a proactive, autonomous agent powered by Gemini.The Home Quality and Intelligence Data Science team is seeking a Senior Data Scientist to support this transition. In this role, you will collaborate with a team of executive practitioners to build the evaluation frameworks that quantify "intelligence" and "reliability" in non-deterministic environments. You will interpret how product and engineering choices impact the home experience, providing the data signal needed to drive decisions in the technical uncertainty. You will also contribute to advancing agentic data science within the team — using AI to automate our internal workflows and scale our collective impact.The US base salary range for this full-time position is $163,000-$237,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.
Responsibilities
- Interpret our collection of automated and human quality metrics as indicators of overall product health, identifying high-impact headroom opportunities — for example, combining autorater scores and user telemetry to pinpoint where the Gemini agent needs improvement.
- Advocate for a culture of metric-informed decision-making, experimentation, and high-quality data modeling.
- Act as a go-to expert within the team on specific data science methodologies related to AI evaluation.
- Build and prototype analysis and business cases iteratively to provide insights at scale. Develop comprehensive knowledge of Google data structures and metrics, advocating for changes where needed for product development.
- Stay abreast of the latest advancements in AI evaluation, data science, and agentic AI, and apply them to improve our team's practices.
Information collected and processed as part of your Google Careers profile, and any job applications you choose to submit is subject to Google's Applicant and Candidate Privacy Policy.
Google is proud to be an equal opportunity and affirmative action employer. We are committed to building a workforce that is representative of the users we serve, creating a culture of belonging, and providing an equal employment opportunity regardless of race, creed, color, religion, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition (including breastfeeding), expecting or parents-to-be, criminal histories consistent with legal requirements, or any other basis protected by law. See also Google's EEO Policy, Know your rights: workplace discrimination is illegal, Belonging at Google, and How we hire.
If you have a need that requires accommodation, please let us know by completing our Accommodations for Applicants form.
Google is a global company and, in order to facilitate efficient collaboration and communication globally, English proficiency is a requirement for all roles unless stated otherwise in the job posting.
To all recruitment agencies: Google does not accept agency resumes. Please do not forward resumes to our jobs alias, Google employees, or any other organization location. Google is not responsible for any fees related to unsolicited resumes.