job details

Back to jobs search

Jobs search results

2,495 jobs matched
Back to jobs search

Data Science Manager, Search Quality, Magi AI Overviews

GoogleMountain View, CA, USA

Minimum qualifications:

  • Master's degree in Statistics, Data Science, Mathematics, Physics, Economics, Operations Research, Engineering, or a related quantitative field, or equivalent practical experience.
  • 8 years of work experience using analytics to solve product or business problems, coding (e.g., Python, R, SQL), querying databases or statistical analysis, or 6 years of work experience with a PhD degree.

Preferred qualifications:

  • 12 years of experience using analytics to solve product or business problems, coding (e.g., Python, R, SQL), querying databases or statistical analysis, or 10 years of experience with a PhD degree.
  • 6 years of experience as a people manager within a technical leadership role.

About the job

As a key member of the team, you will work with engineers and researchers to analyze/interpret data, develop metrics, and integrate new methodologies into existing evaluation systems. You will work with stakeholders to help prioritize data science efforts and provide technical leadership within the team.

In this role, you will help lead a team of data scientists working to evaluate and improve the Google Search user experience. You will work on challenging problems at the frontiers of Generative AI evaluation, and collaborate cross-functionally. We use available data sources (e.g., human ratings, offline eval, live experiments, user surveys, etc) to bring investigative expertise and statistical methods to the challenges of measuring quality, developing metrics, and improving training data for model development.
The US base salary range for this full-time position is $177,000-$266,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. The range displayed on each job posting reflects the minimum and maximum target salaries for the position across all US locations. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about benefits at Google.

Responsibilities

  • Collaborate with stakeholders in cross-projects and team settings to identify and clarify business or product questions to answer. Provide feedback to translate and refine business questions into tractable analysis, evaluation metrics, or mathematical models.
  • Use custom data infrastructure or existing data models as appropriate, using specialized knowledge. Design and evaluate models to mathematically express and solve problems with limited precedent.
  • Gather information, business goals, priorities, and organizational context around the questions to answer, as well as the existing and upcoming data infrastructure.
  • Own the process of gathering, extracting, and compiling data across sources via relevant tools (SQL, R, Python). Ensure quality, and review the dataset to ensure it is ready for analysis.
  • Develop analysis methods to improve the quality of Google Search. Develop expertise in evaluation and application of Large Language Model and Generative AI.

Information collected and processed as part of your Google Careers profile, and any job applications you choose to submit is subject to Google's Applicant and Candidate Privacy Policy.

Google is proud to be an equal opportunity and affirmative action employer. We are committed to building a workforce that is representative of the users we serve, creating a culture of belonging, and providing an equal employment opportunity regardless of race, creed, color, religion, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition (including breastfeeding), expecting or parents-to-be, criminal histories consistent with legal requirements, or any other basis protected by law. See also Google's EEO Policy, Know your rights: workplace discrimination is illegal, Belonging at Google, and How we hire.

If you have a need that requires accommodation, please let us know by completing our Accommodations for Applicants form.

Google is a global company and, in order to facilitate efficient collaboration and communication globally, English proficiency is a requirement for all roles unless stated otherwise in the job posting.

To all recruitment agencies: Google does not accept agency resumes. Please do not forward resumes to our jobs alias, Google employees, or any other organization location. Google is not responsible for any fees related to unsolicited resumes.

Google apps
Main menu