Engineering Analyst, Generative AI, Trust and Safety
- linkCopy link
- emailEmail a friend
Minimum qualifications:
- Bachelor's degree or equivalent practical experience.
- 2 years of experience in data analysis, including identifying trends, generating summary statistics, and drawing insights from quantitative and qualitative data.
- 2 years of experience managing projects and defining project scope, goals, and deliverables.
Preferred qualifications:
- Master's degree in a quantitative field.
- 2 years of experience with one or more of the following languages such as SQL, R, Python, or C++.
- Experience analyzing ML models performance or working on Large Language Models, and using statistical analysis, hypothesis testing.
- Experience working with abuse, spam, fraud, or malware.
- Experience working on product policy analysis and identifying policy risks.
- Excellent communication skills.
About the job
Fast-paced, dynamic, and proactive, YouTube’s Trust & Safety team is dedicated to making YouTube a safe place for users, viewers, and content creators around the world to create, and express themselves. Whether understanding and solving their online content concerns, navigating within global legal frameworks, or writing and enforcing worldwide policy, the Trust & Safety team is on the frontlines of enhancing the YouTube experience, building internet safety, and protecting free speech in our ever-evolving digital world.
The Trust and Safety team reduces risk and protects the experience of our users and business partners across Google's expanding base of products. We work with a variety of teams from Engineering to Legal and Public Policy to set policies and combat fraud and abuse in a scalable way, often with an eye to finding industry-wide solutions. Trust and Safety team members are motivated to find innovative solutions, and use technical know-how, user insights and proactive communication to pursue the highest possible quality and safety standards for users across Google products.
Responsibilities
- Help to establish metrics to benchmark Generative AI issues and quantify improvements. Develop datasets and run evals for engineers to evaluate and improve search, labs and assistant products.
- Perform complex data analyses to derive insights that help identify and fight abuse across our products.Use technical judgment to drive project delivery, challenge proposals and identify risks.
- Improve tools through data analysis, technical expertise, and presentations to key stakeholders. Enhance our operational workflows via process improvements and identification of automation opportunities.
- Analyze and debug escalations and identify trends that can indicate bigger product risks .Perform on-call responsibilities on a rotating basis, including weekend coverage.
- Manage multiple interdependent projects of moderate to high complexity and scope against crashed timelines.
Information collected and processed as part of your Google Careers profile, and any job applications you choose to submit is subject to Google's Applicant and Candidate Privacy Policy.
Google is proud to be an equal opportunity and affirmative action employer. We are committed to building a workforce that is representative of the users we serve, creating a culture of belonging, and providing an equal employment opportunity regardless of race, creed, color, religion, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition (including breastfeeding), expecting or parents-to-be, criminal histories consistent with legal requirements, or any other basis protected by law. See also Google's EEO Policy, Know your rights: workplace discrimination is illegal, Belonging at Google, and How we hire.
If you have a need that requires accommodation, please let us know by completing our Accommodations for Applicants form.
Google is a global company and, in order to facilitate efficient collaboration and communication globally, English proficiency is a requirement for all roles unless stated otherwise in the job posting.
To all recruitment agencies: Google does not accept agency resumes. Please do not forward resumes to our jobs alias, Google employees, or any other organization location. Google is not responsible for any fees related to unsolicited resumes.