Scaled Abuse Analyst, YouTube Trust and Safety
- linkCopy link
- emailEmail a friend
Minimum qualifications:
- Bachelor's degree or equivalent practical experience.
- 2 years of experience in data analytics, Trust and Safety, policy, cybersecurity, or related fields.
Preferred qualifications:
- Experience in content policy, anti-abuse, and reviewing online content.
- Experience with identifying abuse trends or working in news or policy.
- Experience with SQL and spreadsheets.
- Ability to build relationships with cross-functional partners across geographies.
- Excellent problem-solving skills, with the ability to use data to drive strategy and business action.
About the job
Fast-paced, dynamic, and proactive, YouTube’s Trust & Safety team is dedicated to making YouTube a safe place for users, viewers, and content creators around the world to belong, create, and express themselves. Whether understanding and solving their online content concerns, navigating within global legal frameworks, or writing and enforcing worldwide policy, the Trust & Safety team is on the frontlines of enhancing the YouTube experience, building internet safety, and protecting free speech in our ever-evolving digital world.
As a Scaled Abuse Analyst, you will be responsible for working with a global team from policy, enforcement, product, engineering, tooling, and legal to prevent violative content from appearing on the platform. You will evaluate abuse trends and develop creative solutions to address detection gaps, quality workflows, and processes. You will also review decisions about the appropriateness of different content. You will grow in a paced, dynamic, and demanding environment where the threat actor landscape is constantly evolving.
In this role, you will be a contributor to the efforts to reduce harmful content on YouTube. You will be part of a team that oversees emerging threats to the YouTube platform and user base. These threats include, influence operations, financially motivated abuse, sensationalist news, with a focus on deceptive practices.
At YouTube, we believe that everyone deserves to have a voice, and that the world is a better place when we listen, share, and build community through our stories. We work together to give everyone the power to share their story, explore what they love, and connect with one another in the process. Working at the intersection of cutting-edge technology and boundless creativity, we move at the speed of culture with a shared goal to show people the world. We explore new ideas, solve real problems, and have fun — and we do it all together.
Responsibilities
- Research and stay up-to-date on trends and suspicious patterns of abuse across the team’s policy areas. Oversee enforcement quality across team policy areas, including calibrations with vendor teams.
- Utilize methods to analyze data sets to gain insights into the impact of abuse on the YouTube ecosystem with knowledge of SQL and dashboarding.
- Leverage SQL and programming skills to provide rapid incident response for abuse problems, operating with minimal guidance. Analyze and draw conclusions on root-causes and define and implement mitigation steps.
- Contribute to the strategy and development of new workflows to address additional known and emerging vectors of abuse. Apply and develop machine learning models (e.g., using LLMs, BERT) to detect, prevent various types of abuse on YouTube.
- Develop Machine Learning (ML) based detection systems for different adversarial and large scale coordinated abuse vectors.
Information collected and processed as part of your Google Careers profile, and any job applications you choose to submit is subject to Google's Applicant and Candidate Privacy Policy.
Google is proud to be an equal opportunity and affirmative action employer. We are committed to building a workforce that is representative of the users we serve, creating a culture of belonging, and providing an equal employment opportunity regardless of race, creed, color, religion, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition (including breastfeeding), expecting or parents-to-be, criminal histories consistent with legal requirements, or any other basis protected by law. See also Google's EEO Policy, Know your rights: workplace discrimination is illegal, Belonging at Google, and How we hire.
If you have a need that requires accommodation, please let us know by completing our Accommodations for Applicants form.
Google is a global company and, in order to facilitate efficient collaboration and communication globally, English proficiency is a requirement for all roles unless stated otherwise in the job posting.
To all recruitment agencies: Google does not accept agency resumes. Please do not forward resumes to our jobs alias, Google employees, or any other organization location. Google is not responsible for any fees related to unsolicited resumes.