Likeremote

Subscribe to the latest remote jobs:

  • Likeremote jobs on https://LinkedIn.com/
  • Likeremote jobs on https://telegram.org/
  • Likeremote jobs on Reddit.com
TikTok USDS logo

Moderation Quality Assurance Specialist

TikTok USDS
  • ๐Ÿ‡บ๐Ÿ‡ธ United States
  • On-site
  • Manager or above
  • 1 month ago
  • calibration
  • AI
  • Excel
  • PowerPoint
  • Tableau
  • Data Visualization
  • Technical Writing
Not scoredNo CV on file. Upload one and this job gets a score out of 100.Upload CV

About the Team

Trust and Safety Operations is a pivotal team within U.S. Data Security. We strive to enable TikTok to become the most trusted and secure platform in the US through operational excellence in content moderation via innovations in technology, optimization in processes and investment in people. We ensure that we enforce our policies based on our community guidelines and we take appropriate actions in a timely manner to minimize risks on our platform to our users and advertisers.

This team performs a critical function that supports our efforts to address objectionable or disturbing content. Content that this role interacts with includes images, video, and text related to every-day life, but it can also include (but is not limited to) bullying; hate speech; child abuse; sexual assault; torture; bestiality; self-harm; suicide; and murder. It is possible that this role will be exposed to harmful content on a daily basis.

About the Role

The Quality Analyst on TikTok's USDS Trust and Safety team plays a key role in upholding platform quality and safety. Reporting to the Moderation Quality Manager, you will assess moderation performance, review graphic content, identify quality risks, and translate QA signals into business intelligence that inform content moderation strategy across in-house and BPO teams.

Key Responsibilities

  • Assess the overall quality of performance by moderation sites, ensuring strict compliance with TikTok's policies and processes.
  • Review TikTok content, including graphic material, to enforce policy decisions and maintain user safety.
  • Conduct weekly audits and calibration sessions, analyzing error trends to identify patterns, performance gaps, and improvement opportunities.
  • Lead system-wide root cause analyses (RCAs), QA deep dives, and data validation processes for Trust and Safety moderation queues; document and report findings to leadership.
  • Develop and deliver forward-looking, data-based strategies that shape trust and safety policies and resolve complex quality issues.
  • Serve as a functional bridge between external vendors, internal stakeholders, and the quality team; identify performance gaps and partner with vendor leadership to prepare solutions.
  • Ensure partners are on track to meet or exceed KPI targets, and support calibration processes, Monthly Quality Reports, Monthly Business Reviews, glide paths, and daily or weekly quality metric tracking.
  • Analyze quantitative and qualitative QA datasets and use visualization or descriptive reporting to generate impact-driven recommendations for Training, Product, Workforce Management, Enforcement Operations, and other department partners.
  • Develop automated reporting and ensure data quality through documentation, validation, and quality assurance of delivered insights.
  • Partner with data and analytics stakeholders on tools, dashboards, and business cases that improve QA processes for the Training and Quality Department.
  • Design and analyze product experiments and propose frameworks to communicate results.
  • Evaluate moderation AI model performance, including decision accuracy, reasoning quality, and failure patterns, to identify risks and recommend improvements to model-assisted enforcement workflows.
  • Lead ad hoc projects that enhance quality assurance practices, operational efficiency, and scalable moderation outcomes.
  • Maintain expert understanding of TikTok's policies, procedures, app features, and internal documents; act as a thought partner to foster innovation and efficiency within the team.

Minimum Qualifications

  • BA/BS degree in a relevant field or equivalent experience in content moderation, quality assurance, or similar areas.
  • 3+ years of experience in Trust & Safety or a similar industry.
  • 2+ years of experience in quality assurance, reporting, analytics, or operational excellence.
  • Experience developing analysis reports, conducting root cause analyses, and turning data into clear, actionable recommendations. Able to gather and analyze information, identify key takeaways, and explain findings clearly to both technical and non-technical audiences, verbally and in writing.
  • Experience applying policy labels or enforcement actions to media content, with a strong focus on user safety and platform integrity.
  • Skilled at identifying problems, recommending practical solutions, and understanding stakeholder needs. Able to provide guidance on both immediate and longer-term solutions, and influence others through clear, honest, and constructive communication, even without formal authority.
  • Self-motivated, organized, and comfortable working through ambiguity. Able to move between detailed data analysis and broader business insights while adapting to changing priorities. Proficient in Microsoft Office Suite, including Excel and PowerPoint, or similar platforms.

Preferred Qualifications

  • Expert-level knowledge of QA processes including auditing, RCA, and calibration.
  • Advanced content risk identification and control experience, with a complete understanding of the moderation and QA process.
  • Proven experience manipulating, processing, and extracting value from large and disconnected datasets within spreadsheets and databases.
  • Familiarity with Tableau or other data visualization tools that utilize query language.
  • Familiarity with using AI-enabled tools or workflows to automate operational processes, scale quality assurance practices, and improve team efficiency.
  • Understanding policy developments, platform trends, challenges, and online culture across media, tech, entertainment, and major social media networks.
  • Experience in technical writing and technical communication.
  • Experience working in a fast paced environment, or forming new teams in established companies.
  • Interest in project management skill development.
  • Resilience and commitment to self-care to manage the emotional demands of the role.

Moderation Quality Assurance Specialist ยท TikTok USDS

Auto apply with Likeremote