AI Training Scenarios Reviewer (Quality Control) – Remote Contract

Role Overview

As anAI Training Scenarios Reviewer, you will act as the final quality checkpoint for simulated environments and tasks designed to train advanced AI agents. You will audit detailed digital worlds (e.g., email, messaging, calendars, file systems) and evaluate whether they effectively challenge AI reasoning without introducing errors or inconsistencies.

This role is ideal for individuals with strongQA, auditing, editing, or analytical review experience.

Key Responsibilities

• Review and evaluate AI training scenarios, personas, and digital environments forlogical consistency and structure

• Apply detailed grading rubrics to assessquality, realism, and task effectiveness

• Identifyerrors, inconsistencies, missing context, and technical flaws (e.g., broken JSON structures)

• Provideclear, actionable feedback to improve scenario quality

• Document evaluations, scores, and feedback using structured tools (e.g., Airtable and internal platforms)

What We’re Looking For

• Proven experience inQA, auditing, editing, or reviewing complex content

• Strong analytical thinking and exceptional attention to detail

• Ability to apply structured evaluation frameworks consistently

• Comfortable working with tools such asAirtable, JSON editors, and AI platforms

• Ability to provide structured, constructive feedback

• Self-driven with strong organizational skills

Minimum Requirements:

• Bachelor’s degree

• At least2 years of professional experience

• Availability for~40 hours per week

Nice to Have

• Background inediting, QA testing, technical review, or compliance auditing

• Familiarity withJSON structures and data workflows

• Experience with tools likeJira, Asana, SQL, or Python

• Experience inoperations, systems design, or process management

Compensation & Terms

• Independent contractor engagement

• Fully remote with flexible working environment

• Project duration may vary based on performance and business needs

• Weekly payments based on services rendered

Equal Opportunity

We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.