AI
Evaluations Lead: 26-03084
Akraya, Inc.
- 🇺🇸 United States
- On-site
- Staff / Principal
- 1 day ago
- Machine Learning
- AI
1 day ago
Not enough detail in this posting to match
Contract Type:Â W2
Duration:Â 8 MonthsÂ
Location: Oakland CA (#LI-HYBRID)
Pay Range: $55-$60/HR W2
#LP
Job Summary:
This role is critical in ensuring the quality and scalability of Large Language Model outputs for TurboTax by leading human evaluation processes. You will be responsible for designing and overseeing these evaluations to directly improve AI model performance and customer experiences. Your work will transform raw AI outputs into valuable solutions that address user needs.
Key Responsibilities:
- Oversee AI evaluation processes and ensure adherence to quality standards.
- Collaborate with engineering to generate AI outputs for various applications.
- Train and guide evaluators to produce high-quality data.
- Analyze evaluation results to identify trends and insights.
- Prioritize data requests in conjunction with product teams.
- Proficiency in AI evaluation and quality management.
- Strong project management and operational skills.
- Excellent communication and cross-functional collaboration abilities.
Experience in the financial services or tax technology domain is preferred.
ABOUT AKRAYA
Akraya is an award-winning IT staffing firm consistently recognized for our commitment toexcellence and a thriving work environment. Most recently, we were recognized Stevie Employer of the Year 2025, SIA Best Staffing Firm to work for 2025, Inc 5000 Best Workspaces in US (2025 & 2024) and Glassdoor's Best Places to Work (2023 & 2022)!
Industry Leaders in Tech Staffing
As Talent solutions provider for Fortune 100 Organizations, Akraya's industry recognitions solidify our leadership position in the IT staffing space. We don't just connect you with great jobs, we connect you with a workplace that inspires!
Join Akraya Today!
Let us lead you to your dream career and experience the Akraya difference. Browse our open positions and join our team!
Evaluations Lead: 26-03084 · Akraya, Inc.