Subscribe to the latest remote jobs:

Generative AI Quality Engineer - Senior Associate

🇮🇳 India

Management

Python

Git

Jenkins

Finance

Machine Learning

Large Language Models

Devops

Testing

Generative AI Quality Engineer - Senior Associate

from 🇮🇳 India

Who we are looking for

We are looking forSoftware Quality Assurance Testers with 3–8 years of experience, with exposure or interest inLLM (Large Language Model) testing andAgents testing. This role involves analyzing business and technical specifications, defining and executing test cases, and capturing and tracking defects.

You will work onArtificial Intelligence initiatives within a multidisciplinary team focused on emerging trends, cutting‑edge technologies, and their application in financial services for our clients.

This role supports ahybrid work model, allowing you to balance work from home and office based on your needs and role requirements.

What you will be responsible for

As anSQA Tester, you will:

  • Analyze business and technical specifications.
  • Write functional test cases and perform regression testing.
  • Report bugs, verify fixes, and maintain the bug tracking system (e.g., Jira).
  • Maintain and execute automated tests usingSelenium with Python.
  • Create automated test scripts using thePytest framework.
  • Automate web services usingPostman and/or Python.
  • Execute test plans forLarge Language Models (LLMs), including prompt validation, accuracy checks, and basic safety evaluation.
  • SupportAgents testing for AI-driven workflows to ensure reliability, robustness, and integration quality.

What we value

These skills will help you succeed in this role:

  • Ability to understand customer/business user needs and translate them into test scenarios.
  • Strong analytical, technical, and problem-solving skills with attention to detail.
  • Ability to manage time effectively and prioritize tasks while working within deadlines.
  • Experience withBDD & TDD (Gherkin).
  • Experience usingJira as an agile management tool.
  • Experience in usingSelenium with Python for test automation.
  • Experience in testingLLMs, including prompt-response validation and evaluation of model accuracy and relevance.
  • Exposure tored teaming for identifying vulnerabilities and edge cases in LLMs (preferred but not mandatory at junior level).
  • Familiarity with evaluation tools such asOpenAI Evals,Ragas, or custom benchmarking suites (good-to-have).

Education & Preferred Qualifications

  • 3–8 years of software quality assurance testing experience.
  • Experience with tools likePyCharm, VS Code, Git, Fiddler, Postman, SoapUI, JMeter, Jenkins, Jira.
  • Experience inCI/CD-based projects.
  • Hands‑on experience or strong exposure toLLM testing andAgents testing is highly preferred.

Additional Requirements

  • Basic understanding ofartificial intelligence andmachine learning concepts is preferred.
  • Familiarity withAI governance, bias detection, and safety validation will be an added advantage.

About State Street

Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success.

We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you’ll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future.

As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law.

Discover more information on jobs atStateStreet.com/careers

Read ourCEO Statement

by @maxrusakovic