VI
AI QA Engineer
VARITE INDIA PRIVATE LIMITED
🇮🇳 India
On-site
Mid level
11 months ago
- IoT
- AI
- AI/ML
- Test Automation
- Devops
- AWS
- Azure
- GCP
- GDPR
- HIPAA
- SOC2
- MLOps
- CI/CD
- pytest
- Robot Framework
- Selenium
- Playwright
- Postman
- Performance Testing
- JMeter
- k6
- OWASP ZAP
- Burp Suite
- Computer Vision
- Natural Language Processing
- AWS SageMaker
- Azure ML
- Vertex AI
- TensorRT
- Core ML
- Python
- Bash
- Java
- GitHub Actions
- Jenkins
- GitLab CI
- Docker
- Kubernetes
- Prometheus
- Grafana
- OpenTelemetry
- Agile
- Scrum
- Unity
- Unreal Engine
11 months ago
About The Client:
An Indian multinational information technology (IT) consulting company headquartered in Noida, The company has offices in 52 countries and over 225,944 employees. The Client is a global IT services and consulting company that offers a wide range of services and products across various industries like IT Infrastructure Services, Cybersecurity Services, Cloud Services, Big Data and Analytics, Internet of Things (IoT) Solutions, Semiconductor Services and Enterprise Software Products.
About The Job:
- We are looking for an experienced AI Quality Engineer to define and implement testing strategies for AI/ML applications across cloud and edge environments.
- This role involves test automation, model quality validation, system reliability testing, and performance benchmarking.
- You will work closely with developers, data scientists, and DevOps engineers to ensure AI-powered systems are robust, explainable, and production-ready.
AI Testing & Automation
- Design and implement automated test frameworks for AI/ML pipelines (training, inference, monitoring).
- Validate model accuracy, robustness, drift, and bias across datasets.
- Develop test suites for edge AI inference, cloud deployments, and hybrid pipelines.
- Automate data validation pipelines (quality, integrity, lineage).
- Implement regression testing for AI models after retraining.
- Conduct performance, latency, and throughput testing of AI inference on cloud (AWS, Azure, GCP) and edge devices (NVIDIA Jetson, Coral TPU, ARM devices).
- Benchmark models across different hardware accelerators (CPU, GPU, TPU, NPU).
- Test OTA updates for AI models on edge devices.
- Validate resiliency, failover, and network reliability in edge–cloud AI pipelines.
- Define quality metrics for AI models (precision, recall, F1, robustness under adversarial attacks).
- Ensure AI systems meet governance, fairness, and ethical AI standards.
- Conduct security testing for model APIs and inference pipelines.
- Validate compliance with GDPR, HIPAA, SOC2 for data and AI systems.
- Work with MLOps teams to integrate quality gates into CI/CD pipelines.
- Collaborate with data scientists to build reproducible model testing environments.
- Partner with DevOps/AI Ops teams for continuous monitoring and anomaly detection.
- Leverage synthetic data generation to expand test coverage.
Testing & QA Skills
- Strong background in test automation frameworks (PyTest, Robot Framework, Selenium, Playwright).
- Experience with API testing (Postman, REST Assured, Karate).
- Hands-on with performance testing tools (Locust, JMeter, k6).
- Familiarity with security testing tools (OWASP ZAP, Burp Suite).
- Knowledge of model evaluation metrics (ROC, AUC, F1-score, confusion matrix).
- Experience validating computer vision, NLP, and multimodal AI models.
- Tools for model validation: Evidently AI, WhyLabs, Arize AI, Fiddler AI.
- Familiarity with adversarial testing frameworks (Foolbox, ART – Adversarial Robustness Toolbox).
- Cloud AI services: AWS SageMaker, Azure ML, GCP Vertex AI.
- Edge AI platforms: NVIDIA Jetson, OpenVINO, TensorRT, TFLite, CoreML.
- Strong understanding of distributed systems testing.
- Knowledge of IoT/edge device testing frameworks.
- Programming: Python (must), Bash, Java/Go (nice-to-have).
- CI/CD: GitHub Actions, Jenkins, GitLab CI.
- Containerization: Docker, Kubernetes.
- Observability: Prometheus, Grafana, ELK, OpenTelemetry.
- 5–7 years in QA/Automation testing, with at least 2+ years in AI/ML systems testing.
- Hands-on testing of AI applications in production (cloud and edge).
- Proven track record in building automated test frameworks for AI/ML pipelines.
- Experience working in Agile/Scrum AI/ML product teams.
- Knowledge of federated learning testing scenarios.
- Experience with synthetic data & simulation environments (Unity, Unreal Engine).
- Publications or contributions to AI testing frameworks/tools.
- Understanding of Responsible AI testing frameworks.
Unlock Rewards: Refer Candidates and Earn.
If you're not available or interested in this opportunity, please pass this along to anyone in your network who might be a good fit and interested in our open positions. VARITE offers a Candidate Referral program, where you'll receive a one-time referral bonus based on the following scale if the referred candidate completes a three-month assignment with VARITE.
Experience Level Bonus Referral:
| 0-2 years | INR 5,000 |
| 2-6 years | INR 7,500 |
| 6+ years | INR 10,000 |
About VARITE: VARITE is a global staffing and IT consulting company providing technical consulting and team augmentation services to Fortune 500 Companies in USA, UK, CANADA and INDIA. VARITE is currently a primary and direct vendor to the leading corporations in the verticals of Networking, Cloud Infrastructure, Hardware and Software, Digital Marketing and Media Solutions, Clinical Diagnostics, Utilities, Gaming and Entertainment, and Financial Services.
Equal Opportunity Employer:
VARITE is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We do not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, marital status, veteran status, or disability status.
AI QA Engineer · VARITE INDIA PRIVATE LIMITED