AI Test Engineer
- Tech Mahindra
- 7 - 12 years
- Hyderabad
- 5 days ago
- Email to a friend
- Report this job
Job Description
We are seeking a highly skilled AI Test Engineer to validate, test, and assure the quality of AI/ML-based systems. The role focuses on ensuring reliability, fairness, performance, and robustness of AI models and intelligent applications across their lifecycle.
Key Responsibilities
- Design and implement test strategies for AI/ML models, including functional, non-functional, and ethical validation
- Validate data quality, model accuracy, and bias detection across training and inference stages
- Develop automated test frameworks for AI pipelines, APIs, and model outputs
- Perform model validation using statistical techniques and benchmark datasets
- Conduct adversarial testing and edge-case analysis to ensure model robustness
- Validate LLM-based applications (prompt testing, hallucination detection, response quality)
- Collaborate with Data Scientists, ML Engineers, and Product teams to ensure end-to-end quality assurance
- Ensure compliance with AI governance, regulatory, and ethical standards
- Monitor model performance in production and support continuous testing (MLOps integration)
Required Skills & Qualifications
- Bachelors/Masters degree in Computer Science, Data Science, or related field
- 7+ years of experience in Automation and QA/Testing, with exposure to AI/ML systems
- Strong understanding of Machine Learning concepts (supervised/unsupervised learning, model evaluation metrics)
- Hands-on experience with Python, and testing frameworks (e.g., PyTest, Selenium, Playwright)
- Experience testing APIs, microservices, and data pipelines
- Knowledge of ML frameworks like TensorFlow, PyTorch, or Scikit-learn
- Familiarity with data validation tools (Great Expectations, Pandera)
- Understanding of bias, fairness, explainability, and AI risks
Preferred Skills
- Experience with LLM testing (e.g., prompt engineering, RAG validation)
- Exposure to MLOps tools (MLflow, Kubeflow, Azure ML, SageMaker)
- Knowledge of performance testing for AI systems and Automation testing frameworks
- Familiarity with AI governance frameworks and regulatory standards
- Experience in cloud platforms (AWS, Azure, GCP)
Nice-to-Have Certifications
- AI/ML certifications (e.g., AWS ML, Google AI, Microsoft AI Engineer)
- ISTQB Advanced/Test Automation certifications
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: ConsultingRole Category: IT ConsultingRole: Technical ConsultantEmployement Type: Full timeContact Details:
Company: Tech MahindraLocation(s): Hyderabad
Keyskills: Large Language Model Artificial Intelligence PyTest TensorFlow Playwright Automation Automation PyTorch Great Expectations Pandera Machine Learning Algorithms Selenium Scikit-Learn
Similar positions
Tech Mahindra
Tech Mahindra Limited is an Indian multinational provider of information technology (IT), networking technology solutions and Business Process Outsourcing (BPO) to the telecommunications industry. Tech Mahindra is a US$4.2 billion company with over 117,000 employees across 90 countries. It provide...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in