AI Tester with Automation testing
- Ltimindtree
- 5 - 10 years
- Noida, Gurugram
- 22 hours ago
- Email to a friend
- Report this job
Job Description
Location: Pan India.
ExP: 5+ Years
Mandate Skill: AI Tester
The core responsibilities for this position revolve around functional model testing, where youll design and execute test cases for various AIML modelsincluding classification, NLP, recommendation, and generative AI systems. Ensuring model outputs are accurate, consistent, and behave as expected across diverse inputs will be crucial. Youll also perform regression testing after model updates, retraining cycles, and data changes to maintain the integrity of our solutions.
Prompt LLM testing is another vital aspect. Youll develop and maintain prompt test libraries for features based on large language models, and rigorously evaluate responses for relevance, tone, factual accuracy, and adherence to business rules. Spotting hallucinations, response drift, and edge-case failures in generative outputs will be a key measure of your effectiveness.
AI safety and red teaming will be central to this role. Youll conduct adversarial testing to uncover vulnerabilities like prompt injection, jailbreaks, and unintended model behaviors. Assessing outputs for bias, fairness, and compliance with responsible AI principles, then documenting risks and collaborating with model teams for remediation, will help us uphold our commitment to responsible AI.
On the automation front, youll build and maintain automated test suites for AI pipelines using Python-based frameworks, integrate testing into CI/CD workflows, and contribute to the overall evaluation infrastructure. Tracking and reporting quality metrics, model performance benchmarks, and defect trends will ensure continuous improvement.
Collaboration and documentation are also essential. Youll partner with data scientists, ML engineers, and product teams throughout the development lifecycle. Writing clear test plans, defect reports, and evaluation summaries, as well as contributing to internal QA standards and best practices for AI systems, will be expected.
If you know someone who fits this profile or are interested yourself, please share your updated profile to an***************u@***.com
Regards,
Anjali
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: IT & Information SecurityRole Category: IT Infrastructure ServicesRole: IT Infrastructure Services - OtherEmployement Type: Full timeContact Details:
Company: LtimindtreeLocation(s): Noida, Gurugram
Keyskills: AI tester Automation Testing LLM Testing NLP AIML
Similar positions
Ltimindtree
[NSE: LTIMindtree] is a global technology consulting and digital solutions LTIMindtree company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 75...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in