AI Benchmarking Specialist, PBA
- Amazon
- 1 - 6 years
- Hyderabad
- 5 months ago
- Email to a friend
- Report this job
Job Description
At Amazon, were evolving how to support sellers, customers in solving their query resolved faster using AI. That is where our team steps in, we support multiple AI models in benchmarking their responses for it relevancy, correctness and completeness.You perform straightforward annotation related tasks across ML data process areas. You are able to determine the right task or procedure (or when a slight deviation is needed) to achieve desired outcome.
You act as point of contact for one or more simple annotation tasks in a given ML data process area. You are responsible for the quality of execution for these tasks.
You understand the dependencies of tasks across ML data workflows and are able to articulate customer impact. You use the existing annotation methods and modify the SOPs. You document the changes in SOP and once approved, you share the knowledge with the team, audit SOP adoption and execution.
You test new SOP/tools and share feedback on their quality and provide inputs for improvement to support on boarding of new tools. You structure data collection, analyse results and share inputs for SOP changes.
You collate, track, and report progress on key metrics agreed to with respective stakeholders (e.g., Program managers, Applied Scientist) specific to your functional area.
You identify operational issues related to process and tooling and recommend suggestions to improve key project metrics such as productivity and quality. Bachelors degree
Communication Skills: Strong verbal and written communication skills in English
Technical Skills: Proficiency in MS Excel; basic understanding of SQL and Python
Experience with Microsoft Office products and applications Performed annotation related tasks across ML data process areas.
Strong knowledge of process documentation, analysis knowledge
Technical proficiency in SQL querying and Python programming for data analysis
Strong analytical and problem-solving skills
Ability to work independently and as part of a team
Job Classification
Industry: InternetFunctional Area / Department: Data Science & AnalyticsRole Category: Data Science & Machine LearningRole: Data Science & Machine Learning - OtherEmployement Type: Full timeContact Details:
Company: AmazonLocation(s): Hyderabad+ View Contact
Keyskills: Data analysis Process documentation Analytical Data collection Data processing MS Office Operations SQL Auditing Python
Fraud Alert to job seekers!
₹ Not Disclosed
Similar positions
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in