Lead Engineer- GEN AI
- Prodapt Solutions
- 5 - 10 years
- Chennai
- 3 months ago
- Email to a friend
- Report this job
Job Description
OverviewJoin the Prodapt team in building a unified, cloud-native environment for scalable machine learning inferencing. You will help design, develop, and optimize robust workflows that empower data scientists and engineers to efficiently deploy, serve, and monitor ML models at scale, supporting both real-time and batch inference use cases.
ResponsibilitiesDevelop, maintain, and enhance model deployment workflows using Seldon, Docker, and Kubernetes for scalable inferencing.
Build and optimize REST and gRPC endpoints for serving ML models, ensuring secure and reliable access from internal tools and pipelines.
Integrate with AI Hub for unified model registration, endpoint management, and monitoring.
Support both online (real-time) and offline (batch) inference, leveraging batch inference capabilities.
Manage container images and model artifacts using Docker Hub, Artifact Registry, and Google Cloud Storage.
Implement and maintain CI/CD pipelines for automated model deployment and endpoint promotion. Ensure robust security, compliance, and governance, including role-based access control and audit logging. Collaborate with data scientists, ML engineers, and platform teams to deliver production-grade inferencing solutions. Participate in code reviews, architecture discussions, and continuous improvement of the inferencing platform.
- Proficiency in Python for ML model development and deployment.
- Experience with Seldon Core for model serving and endpoint management.
- Hands-on experience with Docker for containerization and Kubernetes for orchestration.
- Familiarity with REST and gRPC API development for model serving.
- Experience with cloud platforms (GCP preferred), including Artifact Registry and Google Cloud Storage.
- Strong understanding of CI/CD tools and automation for ML workflows.
- Knowledge of model governance, security best practices, and compliance requirements.
- Excellent troubleshooting, debugging, and communication skills.
- Experience with batch inference frameworks and large-scale batch scoring.
- Familiarity with large-scale financial/ML platforms.
- Exposure to agentic frameworks, custom application deployment (BYOA), and orchestration SDKs.
- Experience with monitoring, dashboarding, and operational health tools for inferencing endpoints.
- Knowledge of data privacy, vulnerability scanning, and compliance automation in ML environments.
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Data Platform EngineerEmployement Type: Full timeContact Details:
Company: Prodapt SolutionsLocation(s): Chennai
Keyskills: continuous integration python cd tools ci / cd tools ml kubernetes rest machine learning grpc artificial intelligence docker ansible puppet java hub gcp devops jenkins debugging model development troubleshooting api aws application deployment
Similar positions
Prodapt Solutions
Prodapt is a two-decade-old consulting & managed services provider, singularly focused on the telecom/DSP (digital service provider) ecosystem that helps clients transform their IT, products, operations, and networks to meet their strategic objectives. Prodapt provides end-to-end IT/software arc...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in