Job Title: Lead Software Engineer (Big Data & Cloud) Location: Indore Experience- 8-12 years Job Summary: We are seeking a highly skilled Lead Software Engineer (Big Data & Cloud) to drive innovation and lead the development of scalable data solutions. The ideal candidate will have extensive experience in building, designing, and optimizing large-scale distributed applications leveraging cloud and Big Data technologies. Job Description 8-12 years of good hands on exposure with Big Data technologies Pyspark (Data frame and SparkSQL), Hadoop, and Hive. Good hands on experience of python/Pyspark. Good understanding of SQL and data warehouse concepts. Strong analytical, problem-solving, data analysis and research skills Demonstrable ability to think outside of the box and not be dependent on readily available tools Excellent communication, presentation and interpersonal skills are a must Good to have: Hands-on experience with using Cloud Platform provided Big Data technologies- AWS/Azure/GCP/Databricks Any job scheduler experience Experience in migrating workload from on-premise to cloud and cloud to cloud migrations. Roles & Responsibilities Develop efficient ETL pipelines as per business requirements, following the development standards and best practices. Perform integration testing of different created pipeline in Cloud env. Provide estimates for development, testing & deployments on different env. Participate in code peer reviews to ensure our applications comply with best practices. Create cost effective Cloud pipeline with required Cloud services i.e. AWS/Azure/GCP/Databricks.,
Employement Category:
Employement Type: Full timeIndustry: IT Services & ConsultingRole Category: Not SpecifiedFunctional Area: Not SpecifiedRole/Responsibilies: Lead Software Engineer- (Big Data & Cloud)