Job description:
Iris Software has been a trusted software engineering partner to several Fortune 500 companies for over three decades. We help clients realize the full potential of technology-enabled transformation by bringing together a unique blend of domain knowledge, best-of-breed technologies, and experience executing essential and critical application development engagements.
www.irissoftware.com
Title- Azure & Big Data Engineer
Location- Noida/Gurgaon/Pune
Notice: 15 Days OR Immediate joiners only
Mode- Hybrid
Shift: 1:00 PM- 10:00 PM IST
Job Summary:
We are seeking a highly skilled and experienced Lead Data Engineer to join our data engineering team. The ideal candidate will have a strong background in designing and deploying scalable data pipelines using Azure technologies, Spark, Flink, and modern data lakehouse architectures. This role demands hands-on technical expertise, leadership in managing offshore teams, and a strategic mindset to drive data-driven decision-making across financial and regulatory domains.
Key Responsibilities:
Design, develop, and deploy scalable batch and streaming data pipelines using PySpark, Flink, Scala, SQL, and Redis.
Lead migration of complex on-premise workflows to Azure cloud ecosystem (Databricks, ADLS, Azure Data Factory), optimizing infrastructure and deployment processes.
Implement performance tuning strategies to reduce job runtimes and enhance data reliability, including optimization of Unity Catalog tables.
Collaborate with product stakeholders to deliver high-priority data features and ensure alignment with business goals.
Manage and mentor an 8-member offshore team, fostering best practices in data engineering and agile development.
Conduct internal training sessions on modern data architecture, cloud-native deployments, and data engineering best practices.
Certifications (Good to have):
Databricks Certified: Data Engineer Associate, Lakehouse Fundamentals
Microsoft Certified: Azure Fundamentals (AZ-900), Azure Data Fundamentals (DP-900)
Preferred Qualifications:
Sounds like you? Send your CV to me - an**********p@ir*********e.com

Keyskills: Azure Big Data Spark Data Bricks Python Shell Hive SCALA Hadoop