Azure Data Engineer
- Quinnox
- 7 - 11 years
- Bengaluru
- 1 month ago
- Email to a friend
- Report this job
Job Description
*** We are looking for ETL Developer with strong expertise in Python, Azure Data Engineering services who can join us immediately at our Bangalore Office***
Experience : 7-10 years
Job Overview :
Role & responsibilities :
- We are looking for an experienced ETL Developer with strong expertise in Python, Azure Data Engineering services, and data integration frameworks. The ideal candidate will design, build, and optimize scalable ETL/ELT pipelines to support enterprise data needs.
- Key Responsibilities
- Design, develop, and maintain ETL/ELT pipelines using Python, Azure Data Factory, and Azure Databricks.
- Build robust data ingestion workflows from various sources (APIs, flat files, databases, cloud systems).
- Work with Azure services including Azure Data Lake Storage (ADLS), Azure SQL Database, Synapse Analytics, Azure Functions, and Key Vault.
- Optimize ETL performance, implement error handling, and ensure data quality & reliability.
- Develop reusable Python components/modules for data transformations.
- Implement CI/CD pipelines for data workflows using Azure DevOps or Git.
- Collaborate with data architects, analysts, and business stakeholders to understand data requirements.
- Ensure data security, compliance, and governance standards across ETL pipelines.
- Conduct root-cause analysis and troubleshoot data pipeline issues.
- Prepare technical documentation for workflows, code, and architecture.
- Required Skills & Qualifications:
- 57 years of overall experience in data engineering or ETL development.
- Strong hands-on experience with Python, including libraries like Pandas, PySpark, NumPy.
- Proficiency in Azure Data Factory (ADF) for orchestrating ETL workflows.
- Experience with Azure Databricks, PySpark, or other distributed data processing frameworks.
- Solid understanding of SQL, stored procedures, and performance tuning.
- Experience working with Azure cloud data components (ADLS, Synapse, Azure SQL, Azure Functions).
- Good understanding of data modelling, data warehousing, and design patterns.
- Experience integrating on-premise and cloud data sources.
- Knowledge of version control systems (Git) and DevOps pipelines.
- Strong analytical and troubleshooting skills.
- Excellent communication and documentation abilities.
- Good to Have:
- Experience with Delta Lake and lakehouse architectures.
- Exposure to CI/CD using Azure DevOps.
- Knowledge of REST APIs and integration patterns.
- Experience with data governance tools .
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: OtherRole Category: OtherRole: OtherEmployement Type: Full timeContact Details:
Company: QuinnoxLocation(s): Bengaluru+ View Contact
Keyskills: Api Integration Azure Databricks Etl Development Python SQL Pyspark Rest Azure Data Lake
Fraud Alert to job seekers!
₹ Not Disclosed
Similar positions
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in