Azure Data Engineer - PAN India - Hybrid (6-14 Yrs)
- Prodcon Tech Services
- 6 - 11 years
- Pune
- 5 months ago
- Email to a friend
- Report this job
Job Description
Hello Folks,We are hiring for "Azure Data Engineer" for one of the Service Based Company.
Job Description:
Job type:- Permanent / Full Time
1) Skills - Pyspark + ADB, ADF - Good to have
Exp - 6-9 yrs
Loc - Chennai/Mumbai (Hybrid)
NP - Sept Serving Only
IP - L1 - L2 - Virtual
2) Skills - Pyspark + ADB + ADF + SQL, Azure Synapse - Good to have
Exp - 6-14 yrs
Loc - MPCBN - Hybrid (Coim/Ahm - 2nd priority)
NP - Sept Serving Only
IP - L1 - L2 - Virtual
3) Skills - Pyspark + Azure Synapse - SQL
G5 - 6-12 yrs
Loc - MPCB - Hybrid
NP - Mid Sept Serving Only
IP - L1 - L2 - Virtual
- 6+ years of experience in ETL with minimum of 3+ years of experience in PySpark/Spark SQL
- Strong SQL skills with experience in Azure SQL & Synapse
- Strong Skill in developing Synapse Notebooks , Azure Data Bricks
- Experience in ETL (SAS/Informatica/ADF Data flows)
- Experience implementing Synapse Pipelines/Dataflows
- Use the interactive Synapse/Databricks notebook environment using SQL, Examine external data sets, Query existing data sets using SQL
- ETL transformations and Loads using Synapse Notebooks/ Azure Databricks to apply built-in functions to manipulate data,
- Perform an ETL job on a streaming data source, Parameterize a code base and manage task dependencies, Submit and monitor jobs using the REST API or Command Line Interface
- Manage Delta lake using interactive Synapse notebook environment, Create, append and upsert data into a data lake. Primary Responsibilities
- Develop ETL processing and Data extraction using Synapse Notebooks / Azure Databricks.
- Develop Apache Spark SQL using Python to examine and query datasets.
- Develop Dataframes for ETL transformation and loads
- Capture audit information during all phases of the ETL transformation process.
- Write and maintain documentation of the ETL processes via process flow diagrams.
- Collaborate with business users, support team members, and other developers throughout the organization to help everyone understand issues that affect the data warehouse.
Any references would be greatly appreciated !!
Cheers & warm regards,
Kajal Gupta
Lead - Talent Acquisition Specialist
ka********a@pr****n.com
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Data Science & AnalyticsRole Category: Data Science & Machine LearningRole: Data EngineerEmployement Type: Full timeContact Details:
Company: Prodcon Tech ServicesLocation(s): Pune
Keyskills: Pyspark SQL Azure Data Factory Azure Synapse Azure Databricks
Similar positions
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in