Data Engineer Full Time - Gurgaon/Noida/Hyderabad Role and Responsibilities
Develops and operationalizes data pipelines to make data available for consumption (BI, Advanced analytics, Services).
Works in tandem with data architects and data/BI engineers to design data pipelines and recommends ongoing optimization of data storage, data ingestion, data quality and orchestration.
Designs, develops, and implements ETL/ELT processes using Azure services such as Azure Data Bricks, Azure SQL Synapse, ADLS etc. to improve and speed up delivery of our data products and services.
Implement solutions by developing scalable data processing platforms to drive high-value insights to the organization.
Identifies, designs, and implements internal process improvements: automating manual processes, optimizing data delivery.
Identifies ways to improve data reliability, efficiency, and quality of data management.
Communicates technical concepts to non-technical audiences both in written and verbal form.
If Lead - Then performs peer reviews for other data engineer work.
Skills
Good Understanding of Data integration: Onboarding and integration of data from external and internal data sources through API management, sftp processes and others using synapse pipelines
Deep expertise of core data platforms: Azure, Data Lakehouse design, big data concept using spark architecture
Strong knowledge:
With Integration technologies: pySpark, Python, ADF, Databricks
With conceptual, logical, and physical database modeling.
T-SQL knowledge and experience working with relational databases, query authoring, stored procedure development, debug, and optimize SQL queries.
Proven success as a technical lead and individual contributor
Familiarity with Project management methodologies: Agile, DevOps.
Qualification
Bachelors degree (or equivalent) in computer science, information technology, engineering, or related discipline
Experience in building or maintaining ETL processes
Professional certification
Job Classification
Industry: BPM / BPOFunctional Area / Department: Engineering - Software & QARole Category: DBA / Data warehousingRole: Database Developer / EngineerEmployement Type: Full time