Data Engineer
- Chetu
- 6 - 9 years
- Noida, Gurugram
- 1 month ago
- Email to a friend
- Report this job
Job Description
Job Summary:
We are seeking an experienced and highly skilled Data Engineer to design, build, and maintain scalable data solutions using the Microsoft Azure and Microsoft Fabric platforms. The ideal candidate will have strong expertise in data modeling, ETL processes using Azure Data Factory and Microsoft Fabric Pipelines, and developing insightful Power BI reports and semantic models. This role involves collaborating with cross-functional teams to translate business requirements into robust, high-performance data solutions that drive data-driven decision-making.
Key Responsibilities:
- Data Pipeline Development: Design, build, and maintain scalable and efficient data pipelines and ETL/ELT workflows using Azure Data Factory (ADF) and Microsoft Fabric Pipelines to ingest, transform, and load data from diverse sources.
- Microsoft Fabric Implementation: Implement and manage data solutions within the Microsoft Fabric ecosystem, including Lakehouse and Data Warehouse architectures, using tools like Synapse Data Engineering notebooks (Data modeling, SQL, and ETL)
- Data Modeling & Architecture: Design and develop efficient data architecture and dimensional data models (e.g., star schemas) to support enterprise reporting and Business Intelligence (BI) needs.
- Power BI Integration: Collaborate with BI developers and analysts to deliver high-quality Power BI datasets and semantic models. Develop and optimize interactive reports and dashboards with complex DAX calculations and Power Query transformations.
- Data Quality & Governance: Implement data validation, cleansing procedures, and robust data governance practices, including role-level security (RLS), access control, and lineage tracking (using tools like Microsoft Purview).
- Performance Optimization: Continuously monitor and fine-tune data pipelines, queries (SQL and PySpark), and data storage solutions for performance, scalability, and cost efficiency.
- Collaboration & Documentation: Work closely with business stakeholders, data scientists, and analysts to understand requirements and translate them into technical solutions. Create and maintain clear documentation for data models, processes, and configurations.
- Automation & CI/CD: Automate deployments and monitoring using CI/CD pipelines with tools like Azure DevOps or GitHub for data solutions.
Required Skills & Qualifications:
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- Proven experience (e.g., 4-5+ years) as a Data Engineer, preferably on Microsoft Azure and Fabric platforms.
- Strong proficiency in SQL, Python/PySpark, and Kusto Query Language (KQL).
- Hands-on experience with Microsoft Azure Data Factory and the broader Microsoft Fabric ecosystem.
- Expertise in Power BI, including data modeling, DAX, and creating interactive visualizations.
- Solid understanding of data warehousing concepts, ETL/ELT processes, and lakehouse architectures.
- Familiarity with data governance, security, and compliance best practices.
- Strong problem-solving, debugging, and performance tuning skills.
Preferred Qualifications:
- Microsoft certifications such as the Microsoft Certified: Fabric Analytics Engineer Associate or Microsoft Certified: Fabric Data Engineer Associate are highly desirable.
- Experience with Azure services like Azure Synapse Analytics, Azure Databricks, and Azure Data Lake Storage Gen2.
- Knowledge of real-time data streaming concepts (e.g., Kafka or Azure Event Hub).
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Data EngineerEmployement Type: Full timeContact Details:
Company: ChetuLocation(s): Noida, Gurugram
Keyskills: Azure Data Factory Microsoft Fabric PowerBI Data Modeling Large Data Large Data optimization
Similar positions
Chetu
Established in 2000, Chetu has become a recognized leader in software solutions and support services. With a global team of over 2,800 software professionals, the company operates primarily from its three advanced software development centers in Sector 63, Noida. These facilities, spanning more th...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in