Lead Data Engineer
- R Systems
- 8 - 10 years
- Noida, Gurugram
- 5 days ago
- Email to a friend
- Report this job
Job Description
Role & responsibilities
We are seeking a highly skilled Google Cloud Platform (GCP) Data engineer role with SAP data integration expertise to design, implement, and oversee enterprise-grade data solutions. The ideal candidate will combine deep expertise in cloud data platforms, data governance, security, and data modeling with hands-on experience in ETL/ELT pipelines, SAP data extraction, system migrations, and analytics. This role will collaborate with business stakeholders, and engineering teams to create a robust, scalable, and cost-effective data ecosystem that bridges SAP and GCP environments.
Key Responsibilities
- Lead and mentor a team of data engineers in building ETL/ELT pipelines for SAP and other ERP sources into GCP
- Set engineering standards, best practices, and coding guidelines.
- Provide technical direction, code reviews, and support for complex data solutions.
- Collaborate with project managers, provide the estimates, track the progress, remove roadblocks to ensure timely completion of work.
- Collaborate with BI teams, Data analyst to enable reporting solution
.
2. Data Architecture & Modeling
- Design conceptual, logical, and physical data models to support analytics and operational workloads.
- Implement star, snowflake, and data vault models for analytical systems.
3. Google Cloud Platform Expertise
- Design data solutions on GCP using BigQuery, Cloud Storage, Dataflow, and Dataproc.
- Implement cost optimization strategies for GCP workloads.
4. Data Pipelines & Integration
- Design and orchestrate ETL/ELT pipelines using Apache Airflow (Cloud Composer), and Dataflow
- Integrate data from multiple systems including SAP BW, SAP HANA, Business Objects using tools like SAP SLT, or Google Cortex Framework.
- Leverage integration tools such as Boomi for system interoperability.
5. Programming & Analytics
- Develop complex SQL queries for analytics, transformations, and performance tuning.
- Build automation scripts and utilities in Python.
6. System Migration
- Lead on-premise to cloud migrations for enterprise data platforms [SAP BW/Bobj]
- Manage migration of SAP datasets to GCP ensuring data integrity and minimal downtime.
8. DevOps for Data
- Implement CI/CD pipelines for data workflows using GitHub Actions, Cloud Build, and Terraform.
- Apply infrastructure-as-code principles for reproducible and scalable deployments.
9. Data Modelling
- Design and develop conceptual, logical, and physical data models for enterprise systems.
- Translate business requirements into data entities, attributes, relationships, and constraints.
- Build and maintain dimensional models (Star/Snowflake schema) for data warehouses and BI reporting.
- Develop data models for data lake / lakehouse environments (BigQuery, Snowflake, Azure Synapse, Databricks).
- Define and document data standards, naming conventions, and data definitions.
- Collaborate with Data Engineering teams to ensure models are implemented accurately in ETL/ELT pipelines.
- Work with BI teams to optimize models for reporting tools such as Power BI, Tableau, SAP BW, etc.
- Support integration across multiple source systems (SAP, Salesforce, Oracle, etc.).
- Ensure data models comply with data governance, security, and compliance requirements.
- Create and maintain documentation including ERDs, data dictionaries, and lineage diagrams
Preferred candidate profile
- 8-10 years of proven experience with GCP BigQuery, Composer, Cloud Storage, Pub/Sub, Dataflow.
- Strong SQL and Python programming skills.
- Hands-on experience with SAP data extraction, modeling, and integration from ERP, BW, and/or HANA systems.
- Knowledge of data governance frameworks and security best practices.
- Familiarity with DevOps tools for data.
- Understanding of Google Cortex Framework for SAP-GCP integrations.
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Data EngineerEmployement Type: Full timeContact Details:
Company: R SystemsLocation(s): Noida, Gurugram
Keyskills: SAP Gcp Bigquery Data Flow
Similar positions
R Systems
We would like to introduce ourselves as one the biggest and most diversified business house of South Korea. In 2009, the company was placed 471st in the Fortune Global 500.[1] It has been included in the Forbes Global 2000 companies from 2007. It is the parent company of KODA power. Doosan was ranke...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in