Lead Data Engineer
- Wissen Infotech
- 3 - 8 years
- Bengaluru
- 6 months ago
- Email to a friend
- Report this job
Job Description
Wissen Technology is Hiring fo r Lead Data Engineer
About Wissen Technology:
Wissen Technology is a globally recognized organization known for building solid technology teams, working with major financial institutions, and delivering high-quality solutions in IT services. With a strong presence in the financial industry, we provide cutting-edge solutions to address complex business challenges
Role Overview : We are seeking a Lead Data Engineer to design and build a modern, cloud-native hybrid transactional and analytical processing (HTAP) data platform using the Microsoft Azure ecosystem, including Microsoft Fabric . The platform will process large volumes of structured and semi-structured data from external entities, apply complex validation logic, and serve both transactional and analytical needs across business functions. This is a high-impact, hands-on leadership role requiring architectural vision, hands-on implementation, and the ability to drive platform standardization at scale
Experience : 8 - 12 Years
Location: Bangalore
Key Responsibilities
- Lead the architecture and implementation of an enterprise-grade data platform using Microsoft Fabric and related Azure services
- Design and implement a Medallion architecture (Bronze/Silver/Gold layers) to manage raw, validated, and curated data
- Develop real-time data ingestion, validation, and transformation pipelines supporting heterogeneous file formats
- Build and orchestrate event-driven workflows using serverless Azure Functions, Event Hub, and Durable Functions
- Integrate Fabric Lakehouses and Synapse Data Warehousing with transactional systems and UI components
- Implement schema evolution, metadata management , and lineage tracking across the platform
- Enable business self-service through configurable rules engines and validation UIs
- Ensure role-based access control (RBAC) , end-to-end encryption, and audit trails are enforced across all layers
- Build CI/CD pipelines and monitoring for automated deployments and observability
- Collaborate with UI engineers, solution architects, product owners, and compliance stakeholders
- Lead and mentor a team of data engineers; establish coding and documentation standards
Required Skills and Qualification
- 8 -12 years of hands-on experience in data engineering , including 3+ years in a leadership or architecture role
- Strong expertise in Microsoft Azure , especially:
- Microsoft Fabric (Data Lakehouses , Pipelines, Real-Time Analytics, Synapse)
- Microsoft Fabric (Data Lakehouses , Pipelines, Real-Time Analytics, Synapse)
- Strong expertise in Microsoft Azure , especially:
- 8 -12 years of hands-on experience in data engineering , including 3+ years in a leadership or architecture role
- Lead and mentor a team of data engineers; establish coding and documentation standards
- Collaborate with UI engineers, solution architects, product owners, and compliance stakeholders
- Build CI/CD pipelines and monitoring for automated deployments and observability
- Ensure role-based access control (RBAC) , end-to-end encryption, and audit trails are enforced across all layers
- Enable business self-service through configurable rules engines and validation UIs
- Implement schema evolution, metadata management , and lineage tracking across the platform
- Integrate Fabric Lakehouses and Synapse Data Warehousing with transactional systems and UI components
- Build and orchestrate event-driven workflows using serverless Azure Functions, Event Hub, and Durable Functions
- Develop real-time data ingestion, validation, and transformation pipelines supporting heterogeneous file formats
- Design and implement a Medallion architecture (Bronze/Silver/Gold layers) to manage raw, validated, and curated data