Data Engineer Microsoft SQL Server
- Zensar
- 7 - 9 years
- Pune
- 7 days ago
- Email to a friend
- Report this job
Job Description
Required Skills:
- Strong expertise in SQL Server, data extraction, and performance optimization.
- Hands on experience with MinIO or similar S3 compatible object stores.
- Proficiency in handling Parquet and high compression data workflows.
- Experience with large scale data movement (multi TB to PB).
- Strong understanding of data retention, archival strategies, and DLM best practices.
- Ability to design resilient, fault tolerant, and fully auditable pipelines.
Preferred
- Experience in gaming, gambling, or high velocity transactional industries.
- Knowledge of scripting/ETL frameworks (Python, Airflow, Spark, etc.).
- Understanding of compliance and audit requirements for long term customer data storage
Required Skills:
- Strong expertise in SQL Server, data extraction, and performance optimization.
- Hands on experience with MinIO or similar S3 compatible object stores.
- Proficiency in handling Parquet and high compression data workflows.
- Experience with large scale data movement (multi TB to PB).
- Strong understanding of data retention, archival strategies, and DLM best practices.
- Ability to design resilient, fault tolerant, and fully auditable pipelines.
Preferred
- Experience in gaming, gambling, or high velocity transactional industries.
- Knowledge of scripting/ETL frameworks (Python, Airflow, Spark, etc.).
- Understanding of compliance and audit requirements for long term customer data storage
Key Responsibilities :
- Design and implement an on prem data lake on MinIO for multi petabyte storage.
Build high efficiency pipelines to extract data from SQL Server and convert to Parquet (high compression, columnar format). - Implement Data Lifecycle Management (DLM) for 7 year retention, tiering, and archival policies.
- Guarantee ultra high accuracy with strict zero tolerance for data loss across all customer datasets.
- Optimize storage of mixed type datasets, including:
- Transactional data (e.g., gaming ledger entries)
- BLOB/large object data (e.g., game artifacts)
- Monitor storage performance and ensure scalable, cost optimal on prem resource utilization.
- Implement validation, reconciliation, and audit frameworks for end to end integrity.
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: DBA / Data warehousingRole: Database AdministratorEmployement Type: Full timeContact Details:
Company: ZensarLocation(s): Pune+ View Contact
Keyskills: Resource utilization Compliance Reconciliation Performance optimization Gaming SQL Auditing Data extraction Python Scripting
Fraud Alert to job seekers!
₹ Not Disclosed
Similar positions
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in