Azure Data Engineer @ Quess It Staffing

Job Description-

Part of a cross-disciplinary team, work closely with other data engineers, software engineers, data scientists, data managers and business partners.
Architect, design, implement and maintain reliable and scalable data infrastructure in Azure
Write, deploy and maintain software to build, integrate, manage, maintain, and quality assure data.
Adhere to and advocate for software engineering best practices (e.g. technical design, technical design review, unit testing, monitoring & alerting, checking in code, code review, documentation),
Responsible for deploying secure and well-tested software that meets privacy and compliance requirements; develop, maintain and improve CI / CD pipeline
Design, build, deploy and maintain infrastructure as code. Containerizes server deployments.
Skills-
7+ years of overall industry experience specifically in data engineering
5+ years of experience building (from scratch) optimized ETLs and deploying large scale data pipelines in a production environment
Should be a hands-on expert in python 3.5+ and SQL
Should have worked for at least 1-2 years in MS Azure cloud platforms (Azure Data Factory, Azure Data Bricks, Azure Synapse, Azure SQL DW etc.)
Expertise in DataBricks, Airflow, pySpark is highly desirable
Have worked directly with clients to identify pain points and opportunities in pre-existing data pipelines and build or improve the data processing and output creation processes
Worked on building scalable and robust data architecture and data pipeline models that have driven quantifiable results (productivity gains, cost savings, faster insights generation) for clients
Basic Qualifications
BE/B.Tech./Masters in computer science or Software Engineering or with a quantitative discipline, e.g. Mathematics, Statistics, Economics