Senior Data Engineer
- Taskus
- 5 - 10 years
- Chennai
- 8 months ago
- Email to a friend
- Report this job
Job Description
Role & responsibilities
- Develop, maintain, and enhance new data sources and tables, contributing to data engineering efforts to ensure comprehensive and efficient data architecture.
- Serves as the liaison between Data Engineer team and the Airport operation teams, developing new data sources and overseeing enhancements to existing database; being one of the main contact points for data requests, metadata, and statistical analysis
- Migrates all existing Hive Metastore tables to Unity Catalog, addressing access issues and ensuring smooth transition of jobs and tables.
- Collaborate with IT teams to validate package (gold level data) table outputs during the production deployment of developed notebooks
- Develop and implement data quality alerting systems and Tableau alerting mechanisms for dashboards, setting up notifications for various thresholds.
- Create and maintain standard reports and dashboards to provide insights into airport performance, helping guide stations to optimize operations and improve performance.
Preferred candidate profile
- Master's degree / UG
- Min 5 -10 years of experience
- Databricks (Azur op)
- Good Communication
- Experience developing solutions on a Big Data platform utilizing tools such as Impala and Spark
- Advanced knowledge/experience with Azure Databricks, PySpark, (Teradata)/Databricks SQL
- Advanced knowledge/experience in Python along with associated development environments (e.g. JupyterHub, PyCharm, etc.)
- Advanced knowledge/experience in building Tableau Dashboard / Clikview / PowerBi
- Basic idea on HTML and JavaScript
- Immediate Joiner
Skills, Licenses & Certifications
- Strong project management skills
- Proficient with Microsoft Office applications (MS Excel, Access and PowerPoint); advanced knowledge of Microsoft Excel
- Advanced aptitude in problem-solving, including the ability to logically structure an appropriate analytical framework
- Proficient in SharePoint, PowerApp and ability to use Graph API
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Data Science & AnalyticsRole Category: Data Science & Machine LearningRole: Data EngineerEmployement Type: Full timeContact Details:
Company: TaskusLocation(s): Chennai
Keyskills: Pyspark Databricks SQL Azure Databricks Teradata Tableau Dashboard Power Bi JupyterHub Clikview Big Data HTML Impala Graph Api Data Bricks SQL Project Management Javascript PowerApp Spark SharePoint Pycharm Python
Similar positions
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in