Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Data Engineer - Python, PySpark, DBT @ Tata Consultancy

Home > Data Science & Machine Learning






Tata Consultancy  Data Engineer - Python, PySpark, DBT

Job Description

Role & responsibilities

  • Implementing data ingestion pipelines from different types of data sources i.e Databases, S3, Files etc..
  • Experience in building ETL/ Data Warehouse transformation process.
  • Experience working with structured and unstructured data.
  • Developing Big Data and non-Big Data cloud-based enterprise solutions in PySpark and SparkSQL and related frameworks/libraries,
  • Developing scalable and re-usable, self-service frameworks for data ingestion and processing,
  • Integrating end to end data pipelines to take data from data source to target data repositories ensuring the quality and consistency of data,
  • Processing performance analysis and optimization,
  • Bringing best practices in following areas: Design & Analysis, Automation (Pipelining, IaC), Testing, Monitoring, Documentation.

Job Classification

Industry: IT Services & Consulting
Functional Area / Department: Data Science & Analytics
Role Category: Data Science & Machine Learning
Role: Data Engineer
Employement Type: Full time

Contact Details:

Company: Tata Consultancy
Location(s): Pune

+ View Contactajax loader


Keyskills:   Pyspark Data Build Tool Python Data Engineering

 Fraud Alert to job seekers!

₹ Not Disclosed

Similar positions

Data Scientist

  • Capgemini
  • 3 - 15 years
  • Hyderabad
  • 1 hour ago
₹ Not Disclosed

Data Scientist

  • HCLTech
  • 7 - 10 years
  • Hyderabad
  • 3 days ago
₹ Not Disclosed

Data Scientist-Artificial Intelligence

  • IBM
  • 3 - 7 years
  • Bengaluru
  • 3 days ago
₹ Not Disclosed

Data Scientist-Artificial Intelligence

  • IBM
  • 8 - 9 years
  • Pune
  • 12 days ago
₹ Not Disclosed

Tata Consultancy

Tata Consultancy Services is an Indian multinational information technology services and consulting company headquartered in Mumbai, Maharashtra, India with its largest campus located in Chennai, Tamil Nadu, India. As of February 2021, TCS is the largest IT services company in the world by market ca...