Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Pyspark Developer @ Tata Consultancy

Home > Software Development






 Pyspark Developer

Job Description

Role : Pyspark Developer

Range :5+

Location : Pan India


Must-Have


  1. 5+ years of experience in data engineering, with strong focus on PySpark/Spark for big data processing.
  2. Expertise in building data pipelines and ingestion frameworks from relational, semi-structured (JSON, XML), and unstructured sources (logs, PDFs).
  3. Proficiency in Python with strong knowledge of data processing libraries.
  4. Strong SQL skills for querying and validating data in platforms like Amazon Redshift, PostgreSQL, or similar.
  5. Experience with distributed computing frameworks (e.g., Spark on EMR, Databricks).
  6. Familiarity with workflow orchestration tools (e.g., AWS Step Functions, or similar).
  7. Solid understanding of data lake / data warehouse architectures and data modeling basics.

Good-to-Have

  1. Experience with AWS data services: Glue, S3, Redshift, Lambda, CloudWatch, etc.
  2. Familiarity with Delta Lake or similar for large-scale data storage.
  3. Exposure to real-time streaming frameworks (e.g., Spark Structured Streaming, Kafka).
  4. Knowledge of data governance, lineage, and cataloging tools (e.g., AWS Glue Catalog, Apache Atlas).
  5. Understanding of DevOps/CI-CD pipelines for data projects using Git, Jenkins, or similar tools.

Job Classification

Industry: IT Services & Consulting
Functional Area / Department: Engineering - Software & QA
Role Category: Software Development
Role: Data Engineer
Employement Type: Full time

Contact Details:

Company: Tata Consultancy
Location(s): India

+ View Contactajax loader


Keyskills:   Pyspark Spark Python

 Job seems aged, it may have been expired!
 Fraud Alert to job seekers!

₹ Not Disclosed

Similar positions

Salesforce Marketing Cloud Developers-Scheduled F2F interview-May 09th

  • Cognizant
  • 6 - 11 years
  • Hyderabad
  • 2 days ago
₹ Not Disclosed

Salesforce Marketing Cloud - Senior Developer

  • Cognizant
  • 12 - 15 years
  • Bengaluru
  • 2 days ago
₹ Not Disclosed

Ui Developer Or Frontend developer

  • Tech Mahindra
  • 3 - 8 years
  • Bengaluru
  • 3 days ago
₹ -17 Lacs P.A.

Lead Full stack Developer ( .Net + React + Gen AI)

  • Icertis
  • 7 - 12 years
  • Pune
  • 2 days ago
₹ Not Disclosed

Tata Consultancy

Wipro Ltd (NYSE:WIT) is a global information technology, consulting and outsourcing company with 170,000+ workforce serving clients in 175+ cities across 6 continents. \r\n\r\nWipro helps customers do business better by leveraging our industry-wide experience, deep technology expertise, comprehensiv...