Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Big Data Developer @ Sonata Software

Home > Software Development

 Big Data Developer

Job Description

  • Database Expertise:

Strong hands-on experience with Greenplum, Teradata, MongoDB, and Oracle for data modelling, querying, and performance optimization.

  • Streaming & Real-Time Data:

Proficient in Apache Kafka for building and managing real-time data streaming pipelines.

  • Data Integration & ETL Tools:

1. Informatica: Experience with HTTP Transformation for REST APIs, XML Transformation, and OAuth-based authentication.

2. StreamSets: Skilled in using components like HTTP Client Processor with OAuth2 authentication for API integration.

  • Big Data & Lakehouse Technologies:

i. Strong development experience with PySpark for distributed data processing.

ii. Familiarity with Apache Iceberg for managing large-scale, transactional datasets in Lakehouse architectures.

  • Scripting & Automation:

1. Advanced scripting skills in Python and Unix/Linux shell for automation, data manipulation, and workflow management.

2. Proven ability to debug and promote fixes under high-priority scenarios.

  • Data Replication:

1. Basic working knowledge/Understanding of Oracle Goldengate and CDC frameworks for data replication across heterogeneous systems.

  • Workflow Orchestration:

1. Experience with Control-M and Apache Airflow for scheduling, monitoring, and managing complex/custom data workflows.

  • Cloud & DevOps:

1. Familiarity with CI/CD tools and AWS ECS for containerized deployments and continuous integration.

  • Soft Skills:

1. Strong problem-solving and debugging capabilities.

2. Flexible and dependable in supporting teams during critical issue resolution and extended hours when needed.


Job Classification

Industry: IT Services & Consulting
Functional Area / Department: Engineering - Software & QA
Role Category: Software Development
Role: Big Data Engineer
Employement Type: Full time

Contact Details:

Company: Sonata Software
Location(s): Hyderabad

+ View Contactajax loader


Keyskills:   Pyspark Apache Teradata Greenplum Mango Db

 Job seems aged, it may have been expired!
 Fraud Alert to job seekers!

₹ Not Disclosed

Similar positions

Oracle Service Bus Developer Opportunity - Oracle India Pvt Ltd

  • Oracle
  • 4 - 9 years
  • Pune
  • 4 days ago
₹ Not Disclosed

CTO - Quantum Engineering - Developer

  • Wipro
  • 2 - 7 years
  • Bengaluru
  • 4 days ago
₹ Not Disclosed

Chatbot Developer

  • Capgemini
  • 4 - 9 years
  • Mumbai
  • 4 days ago
₹ Not Disclosed

Data Engineer (Azure Purview)

  • Capgemini
  • 6 - 11 years
  • Hyderabad
  • 4 days ago
₹ Not Disclosed

Sonata Software

Sonata is a global technology company, that enables successful platform based digital transformation initiatives for enterprises, to create businesses that are connected, open, intelligent and scalable. Sonata€™s Platformation„¢ methodology brings together industry expertise, platform technol...