Data Engineer
- MNR Solutions Pvt Ltd
- 1 Positions
- Bengaluru
- 8 months ago
- Email to a friend
- Report this job
Job Description
We are looking for a skilled Data Engineer to build and optimize data pipelines for a real-time Digital Twin platform powering mobility simulation, complex event processing, and multi-agent learning.
You'll design the backbone for scalable, low-latency ingestion and processing of high-volume sensor, vehicle, and infrastructure data to feed prediction models and simulations.
Responsibilities: Design and implement streaming data pipelines from IoT sensors, camera, vehicle telemetry, and infrastructure systems. Build scalable infrastructure using Kinesis, Apache Flink / Spark for real-time and batch workloads.
Enable time-series feature stores and sliding window processing for mobility patterns.
Integrate simulation outputs and model predictions into data lakes in AWS.
Maintain data validation, schema versioning, and high-throughput ingestion.
Collaborate with Data Scientists and Simulation Engineers to optimize data formats (e.g., Parquet, Protobuf, Delta Lake).
Deploy and monitor pipelines on AWS cloud and/or edge infrastructure.
Requirements: 3+ years of experience in data engineering, preferably with real-time systems.
Overall 5+ Years of experience Proficient with Python, SQL, and distributed data systems (Kinesis, Spark, Flink, etc.).
Strong understanding of event-driven architectures, data lakes, and message serialization.
Experience with sensor data processing, telemetry ingestion, or mobility data is a plus. Familiarity with Docker, CI/CD, Kubernetes, and cloud-native architectures. Familiarity with bulding data pipelines & its workflows (eg: Airflow).
Employement Category:
Employement Type: Full timeIndustry: IT Services & ConsultingRole Category: Application Programming / MaintenanceFunctional Area: Not SpecifiedRole/Responsibilies: Data EngineerContact Details:
Company: MNR Solutions Pvt LtdLocation(s): Bengaluru
Keyskills: sql python docker aws kubernetes
Similar positions
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in