Data Engineer - Informatica BDM
- Valuelabs
- 5 - 8 years
- Bengaluru
- 7 months ago
- Email to a friend
- Report this job
Job Description
Job Summary
We are seeking a highly motivated Senior Data Engineer with expertise in designing, building, and securing data systems. The ideal candidate will have a strong background in data engineering, security compliance, and distributed systems, with a focus on ensuring adherence to industry standards and regulatory requirements.
Key Responsibilities
- Design, implement, and maintain secure data systems, including wrapper solutions for components with minimal security controls, ensuring compliance with bank standards.
- Identify security design gaps in existing and proposed architectures and recommend enhancements to strengthen system resilience.
- Develop and enforce security controls for data transfers, including CRON, ETLs, and JDBC-ODBC scripts.
- Ensure compliance with data sensitivity standards, such as avoiding storage of card numbers or PII in logs, and maintaining data integrity.
- Collaborate on distributed systems, focusing on resiliency, monitoring, and troubleshooting in production environments.
- Work with Agile/DevOps practices, CI/CD pipelines (GitHub, Jenkins), and scripting tools to optimize data workflows.
- Troubleshoot and resolve issues in large-scale data infrastructures, including SQL/NoSQL databases, HDFS, Hive, and HQL.
Requirements
-5+ years of total experience, with4+ years in Informatica Big Data Management.
- Extensive knowledge of Oozie scheduling, HQL, Hive, HDFS, and data partitioning.
- Proficiency in SQL and NoSQL databases, along with Linux OS configuration and shell scripting.
- Strong understanding of networking concepts (DNS, Proxy, ACL, Policy) and data transfer security.
- In-depth knowledge of compliance and regulatory requirements (encryption, anonymization, policy controls).
- Familiarity with Agile/DevOps, CI/CD, and distributed systems monitoring.
- Ability to address data sensitivity concerns in logging, events, and in-memory storage.
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Data EngineerEmployement Type: Full timeContact Details:
Company: ValuelabsLocation(s): Bengaluru
Keyskills: Informatica BDM Informatica HQL Hive HDFS Oozie NOSQL SQL
Similar positions
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in