Data Engineer
- Incedo
- 3 - 5 years
- Hyderabad
- 5 months ago
- Email to a friend
- Report this job
Job Description
Role Description:
As a Software Engineer - ETL - PySpark, SparkSQL at Incedo, you will be responsible for designing and developing ETL workflows to extract, transform, and load data from various sources to target systems. You will work with data analysts and architects to understand business requirements and translate them into technical solutions. You will be skilled in ETL tools such as Informatica or Talend and have experience in programming languages such as PySpark, SparkSQL. You will be responsible for writing efficient and reliable code that is easy to maintain and troubleshoot.
Roles & Responsibilities:
- Develop, maintain, and enhance software applications for Extract, Transform, and Load (ETL) processes
- Design and implement ETL solutions that are scalable, reliable, and maintainable Develop and maintain ETL code, scripts, and jobs, ensuring they are efficient, accurate, and meet business requirements Troubleshoot and debug ETL code, identifying and resolving issues in a timely manner
- Collaborate with cross-functional teams, including data analysts, business analysts, and project managers, to understand requirements and deliver solutions that meet business needs
- Design and implement data integration processes between various systems and data sources Optimize ETL processes to improve performance, scalability, and reliability
- Create and maintain technical documentation, including design documents, coding standards, and best practices.
Technical Skills
Skills Requirements:
- Proficiency in programming languages such as PySpark, SparkSQL for writing ETL scripts
- Knowledge of data transformation techniques such as filtering, aggregation, and joining
- Familiarity with ETL frameworks such as Apache NiFi, Talend, or Informatica
- Understanding of data profiling, data quality, and data validation techniques
- Must have excellent communication skills and be able to communicate complex technical information to non-technical stakeholders in a clear and concise manner
- Must understand the company's long-term vision and align with it.
Qualifications
3-5 years of work experience in relevant fieldB.Tech/B.E/M.Tech or MCA degree from a reputed university. Computer science background is preferred .
Job Classification
Industry: BankingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Data EngineerEmployement Type: Full timeContact Details:
Company: IncedoLocation(s): Hyderabad+ View Contact
Keyskills: etl talend pyspark programming languages 46417 banking data quality apache nifi apache data science onboarding software engineer telecom data transformation wealth management informatica data integration programming
Fraud Alert to job seekers!
₹ Not Disclosed
Similar positions
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in