Junior Big Data Nifi Developer
- Capco
- 3 - 5 years
- Pune
- 6 months ago
- Email to a friend
- Report this job
Job Description
We are seeking a highly skilled and motivated Big Data NiFi Developer to join our growing data engineering team in Pune. The ideal candidate will have hands-on experience with Apache NiFi, strong understanding of big data technologies, and a background in data warehousing or ETL processes. If you are passionate about working with high-volume data pipelines and building scalable data integration solutions, wed love to hear from you.
Key Responsibilities:- Design, develop, and maintain data flow pipelines using Apache NiFi.
- Integrate and process large volumes of data from diverse sources using Spark and NiFi workflows.
- Collaborate with data engineers and analysts to transform business requirements into data solutions.
- Write reusable, testable, and efficient code in Python or Java or Scala.
- Develop and optimize ETL/ELT pipelines for performance and scalability.
- Ensure data quality, consistency, and integrity across systems.
- Participate in code reviews, unit testing, and documentation.
- Monitor and troubleshoot production data workflows and resolve issues proactively.
- 3 to 5 years of hands-on experience in Big Data development.
- Strong experience with Apache NiFi for data ingestion and transformation.
- Proficient in at least one programming language: Python, Scala, or Java.
- Experience with Apache Spark for distributed data processing.
- Solid understanding of Data Warehousing concepts and ETL tools/processes.
- Experience working with large datasets, batch and streaming data processing.
- Knowledge of Hadoop ecosystem and cloud platforms (AWS, Azure, or GCP) is a plus.
- Excellent problem-solving and communication skills.
- Ability to work independently in a hybrid work environment.
- Experience with NiFi registry and version control integration.
- Familiarity with containerization tools (Docker/Kubernetes).
- Exposure to real-time data streaming tools like Kafka.
Job Classification
Industry: BankingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Data EngineerEmployement Type: Full timeContact Details:
Company: CapcoLocation(s): Pune
Keyskills: big data technologies java apache nifi etl tool data ingestion big data administration kubernetes python software testing scala microsoft azure data warehousing elt docker spark gcp kafka data warehousing concepts hadoop big data aws etl
Similar positions
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in