Requirement On Big Data Developer
- I Square Soft
- 3 to 6 Yrs
- Bengaluru
- 5 years ago
- Email to a friend
- Report this job
Job Description
Roles and Responsibilities
- Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities
- Develop and maintain data pipelines implementing ETL process, monitoring performance and advising any necessary infrastructure changes
- Translate complex technical and functional requirements into detailed designs
- Investigate and analyze alternative solutions to data storing, processing etc. to ensure most streamlined approaches are implemented
- Serve as a mentor to junior staff by conducting technical training sessions and reviewing project outputs
Skills and Qualifications
- Strong understanding of data warehousing and data modeling techniques.
- Proficient understanding of distributed computing principles - Hadoop v2, MapReduce, HDFS
- Strong data engineering skills on the either of the major cloud platforms (Azure/GCP/AWS) is preferred.
- Experience with Spark, SQL, and Linux.
- Experience with building stream-processing systems, using solutions such as Storm or Spark-Streaming
- Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala
- Preferred experience with NoSQL databases, such as HBase, Cassandra, MongoDB
- Knowledge of various ETL techniques and frameworks, such as Flume, Apache NiFi, or DBT.
- Experience with various messaging systems, such as Kafka or RabbitMQ.
- Good understanding of Lambda Architecture, along with its advantages and drawbacks
Desired Candidate Profile
Perks and Benefits
,
Employement Category:
Employement Type: Full timeIndustry: IT - SoftwareRole Category: General / Other SoftwareFunctional Area: Not ApplicableRole/Responsibilies: Requirement On Big Data Developer ForContact Details:
Company: I Square SoftLocation(s): Bengaluru+ View Contact
Fraud Alert to job seekers!
₹ 4.5 - 10 Lakh/Yr
Similar positions
I Square Soft
I Square Soft We provide full range of custom software development services. Ensure us as a efficient and reliable resource partner for our clients. We understand what it takes for a company to hire the right professional for the right position. We have developed a comprehensive and continuously...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in