Big Data Developer
- Magna Infotech
- 2 - 6 Years
- Chennai
- 5 years ago
- Email to a friend
- Report this job
Job Description
JOB LOCATION : NAVI MUMBAIEXPERIENCE:2-6 YRS
Job Type: C2H Long Term Project
Note: Candidate should be have all academics above 65% and Notice period Immediate - 15 days only
Mandatory Skill Set: Core Java(Multi threading, Data Structures, Algorithms), Hadoop, Spark, SCALA, Hive
Mandatory Skill Set: Core Java(Multi threading, Data Structures, Algorithms), Hadoop, Spark, SCALA, Hive
Proficient in Core JAVA (Multithreading and Collections framework)
Proficient in cleaning, transforming, and analyzing vast amounts of raw data from various systems using Spark to provide ready-to-use data to our feature developers and business analysts.
Proficient in designing efficient data processing pipelines by writing suitable Spark batch and streaming Jobs involving various transformations and aggregations.
Proficient in Spark data structures and APIs based on RDDs, Dataframe and Datasets.
Proficient in Spark query tuning and performance optimization
Proficient in usage of Hadoop Distributed File System (HDFS)
Proficient in data formats such as JSON, ORC, Parquet, Avro, etc.
Desirable: Understanding of distributed systems (e.g. CAP theorem, partitioning, replication, consistency, and consensus)
Desirable: Working with unstructured database (Mongo DB, HBase, Cassandra)
Desirable: Understanding and experience of working on SQL databases, such as Oracle, MySQL or Postgres
Desirable: Experience with Zookeeper, Hive, Sqoop and other utilities of Hadoop Ecosystem.
Must have strong troubleshooting skill in debugging the failure of Spark Jobs on production cluster.
Proficient in cleaning, transforming, and analyzing vast amounts of raw data from various systems using Spark to provide ready-to-use data to our feature developers and business analysts.
Proficient in designing efficient data processing pipelines by writing suitable Spark batch and streaming Jobs involving various transformations and aggregations.
Proficient in Spark data structures and APIs based on RDDs, Dataframe and Datasets.
Proficient in Spark query tuning and performance optimization
Proficient in usage of Hadoop Distributed File System (HDFS)
Proficient in data formats such as JSON, ORC, Parquet, Avro, etc.
Desirable: Understanding of distributed systems (e.g. CAP theorem, partitioning, replication, consistency, and consensus)
Desirable: Working with unstructured database (Mongo DB, HBase, Cassandra)
Desirable: Understanding and experience of working on SQL databases, such as Oracle, MySQL or Postgres
Desirable: Experience with Zookeeper, Hive, Sqoop and other utilities of Hadoop Ecosystem.
Must have strong troubleshooting skill in debugging the failure of Spark Jobs on production cluster.
Employement Category:
Employement Type: Part timeIndustry: ITFunctional Area: ITRole Category: Software DeveloperRole/Responsibilies: Big Data DeveloperContact Details:
Company: Quess IT StaffingLocation(s): Chennai+ View Contact
Fraud Alert to job seekers!
₹ Not Specified
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in