Big Data Engineer / Big Data Architect
- Intellisoft
- 4 to 7 Yrs
- Chennai
- 5 years ago
- Email to a friend
- Report this job
Job Description
Job Opening Details back to list Reference Code: AR092 Job Title: Big Data Engineer / Big Data Architect Category: Job Description: Technical Skillset (Mandatory)Big Data Tools: Hadoop, Cloudera (CDP), PySpark, Kafka, etc.
Data Pipeline & Integration: Airflow, Kafka, Informatica Cloud (IICS), PowerCenter
Stream-Processing Systems: Storm, Spark-Streaming, etc.
Databases: Relational SQL and NoSQL databases, Snowflake, Postgres and Cassandra.
AWS Cloud Services: EC2, S3, EMR, RDS, Lambda, DMS etc.
Object-Oriented Languages: Python
Technical Skillset (Optional)
Visualization Tool: SAP Business Objects, Tableau Key Skills: Technical Skillset (Mandatory)
Big Data Tools: Hadoop, Cloudera (CDP), PySpark, Kafka, etc.
Data Pipeline & Integration: Airflow, Kafka, Informatica Cloud (IICS), PowerCenter
Stream-Processing Systems: Storm, Spark-Streaming, etc.
Databases: Relational SQL and NoSQL databases, Snowflake, Postgres and Cassandra.
AWS Cloud Services: EC2, S3, EMR, RDS, Lambda, DMS etc.
Object-Oriented Languages: Python
Technical Skillset (Optional)
Visualization Tool: SAP Business Objects, Tableau
Role and Responsibilities
a. Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities
b. Implementing ETL processes using Spark
c. Ensure optimization of software through design reviews and code reviews
d. Monitoring performance and advising any necessary infrastructure changes & defining data retention policies
e. Management of Hadoop cluster, with all included services
f. Building stream-processing systems, using solutions such as Storm or Spark-Streaming
g. Solve any ongoing issues with operating the Hadoop cluster
Project Specific requirement (if any): ex: shift details
a. 2nd Shift working in US timing.
b. Data-oriented personality, good communication skills, and an excellent eye for details.
Relevant Experience required
a. Proficient understanding of distributed computing principles.
b. Proficiency with Hadoop, MapReduce, HDFS.
c. Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala
d. Strong understanding of Data Structures and Algorithms.
e. Experience with integration of data from multiple data sources
f. Experience with various messaging systems, such as Kafka or RabbitMQ
g. Experience in scripting languages such as Python.
h. Experience with Cloudera/MapR/Hortonworks Apache HDFS
i. Experience with scripting tools and methods to optimize SW development and testing activities.
j. At least 4-7+ years of industry experience in Big Data Domain Location: Chennai Required Experience: 4-7 yrs Positions: 1 Contact Person: Livingston Email ID: li*******n@ve************t.com Qualification:,
Employement Category:
Employement Type: Full timeIndustry: Management Consulting / StrategyRole Category: General / Other SoftwareFunctional Area: Not ApplicableRole/Responsibilies: Big Data Engineer / Big Data ArchitectContact Details:
Company: VEGA IntellisoftLocation(s): Chennai+ View Contact
Fraud Alert to job seekers!
₹ Not Specified
Similar positions
Intellisoft
Vega intellisoft provides Enterprise Solutions to core industries like Manufacturing, Automotive, Trading & Distribution, and Engineering & Construction.Since our inception, we have built long-term relationships with our customers serving their IT & ERP needs. We help our customers to compete and ...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in