Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Big Data Engineer - Bengaluru/Bangalore @ Calsoft

Home > Programming & Design

 Big Data Engineer - Bengaluru/Bangalore

Job Description

Interested folks can share their details @ ga*****p@ac*******l.com

  1. Kafka and Spark experience is very important

2. Experience with AWS or other public cloud like Azure is more important


Role: Big Data Engineer

Job Description:

  • Develops and maintains salable data pipelines and builds out new API integrations to support continuing increases in data volume and complexity.
  • Defines company data assets (data models), SPARK,SPARKSQL, and HIVESQL jobs to populate data models
  • Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization
  • Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
  • Writes unit/integration tests, contributes to engineering wiki, and documents work.

Experience:

  • BS or MS degree in Computer Science or a related technical field
  • 4+ years of Python or Java development experience
  • 4+ years of SQL experience (No-SQL experience is a plus)
  • 4+ years of experience with schema design and dimensional data modelling
  • 4-5 years experience in ETL/Data Engineering technologies
  • Experience in Cloud Big Data Technologies Cloudera, HortonWorks, MS Azure, AWS, or Google Cloud Platform
  • Experience in building Data Lake on Cloud or migration of Big Data clusters to Cloud
  • Ability in managing and communicating data warehouse plans to internal clients
  • Experience designing, building, and maintaining data processing systems
  • Experience working with either a Map Reduce or an MPP system on any size/scale

Job Classification

Industry: IT-Software, Software Services
Functional Area: IT Software - System Programming,
Role Category: Programming & Design
Role: Programming & Design
Employement Type: Full time

Education

Under Graduation: Any Graduate in Any Specialization
Post Graduation: Any Postgraduate in Any Specialization
Doctorate: Doctorate Not Required, Any Doctorate in Any Specialization

Contact Details:

Company: Alten Calsoft Labs
Address: 4/1,7th Floor,IBC Knowledge Park,Tower D,,Bannergh, atta Mail Road,Bhavani Nagar,Sudduguntepalya, , BANGALORE, Karnataka, India
Location(s): Bengaluru

+ View Contactajax loader


Keyskills:   Cloudera Big Data Spark Java Data Engineering Data Warehousing AWS SQL Python Google Cloud

 Job seems aged, it may have been expired!
 Fraud Alert to job seekers!

₹ Not Disclosed

Calsoft

ALTEN Calsoft Labs is a next gen digital transformation, technology consulting, enterprise IT and product engineering services company, that helps customers to become smarter, highly productive, nimble and better at predicting the future. Leveraging our extensive deep industry and business process e...