Job Description
Interested folks can share their details @ ga*****p@ac*******l.com
- Kafka and Spark experience is very important
2. Experience with AWS or other public cloud like Azure is more important
Role: Big Data Engineer
Job Description:
- Develops and maintains salable data pipelines and builds out new API integrations to support continuing increases in data volume and complexity.
- Defines company data assets (data models), SPARK,SPARKSQL, and HIVESQL jobs to populate data models
- Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization
- Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
- Writes unit/integration tests, contributes to engineering wiki, and documents work.
Experience:
- BS or MS degree in Computer Science or a related technical field
- 4+ years of Python or Java development experience
- 4+ years of SQL experience (No-SQL experience is a plus)
- 4+ years of experience with schema design and dimensional data modelling
- 4-5 years experience in ETL/Data Engineering technologies
- Experience in Cloud Big Data Technologies Cloudera, HortonWorks, MS Azure, AWS, or Google Cloud Platform
- Experience in building Data Lake on Cloud or migration of Big Data clusters to Cloud
- Ability in managing and communicating data warehouse plans to internal clients
- Experience designing, building, and maintaining data processing systems
- Experience working with either a Map Reduce or an MPP system on any size/scale
Job Classification
Industry: IT-Software, Software Services
Functional Area: IT Software - System Programming,
Role Category: Programming & Design
Role: Programming & Design
Employement Type: Full time
Education
Under Graduation: Any Graduate in Any Specialization
Post Graduation: Any Postgraduate in Any Specialization
Doctorate: Doctorate Not Required, Any Doctorate in Any Specialization
Contact Details:
Company: Alten Calsoft Labs
Address: 4/1,7th Floor,IBC Knowledge Park,Tower D,,Bannergh, atta Mail Road,Bhavani Nagar,Sudduguntepalya, , BANGALORE, Karnataka, India
Location(s): Bengaluru
Keyskills:
Cloudera
Big Data
Spark
Java
Data Engineering
Data Warehousing
AWS
SQL
Python
Google Cloud