Cloud Data Engineer
- CAI
- 5 - 8 years
- Bengaluru
- 5 months ago
- Email to a friend
- Report this job
Job Description
Cloud Data Engineer
Req number:
R5934
Employment type:
Full time
Worksite flexibility:
Remote
Who we areCAI is a global technology services firm with over 8,500 associates worldwide and a yearly revenue of $1 billion+. We have over 40 years of excellence in uniting talent and technology to power the possible for our clients, colleagues, and communities. As a privately held company, we have the freedom and focus to do what is rightwhatever it takes. Our tailor-made solutions create lasting results across the public and commercial sectors, and we are trailblazers in bringing neurodiversity to the enterprise.
Job Summary
We are seeking a motivated Cloud Data Engineer that has experience in building data products using Databricks and related technologies. This is a Full-time and Remote position.
Job Description
What Youll Do
- Analyze and understand existing data warehouse implementations to support migration and consolidation efforts.
- Reverse-engineer legacy stored procedures (PL/SQL, SQL) and translate business logic into scalable Spark SQL code within Databricks notebooks.
- Design and develop data lake solutions on AWS using S3 and Delta Lake architecture, leveraging Databricks for processing and transformation.
- Build and maintain robust data pipelines using ETL tools with ingestion into S3 and processing in Databricks.
- Collaborate with data architects to implement ingestion and transformation frameworks aligned with enterprise standards.
- Evaluate and optimize data models (Star, Snowflake, Flattened) for performance and scalability in the new platform.
- Document ETL processes, data flows, and transformation logic to ensure transparency and maintainability.
- Perform foundational data administration tasks including job scheduling, error troubleshooting, performance tuning, and backup coordination.
- Work closely with cross-functional teams to ensure smooth transition and integration of data sources into the unified platform.
- Participate in Agile ceremonies and contribute to sprint planning, retrospectives, and backlog grooming.
- Triage, debug and fix technical issues related to Data Lakes.
- Maintain and Manage Code repositories like Git.
What You'll Need
- 5+ years of experience working with Databricks, including Spark SQL and Delta Lake implementations.
- 3 + years of experience in designing and implementing data lake architectures on Databricks.
- Strong SQL and PL/SQL skills with the ability to interpret and refactor legacy stored procedures.
- Hands-on experience with data modeling and warehouse design principles.
- Proficiency in at least one programming language (Python, Scala, Java).
- Bachelors degree in Computer Science, Information Technology, Data Engineering, or related field.
- Experience working in Agile environments and contributing to iterative development cycles. Experience working on Agile projects and Agile methodology in general.
- Databricks cloud certification is a big plus.
- Exposure to enterprise data governance and metadata management practices.
Physical Demands
- This role involves mostly sedentary work, with occasional movement around the office to attend meetings, etc.
- Ability to perform repetitive tasks on a computer, using a mouse, keyboard, and monitor.
Reasonable accommodation statement
If you require a reasonable accommodation in completing this application, interviewing, completing any pre-employment testing, or otherwise participating in the employment selection process, please direct your inquiries to ap***********************s@***.io or (888) 824 8111.
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Data EngineerEmployement Type: Full timeContact Details:
Company: CAILocation(s): Bengaluru
Keyskills: hive scala delta apache pig data pipeline sql plsql cloud java data modeling spark etl tool gcp design hadoop etl big data programming data lake architecture agile methodology snowflake python data engineering data bricks cloud data flow hdfs agile sqoop aws data flow etl process
Similar positions
CAI
About Talent Sketchers: Talent Sketchers is an ISO-certified MNC headquartered in Pune, India, with a global presence in San Jose, USA. Established in 2003, we are a recognized leader in Staffing Services across India. With a strong workforce of 1800+ professionals, we have successfully placed over...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in