AWS Data Architect || Infogain
- Infogain
- 11 - 18 years
- Bengaluru
- 6 months ago
- Email to a friend
- Report this job
Job Description
Exp: 10+ years
Job Role : AWS Architect with Databricks
Job Location: Noida / Mumbai / Pune / Bangalore / Gurgaon / Kochi (Hybrid Work)
Role & responsibilities
- Design, build, and optimize ETL/ELT pipelines using Databricks (PySpark, Delta Lake) on AWS.
- Ingest and process structured, semi-structured, and unstructured data from multiple sources (RDBMS, APIs, streaming).
- Integrate AWS services such as S3, Glue, Lambda, Kinesis, Athena, Redshift with Databricks.
- Implement data quality checks, validation frameworks, and monitoring for production workloads.
- Optimize data storage, partitioning, and caching strategies for performance and cost efficiency.
- Collaborate with Data Architects and Analysts to design data models and lakehouse layers (raw, curated, semantic).
- Implement CI/CD pipelines for Databricks jobs and notebooks using Git-based workflows (e.g., CodeCommit, GitHub).
- Apply security best practices: IAM roles, encryption, VPC, and data governance policies.
- Work with stakeholders to understand data requirements and deliver scalable, reusable solutions.
- Participate in code reviews, peer programming, and Agile ceremonies.
Required Skills & Experience
- 3- 6 years of experience in Data Engineering (cloud-based preferred).
- Strong hands-on expertise in Databricks (PySpark, Delta Lake, SQL).
- Proficiency in AWS data services: S3, Glue, Lambda, Kinesis, Athena, Redshift.
- Experience in ETL/ELT design patterns and best practices.
- Strong Python and SQL skills for data manipulation and transformation.
- Knowledge of data warehousing, dimensional modeling, and lakehouse concepts.
- Experience with version control (Git) and DevOps tools.
- Understanding of data security, encryption, and governance on AWS.
Good to Have / Preferred
- AWS certifications: AWS Certified Data Engineer Associate / Professional or AWS Certified Solutions Architect Associate.
- DataBricks Certification: DataBricks certified Associate / Professional
- Experience with Glue or other orchestration tools.
- Exposure to machine learning pipelines in Databricks.
- Familiarity with Terraform or AWS CloudFormation for IaC.
- Experience in Agile/Scrum delivery models.
Education
- Bachelors or Masters degree in Computer Science, Information Systems, or related field.
Preferred candidate profile
Interested candidates , kindly share updated resume at si*********i@in*****n.com
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: IT & Information SecurityRole Category: IT & Information Security - OtherRole: IT & Information Security - OtherEmployement Type: Full timeContact Details:
Company: InfogainLocation(s): Bengaluru
Keyskills: architect databricks AWS SQL Delta Lake pyspark Aws Glue
Similar positions
Infogain
A global digital engineering company delivering technology solutions that accelerate business outcomes. It specializes in cloud, data, AI, and experience-led transformation for enterprises across industries.
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in