Senior Data Engineer
- Datametica
- 5 - 10 years
- Pune
- 8 months ago
- Email to a friend
- Report this job
Job Description
Job DescriptionKey Responsibilities
- Attend requirements gathering workshops, design meetings, and status review meetings
- Experience in Solution Design for the data engineer model to build and implement respective projects on-premises and on the cloud
- To be able to benchmark systems, analyses system bottlenecks and propose solutions to eliminate them
- Lead the development team, construct, test, maintain and run Sprints for the development and roll-out of functionalities
- Data Analysis, Code Development experience, ideally in ETL (Ab-Initio, Informatica, DataStage, Teradata, Alteryx, etc.) and/or Big Data (Scala, Spark, Hive, Hadoop, Python/Java, PySpark) Data Warehousing
- Able to help programmers and leadership (Architects / Technical Project Managers) in the design, planning, and governance of implementing projects of any kind
Qualifications
- Bachelor's or Master's degree in Computer Science or related field
- 5 plus years of hands-on experience in IT Software Development Industry
- Strong problem-solving and analytical skills
- Data Governance and Data Modeling experience
- Implement and deploy high-performance, custom applications at scale on Hadoop
- Strong experience with designing, creating, and maintaining Scala-based applications
- Strong experience over Hadoop ecosystem (Spark/Pyspark, Hive, Sqoop, ect.) based projects
- Extract Transform Load (ETL) expertise
- Experience with cloud-based data warehousing, cloud data pipeline and data management
- Translate complex functional and technical requirements into detailed design and development
- Good to have hands-on experience in Cloud Native Programming
- Experience GCP services like Big Query, Dataflow, Dataproc, Composer, Streaming, Pub-Sub, etc.
- Good to have experience over other cloud services - Azure (Data Factory, Data Bricks, Synapse etc.) / AWS (EMR, Glue, Athena, Redshift etc.) / Snowflake
- Proficient with agile/scrum
- Experience in architecting and implementing large-scale data solutions is a plus
- Knowledge of Hadoop, Teradata, Oracle, and other database systems is a plus
- Knowledge of any one of the tools Ab-Initio / Informatica / DataStage / Teradata / Alteryx / etc., good to have multiple (more than one) ETL tools hands-on
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Data EngineerEmployement Type: Full timeContact Details:
Company: DatameticaLocation(s): Pune+ View Contact
Fraud Alert to job seekers!
₹ Not Disclosed
Similar positions
Datametica
DataMetica is the leader in Big Data architecture, Advanced Analytics and Big Data Operations focused on serving large global companies. We provide a fast and reliable integration of Hadoop and related technologies into enterprise operations. Our team is comprised of highly experienced Hadoop, noSQL...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in