Data Engineers For Big Data Program @ Grid Dynamics

Home > Software Development

Data Engineers For Big Data Program

Grid Dynamics
3 - 6 years
Remote
11 months ago
Email to a friend
Report this job

Job Description

A passion for continuous learning and professional growth
Willingness to invest time in education and stay updated with the latest technologies
Ability to work in a collaborative and dynamic environment

If you are ready to advance your career in Big Data , apply now and be part of an exciting journey towards becoming a Big Data expert!

Essential functions

Uploader (Go written binary client with its backend API to transfer data from third-party into platform)

Scheme registry (It is a metadata store with dataset schemas including schema management capabilities)
Pipeline manager (Manage ETL pipelines: CRUD and execute. Triggers ETL pipeline on upload event Pipelines metadata storage)
(Airflow DAG) data ingestion pipeline including data decryption, validation (optionally) and ingestion.
Monitor data metrics. uploads and integrity. At least data size, num objects, uploader entity, path.
Hone the soft skills necessary for effective collaboration with customer team members and stakeholders, including engineering managers.

Qualifications

Strong Scala, Java or Python (Primary skill requirement)
Strong SQL
Good knowledge of Apache Spark

Would be a plus

Python and/or Java is nice-to-have
Snowflake, docker, K8s, Helm, PostgreSql, Superset/Tableau
AWS(EKS, IAM, S3, SNS, SQS, MSK etc)
Theoretical knowledge of Big Data concepts
Commercial experience, working with real clients (not only pet-projects or RnD or Internships)
Eager to invest his/her time to education and learn new technologies

Job Classification

Industry: IT Services & Consulting
Functional Area / Department: Engineering - Software & QA
Role Category: Software Development
Role: Big Data Engineer
Employement Type: Full time

Contact Details:

Company: Grid Dynamics
Location(s): Remote

+ View Contact

Login

Candidates can login here to view contacts and apply.

Sign In Sign Up

Email:

Password:

Password too short

To create your profile, apply for a job or make a registration

Your name (*)

Email (*)

Mobile (*)

Preferred City (* max. 2 w/comma)

Designation / Expected Role

Current / Recent Company (*)

Experience (*)

Expected Salary (*)

Desired Industry (*):

Functional area / Department (*):

Enter Skills (key skills, subjects, technologies & roles to use in search)

Write briefly about yourself, your experience and education (*)

Attach Resume Max 2.38 MB (RTF, PDF, DOC, DOCX formats only parsed)

Please, check the file size and type.

Add social media [ + ]

Create password

I agree with website service terms and conditions

Candidates are expected to provide most recent and accurate profile information, inappropriate content is strictly prohibited!

Keyskills: metadata Backend Development Manager spark Postgresql Schema SCALA big data SQL Python

Job seems aged, it may have been expired!
Fraud Alert to job seekers!

₹ Not Disclosed

Job application

We will notify the employer with your details. You can also attach a resume or a cover letter.

Sign In Sign Up

Email:

Password:

Password too short

To create your profile, apply for a job or make a registration

Your name (*)

Email (*)

Mobile (*)

Preferred City (* max. 2 w/comma)

Designation / Expected Role

Current / Recent Company (*)

Experience (*)

Expected Salary (*)

Desired Industry (*):

Functional area / Department (*):

Enter Skills (key skills, subjects, technologies & roles to use in search)

Write briefly about yourself, your experience and education (*)

Attach ResumeMax 2.38 MB (RTF, PDF, DOC, DOCX formats only parsed)

Please, check the file size and type.

Add social media [ + ]

Create password

I agree with website service terms and conditions

Similar positions

Technical Lead For MS Apps solutions +Databricks

Capgemini

15 - 20 years

Hyderabad

2 days ago

₹ Not Disclosed

Data Engineer

ConverseHR

2 - 5 years

Hyderabad

1 day ago

₹ 15-25 Lacs P.A.

Opportunity For Sr. Data Engineer(Azure)-Contractual Role-Kolkata

Top Product Based

6 - 10 years

Kolkata

1 day ago

₹ 12-20 Lacs P.A.

Senior Data Engineer

ConverseHR

7 - 10 years

Hyderabad

2 days ago

₹ 0-45 Lacs P.A.

Grid Dynamics

About Us: Grid Dynamics (NASDAQ: GDYN) is a leading provider of technology consulting, platform and product engineering, and advanced analytics services. Fusing technical vision with business acumen, we enable positive business outcomes for enterprise companies undergoing business tran...

Data Engineers For Big Data Program @ Grid Dynamics

Home > Software Development