Data Engineer II
- Hackerrank
- 3 - 6 years
- Remote
- 1 year ago
- Email to a friend
- Report this job
Job Description
- Evaluate technologies, develop POCs, solve technical challenges and propose innovative solutions for our technical and business problems
- Delight our stakeholders, customers and partners by building high-quality, well-tested, scalable and reliable business applications.
- Design, build and maintain streaming and batch data pipelines that can scale.
- Architect, develop and maintain our Modern lake house Platform using AWS native infrastructure
- Designing Complex Data Models to deliver insights and enable self-service
- Take ownership of scaling, performance, security, and reliability of our data infrastructure
- Hiring, guiding and mentoring junior engineers
- Work in the agile development environment, participate in code reviews
- Collaborate with remote development teams and cross-functional teams
- 3+ years of experience with designing, developing and maintaining data engineering & BI solutions.
- Experience with Data Modeling for Big Data Solutions.
- Experience with Spark, Spark Structured Streaming (PySpark or Scala Spark)
- Experience with database technologies like Redshift or Trino
- Experience with BI Solutions like Looker, Power BI, Amazon Quicksight, Tableau etc is a big plus
- Experience with ETL Design & Orchestration using platforms like Apache Airflow, MageAI etc is a big plus
- Experience querying massive datasets using Languages like SQL, Hive, Spark, Trino
- Experience with performance tuning complex data warehouses and queries.
- Able to solve problems of scale, performance, security, and reliability
- Self-driven, initiative taker with good communication skills, ability to lead and mentor junior engineers, work with cross-functional teams, drive architecture decisions
- Knowledge of Kafka, Kafka Connect and related technologies is a huge bonus
- One-time home office set up stipend
- Monthly Remote Work Enablement Stipend
- Professional Development Reimbursement
- Wellbeing Benefits (Headspace, Cleo, etc)
- Unlimited paid time off, paid leave for new parents, and flexible work hours
- Insurance for all employees (term life, personal accident, medical) along with medical insurance for their dependents
- Employee stock options, flexible work hours, and time off
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Data Science & AnalyticsRole Category: Data Science & Machine LearningRole: Data EngineerEmployement Type: Full timeContact Details:
Company: HackerrankLocation(s): Remote+ View Contact
Keyskills: Performance tuning orchestration data engineer ii Data modeling spark SCALA Silicon Medical insurance Apache SQL
Fraud Alert to job seekers!
₹ Not Disclosed
Similar positions
Hackerrank
We are dedicated to providing marketers with the latest data-driven insights, guidance and thought leadership. Our experts will share their perspectives on the latest marketing and consumer trends, keeping you informed and inspired to do your best work.
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in