Data Engineer
- ADP
- 4 - 7 years
- Hyderabad
- 7 days ago
- Email to a friend
- Report this job
Job Description
ADP is hiring Sr. Data Engineer (Sr. Member Technical)
Required Skills
- Bachelors / Engineering degree in Computer Science or Information Technology.
- Postgraduate degree or diploma in Computer Science / Data Science is an added advantage.
- AWS, SQL, Databricks, and Apache Spark certifications are a plus.
- Strong foundation in data analytics and engineering, with a minimum of 57 years of hands-on experience in project management, implementation, development, improvement, and support of data-related projects.
- Strong expertise in programming languages such as Python and SQL.
- Deep knowledge of big data processing and analytics (Spark, Spark optimization, Databricks, Big Data technologies).
- Proficient in data modeling.
- Good expertise in development and operations (DevOps, GIT).
- Knowledge of data storage and architecture is preferred.
- Experience with minimum 45 relevant project closures.
Roles & Responsibilities
- Demonstrates strong capabilities in Python and SQL, designing functional Python scripts for data manipulation or ETL tasks; uses libraries like pandas, NumPy effectively.
- Designs and optimizes complex SQL-based data models, and mentors others in query optimization and database design principles.
- Independently builds and optimizes Spark jobs for complex ETL tasks and manages Databricks workflows for performance and reliability.
- Designs scalable Spark workflows and mentors others in advanced optimization techniques (e.g., skew handling, memory tuning).
- Develops and optimizes Databricks workflows; manages clusters and schedules jobs effectively.
- Creates robust data models for analytics (e.g., star schemas); ensures scalability and performance.
- Proficient in DevOps practices, utilizing CI/CD pipelines and GIT for deployment while maintaining high standards of code quality and reliability.
- Innovates analytics methodologies for complex problems, mentors others in analytics best practices.
- Demonstrates strong problem-solving and project ownership, independently resolving complex technical issues and driving projects from start to finish.
- Effectively communicates complex ideas to both technical and non-technical stakeholders, ensuring clear understanding and delivering robust, scalable analytics solutions.
- Develops robust analytics approaches; ensures solutions are scalable and aligned with business objectives.
- Optimizes pipeline performance with supervision and implements basic improvements (e.g., indexing, caching).
- Effectively Participates in stakeholder meetings, contributes to discussions on project requirements and updates, and gathers basic requirements, while needing some supervision for advanced conflict resolution and establishing complex stakeholder relationships.
- Actively contributes to Agile processes, project planning, and supports the development team through knowledge sharing and basic technical guidance.
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Data Science & AnalyticsRole Category: Data Science & Machine LearningRole: Data EngineerEmployement Type: Full timeContact Details:
Company: ADPLocation(s): Hyderabad+ View Contact
Fraud Alert to job seekers!
₹ Not Disclosed
Similar positions
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in