Job Description
Senior Data Engineer:
We are seeking a talented Senior Developer to lead our development team in creating software solutions that meet our clients' needs.
Work youll do/Responsibilities:
You will play a pivotal role within the Information Technology (IT) team, analyze technical/business problems, and recommend strategies to implement technology or improve processes to enable improved IT productivity. You will drive large scale modernization from legacy to cloud based solutions.
You will be responsible for communicating with clients to determine their requirements, creating comprehensive solution plans, and provide technical guidance to application development teams. When you join us, youll be part of a hard-working, driven team that shares your passion for modernizing complex legacy applications.
- Provide technical leadership throughout the development life cycle and focus on delivery of quality solutions
- Mentor engineering team members on technical decision making, code reviews and enforcing engineering practices and standards
- Define standards to guide architectural designs
- Architect and develop software solutions by analyzing system performance standards; confer with users or system engineers
- Lead technical discussions and build consensus among engineers
- Stay current on technology trends and identify ways to innovate
- Analyze user requirements to derive technical software design and performance requirements
- Plan, track, manage deliverables on short term sprints and long-term software deployments
Qualifications Required:
Bachelors Degree preferably in Computer Science, Engineering, Management Information Systems, or equivalent work experience.
10+ years of full stack software development with an emphasis on architecting, designing, implementing, testing and delivering highly scalable web and client/server solutions.
10+ years of experience in Data Engineering development
Strong experience with:
- AWS Glue - Python, Big Data Pyspark, Control-M ETL Batch job implementation stack
- Kinesis, Kafka, SNS Real time message processing
- AWS Aurora, Dynamo, S3 Data Storage
- AWS IAM, Cloud formation, Bamboo Infra as code and CI/CD
- Lambda, Step function Orchestration
Secondary Skills:
- CloudWatch, Event Bridge, Amazon EKS, Honeycomb, Redshift, AWS ALB
Good to have knowledge on:
- Design patterns/solid principles, Architectural patterns around microservices, Batch and Real time, Database decision, Memory management, Performance Tuning, Cost Optimization
- Prior experience with Database administration & migration & modernization in AWS Cloud
- Data Modelling and designing
- Experience writing SQL/Functions/Procedures in transactional database systems such as Oracle, SQL Server, DB2
- Extensive expertise in building CI/CD pipelines, containers, AWS and IaC
- Understanding of ALC, DB2 mainframe database
- Demonstrated project experience and skills in information requirements gathering, current state analysis, building data models, data architecture and data management process definition
- Experienced in creating polished high- and low-level design documentation, to facilitate the development cycle
- Extensive experience leading development teams to provide technical deliverables in accordance with SDLC methodologies such as SCRUM andAgile
- Great experience with performing code reviews and recommending automated review tools
- Experience with mentoring others in development technologies, processes, and tools
Job Classification
Industry: IT Services & Consulting
Functional Area / Department: Engineering - Software & QA
Role Category: Software Development
Role: Full Stack Developer
Employement Type: Full time
Contact Details:
Company: Internal
Location(s): Hyderabad
Keyskills:
Pyspark
Senior Data Engineer
Data Engineering
AWS Glue
Python
DynamoDB
Lambda