Job Description
Position Summary... Drives the execution of multiple business plans and projects by identifying customer and operational needs; developing and communicating business plans and priorities; removing barriers and obstacles that impact performance; providing resources; identifying performance standards; measuring progress and adjusting performance accordingly; developing contingency plans; and demonstrating adaptability and supporting continuous learning. Provides supervision and development opportunities for associates by selecting and training; mentoring; assigning duties; building a team-based work environment; establishing performance expectations and conducting regular performance evaluations; providing recognition and rewards; coaching for success and improvement; and ensuring diversity awareness. Promotes and supports company policies, procedures, mission, values, and standards of ethics and integrity by training and providing direction to others in their use and application; ensuring compliance with them; and utilizing and supporting the Open Door Policy. Ensures business needs are being met by evaluating the ongoing effectiveness of current plans, programs, and initiatives; consulting with business partners, managers, co-workers, or other key stakeholders; soliciting, evaluating, and applying suggestions for improving efficiency and cost-effectiveness; and participating in and supporting community outreach events.
What youll do...
About the Team :
Enterprise Business Services is invested in building a compact, robust organization that includes service operations and technology solutions for Finance, People, Associate Digital Experience.
Our team is responsible for design, development, and operations of large-scale data systems operating at petabytes scale. We focus on creating pipelines, curating and aggregating huge data, distributed spark infrastructure. We interact with multiple teams across the company to provide scalable robust technical solutions.
This role will focus on Data engineering and ETL development. A majority of the transformation logic will be in Databricks. A strong understanding of creating workflow is needed. This role will assist in ETL design leveraging standard Data Warehousing techniques and functional programming techniques.
What youll do:
- Design, build, test and deploy cutting edge solutions at scale, impacting millions of customers worldwide drive value from data at Walmart Scale
- Develop high performance and scalable solutions that extract, transform, and load Spark/big data.
- Experience performing root cause analysis on data and processes to answer specific business questions and identify opportunities for improvement.
- Experience building and optimizing spark/big data data pipelines, architectures and data sets involving petabyte and terabyte of data.
- Interact with Walmart engineering teams across geographies to leverage expertise and contribute to the tech community.
- Engage with Product Management and Business to drive the agenda, set your priorities and deliver awesome product features to keep platform ahead of market scenarios.
- Closely interact with Data Engineers from within Walmart to identify right open-source tools to deliver product features by performing research, POC/Pilot.
- Engage with Product Management and Business to support and build data solutions and develop expertise w.r.t data thereby being known as the true data analyst.
- You also get to collaborate with team members to develop best practices and client requirements for the software.
- You will show your skills in analyzing and testing programs/products before formal launch to ensure flawless performance.
- Software security is of prime importance and by developing programs that monitor sharing of private information, you will be able to add tremendous credibility to your work.
- You will also be required to seek ways to improve the software and its effectiveness.
- You will be called upon to support the coaching and training of other team members to ensure all employees are confident in the use of software applications.
What youll bring:
- Bachelor s or master s degree in computer science or related technical field.
- Over all 10+ years of object-oriented programming experience in Python.
- 10+ years of experience in building of large-scale data pipelines using big data technologies (i.e., Spark / Kafka / Cassandra / Hadoop / Hive / Presto / Airflow).
- 10+ years of experience in systems design, algorithms, and distributed systems.
- Strong in Azure Data Factory with Databricks, file movement and general transformation
- Good with Azure Databricks with Database and ADLS and GCS
- Good Knowledge on PySpark, Parquet, Python Framework Development
- Good Azure DevOps and its interaction with Databricks and Data Factory
- Good understanding of on-premises big data technology.
- Good knowledge on GBQ or Azure Synapse.
- Good/Strong understanding of ETL & Data Warehousing concepts
- Strong in connecting to and ingesting from multiple source types to Azure ADLS or Google Cloud Storage
Additional Qualifications:
- Large scale distributed systems experience, including scalability and fault tolerance.
- Exposure to cloud infrastructure, such as Open Stack, Azure, GCP, or AWS
- A continuous drive to explore, improve, enhance, automate and optimize systems and tools.
- Strong computer science fundamentals in data structures and algorithms
- Exposure to information retrieval, statistics, and machine learning.
- Excellent oral and written communication skills.
- Good understanding of metadata driven development
- Excellent problem solving, Critical and Analytical thinking skills.
.
.
.
.
Minimum Qualifications...
Minimum Qualifications:Option 1: Bachelors degree in computer science, computer engineering, computer information systems, software engineering, or related area and 4 years experience in software engineering or related area.Option 2: 6 years experience in software engineering or related area.
Preferred Qualifications...
Master s degree in Computer Science, Computer Engineering, Computer Information Systems, Software Engineering, or related area and 2 years experience in software engineering or related area
Job Classification
Industry: Retail
Functional Area / Department: Engineering - Software & QA
Role Category: Software Development
Role: Data Platform Engineer
Employement Type: Full time
Contact Details:
Company: Walmart
Location(s): Bengaluru
Keyskills:
Product management
Computer science
Networking
Consulting
Machine learning
Data structures
Workflow
Open source
Distribution system
Python