Azure Data Engineer for Data Management Platform – February 2022
The Data Management Platform (DMP) is a major initiative at Kroger that provides a data platform for running analytics to support different business areas across the enterprise. DMP is built entirely on Azure services and over the years it has evolved into a very stable product. Kroger is looking for a Data Engineer experienced in implementing data solutions in Azure.
The Data Engineer will analyze, design, and develop enterprise data and information architecture deliverables, focusing on data as an asset for the enterprise. The Data Engineer will also support the implementation of Infrastructure as Code (IaC) by working with teams to help engineer scalable, reliable, and resilient software running in the cloud.
High-level responsibilities of this position:
• Design, configure, and implement data migration solutions for DMP
• Work with varied data file formats (Avro, JSON, CSV) using PySpark for ingesting and transformation
• Contribute to data warehousing, data architecture, data quality processes, data warehousing design and implementation, table structure, fact and dimension tables, logical and physical database design
• Design and implement ingestion processes for unstructured and structured data sets
• Data modeling and advanced SQL techniques
• Design and develop data cleansing routines utilizing standard data operations
• Work with multi-Terabyte data sets, troubleshooting issues, performance tuning of Spark and SQL queries
• Participate in team Scrum ceremonies
• Hands-on keyboard for product deliverables
Core Technologies
• Azure Functions
• Python
• Spark
• SQL Server
• Azure Data Factory
• Azure Databricks
• Terraform
• Azure DevOps
• GitHub / GitHub Actions
• T-SQL and SQL stored procedures
• Azure Log Analytics
• Azure Data Lake Storage
• Azure Service Bus
• Azure Event Grid
• Azure Cosmos DB
Required Skills : Jira
Basic Qualification :
Additional Skills :
Background Check :Yes
Drug Screen :Yes
Notes :
Selling points for candidate :
Project Verification Info :
Exclusive to Apex :No
Face to face interview required :No
Candidate must be local :No
Candidate must be authorized to work without sponsorship ::No
Interview times set : :No
Type of project :Development/Engineering
Master Job Title :Cloud: Applications Architect
Branch Code :Cincinnati