BP is building new data pipelines from scratch to inherit data in an existing 3rd party platform over to a new home-grown product they have created, and will be working heavily in Scala Coding, Hadoop/Hive, Spark, and Azure Data Factory (AWS experience OK)

The interview process would be 1- 30 Minutes Coding Interview (hackerrank.com style of problem), 2- 30 Minute Engineering Manager interview.

This role would be remote working in CST time zone, and I can begin arranging interviews immediately.

BP Inc

Data Engineer

Innovation & Engineering – Digital Customers, Market, Intelligent Ops

Role:

In short – We are mainly seeking a skilled Senior Data Engineer, good hands-on skill with Scala, Spark, Hadoop/Hive, and Databricks. We work mainly in Azure cloud (ADF, AzureDevops etc.), but if the person has worked in AWS or others, that is suitable as well.

Skills/Responsibilities :

• Extensive hand on experience working on Scala Coding, Spark and PySpark programming

• Experience in Hadoop/Hive big data systems

• Analyze data from multiple sources and create integrated views that can be used in reporting/analytics.

• Worked on Data Parsing, Data wrangling, Cleansing & Transformation, and sanitizing.

• Worked on Regular expressions.

• Troubleshoot and resolve complex customer issues by handling/curating them at DataBricks (pyspark or sql) and other product areas.

• Good to have SQL coding (T-SQL and other ANSI-compliant SQL) experience with performance optimization experience for data queries.

• Good to have experience on Databricks

• Good to have experience on Azure ADF (AWS is comparable)

Required Skills : Scala Coding Hadoop & Hive Azure or AWS Data Services (client works in Azure ADF) Spark Databricks (a plus)
Basic Qualification : 3+ years experience with Computer Science Degree Scala Coding Hadoop/Hive Object Oriented Programming Skills (not a database developer, software developer)
Additional Skills : 3+ years experience with Computer Science Degree Scala Coding Hadoop/Hive Object Oriented Programming Skills (not a database developer, software developer)Multi-year projects via Apex Systems Consulting Services
Background Check :Yes
Notes :30 Min Video Interview w/ Manager, 30-Min Tech Interview (Coding) w/ Lead
Selling points for candidate :Multi-year projects via Apex Systems Consulting Services
Project Verification Info :Apex Letter, PO
Exclusive to Apex :Yes
Face to face interview required :No
Candidate must be local :No
Candidate must be authorized to work without sponsorship ::No
Interview times set :Yes
Type of project :Integration
Master Job Title :Big Data: Dev
Branch Code :Chicago