About the role
The Data Engineer is responsible for the design, development and support of the Data Products Cuscal creates for both internal and client facing use cases by primarily working on sourcing, transforming, securing and monitoring data for the creation of products using Cuscal's data lake and analytics systems. The data engineer will be part of a scrum team and actively engages in both discovery and delivery activities and as such will have direct interaction with our clients, specifically their product, engineering and analytics personnel. The data engineer will work in partnership with our Data Practice to deliver solutions that meet our organisational standards and best practices.
Key responsibilities
Participate in discovery workshops to understand internal and client problems
Work with the product owner to design solutions that address identified pain points
Employ Cuscal infrastructure for extraction, transformation, and loading (ETL) of data from a wide variety of data sources using 'Big Data' technologies
Create and maintain Data pipelines in an efficient manner
Maintain, troubleshoot, and improve the workflow and job scheduling of ETL processes
Assist in the design & development of analytic solutions, mostly in Databricks SQL Analytics &/or PowerBI
Manage and process complex, large data for analysis (e.g. hierarchies of datasets, inter-relationships, partitions, views, etc.)
Maintain a high level of system availability, system monitoring, fault diagnosis and change implementation and review
Work with our Data Practice to support the tracking, analysis and review of trends in commonly occurring support issues and embed identified risk management strategies
Respond to incidents and manage systems availability (change, incident and problem management)
About you
5+ years in Data Engineering, ideally in Payments
Strong knowledge in Databricks, Datalake and Data Warehousing techniques
Experience in one or more programming languages, Python preferred
Experience with Oracle and/or SQL databases and writing SQL
Knowledge and understanding of Databricks tuning and functions
Experience in Analytics; Databricks SQL Analytics &/or PowerBI preferred
Experience in scripting & Infrastructure as Code; eg: PowerShell, Terraform
Experience in the financial services or payments sector
Experience working within PCI-DSS compliant environment
Knowledge of project delivery techniques and methodologies
About us
At Cuscal, our Commercial and Business teams are the backbone of our organisation. From supporting clients and driving growth to ensuring compliance, managing finances, and fostering a positive workplace culture, our people play a vital role in achieving our commercial objectives while staying true to our values.