data ingestion expert - Old Warren - beBeeDataAcquisition

Job title: Data Acquisition Lead

Description

Data Acquisition Manager sought to oversee data ingestion and integration processes.

You will lead a team of data engineers and business analysts in managing the end-to-end acquisition process, ensuring high-quality and reliable pipelines that power analytics across the organisation.

Main Responsibilities:

• Lead and mentor a team of data engineers and business analysts.


• Owning data ingestion pipelines from source systems into the Azure-based enterprise platform.


• Designing and implementing ETL/ELT processes using Azure Data Factory, Databricks, PySpark tools.


• Collaborating with architects and scientists to prioritise required datasets.

'Azure full-stack experience' including ADLS Gen2 permissions structure lifecycle. 'PySpark skills: writing scalable transformations optimising Spark jobs working with Delta Lake', SQL Python knowledge 'Experience with warehousing modelling.' Stakeholder engagement communication expertise desirable utility sector understanding
P

Become part of our dynamic team helping customers communities people planet thrive engage enjoy career opportunities flexible arrangements excellent benefits support sustainable successful career making daily difference protecting world water future generations.',