Data Engineer - London, United Kingdom - Advantage Resourcing
Description
Job Title:
Data Engineer
Length: 12 Months
Location:
London Waterloo ( Hybrid working )
Advantage Resourcing are recruiting for a Data Engineer on behalf of a globally renowned energies business.
Key accountabilities
- Understands the business vision from the data solutions and works with all project stakeholders to enable that.
- Works alongside multiple other project team members to drive towards the common goal.
- Helps the business analysts to create data mapping documents that define the endtoend pipeline.
- Builds and delivers data pipelines that ingests data (structured and unstructured) from multiple sources into the target data lake.
- Builds the data management layer in line with the business needs and standards defines.
Key Skills Required:
- Python 3 (pandas, pytest, virtualenv etc)
- Basic understanding of ETLs
- Aure Data Factory
- Azure Containers (Blob, Queue etc)
- Azure Datalake
- Azure Functions
- MS SQL Database
- Intermediate to advanced SQL skills
- Data Modelling
- CI/CD pipelines (github actions, azure devops, jenkins, drone terraform etc)
- Exposure to AI and ML models
More jobs from Advantage Resourcing
-
Production Test Engineer
Bolton, Greater Manchester, United Kingdom - 1 week ago
-
Engineer - Analysis
Bolton, Greater Manchester, United Kingdom - 1 week ago
-
PCB Layout Engineer
Stevenage, Hertfordshire, United Kingdom - 1 week ago
-
Quality Engineer
Bolton, Greater Manchester, United Kingdom - 1 week ago
-
Performance Quality Engineer
Bolton, Greater Manchester, United Kingdom - 1 week ago
-
Accounts Payable Processor
Darlington, County Durham, United Kingdom - 1 week ago