Data Engineer - London, United Kingdom - Advantage Resourcing

Tom O´Connor

Posted by:

Tom O´Connor

beBee Recruiter


Description

Job Title:
Data Engineer


Length: 12 Months

Location:
London Waterloo ( Hybrid working )

Advantage Resourcing are recruiting for a Data Engineer on behalf of a globally renowned energies business.


Key accountabilities

  • Understands the business vision from the data solutions and works with all project stakeholders to enable that.
  • Works alongside multiple other project team members to drive towards the common goal.
  • Helps the business analysts to create data mapping documents that define the endtoend pipeline.
  • Builds and delivers data pipelines that ingests data (structured and unstructured) from multiple sources into the target data lake.
  • Builds the data management layer in line with the business needs and standards defines.

Key Skills Required:


  • Python 3 (pandas, pytest, virtualenv etc)
  • Basic understanding of ETLs
  • Aure Data Factory
  • Azure Containers (Blob, Queue etc)
  • Azure Datalake
  • Azure Functions
  • MS SQL Database
  • Intermediate to advanced SQL skills
  • Data Modelling
  • CI/CD pipelines (github actions, azure devops, jenkins, drone terraform etc)
  • Exposure to AI and ML models

More jobs from Advantage Resourcing