Senior Data Engineer - London, United Kingdom - Opus Recruitment Solutions Ltd

Opus Recruitment Solutions Ltd

Verified Company

London, United Kingdom

3 weeks ago

Posted by:

Tom O´Connor

beBee Recruiter

Senior Data Engineer

Energy

Hybrid - 1 day a week on site

Permanent

£70,000 - £90, % Bonus + Package

My client are one of the fastest growing Energy companies in the UK and they are currently on the hunt for a Senior Data Engineer.

They are looking for someone who enjoys building data pipelines and the engineering that goes along with them.

They are buildinga data analytics platform in GCP (Google Cloud Platform) that will accelerate their disruption of the energy sector.

Your Role:

As a Senior Data Engineer you will be responsible for building the ETL data pipelines
Technical ownership, develop and support the Data Pipelines and related engineering practices within GCP
Any cloud experience but ideally in GCP
Proven, handson experience in Data Engineering role
A good mentor to other team members for standards, problem solving and best practices
Demonstrate experience building both realtime and batch data pipelines to match the evolving needs of the business
Provide technical support to other teams within the organisation as required
Code elegant strategic solutions that are reusable and maintainable (Python)
Strong experience writing complex SQL and writing good quality python code

Tech Skills:

Build, test and deploy Data pipelines on Google Cloud Platform
Implement pipelines using Google's Dataflow, GCS, cloud functions, BigQuery, Dataproc, Apache Beam (Python), Composer (Airflow)
Deduplicate, transform and conform as appropriate from source to target structures
Build and support both batch and realtime pipelines
Implement solutions to improve our observability, findability, data privacy and other data governance and architectural concerns
Detailed physical design of data storage solutions
Logical and physical data modelling
Implement data transformation rules for batch and data streaming in SQL and Python
Implement CI / CD from Github to GCP

If you would like to find out more please send the latest copy of your CV to and I will be in contact to discuss the next steps.

Remote PHP