Senior Data Engineer - Reading, United Kingdom - Thames Water

Thames Water

Verified Company

Reading, United Kingdom

2 weeks ago

Posted by:

Tom O´Connor

beBee Recruiter

Description

Who are we?
Thames Water is the UK's largest water and wastewater company.

We make a daily difference to our 15 million customers by supplying 2.6 billion litres of water through 32,000 km of pipes_,_ keeping taps flowing and toilets flushing.

?
At Thames Water, every one of our actions, big and small, matters every day. Water is essential to life, so our business is always open.

What you'll be doing

Our Data Engineers work alongside data scientists, software engineers, delivery leads and other disciplines; to complete data acquisition requests and evolve our leading edge platforms and development environments.

You would be working on stimulating technicalchallenges in support of our continued progress towards a data-driven business.

As an advocate of Data Engineering across departments and teams, you will bring awareness of data engineering and platform opportunities and capabilities to those we work with, as we work together to roll out our hub-and-spoke model for data.

As a Data Engineer, your responsibilities will include:

Working with Azure, Data Factory V2, Delta Lake Warehouse and Databricks, and building pipelines ingesting data from source systems to our data lake.
Development and operation of our data platform and environments using Agile DevOps CI/CD methods.
Analyse, design, plan, execute and evaluate data requirements to support business activities, innovation, and projects.
Working closely with data architects (to determine what data management systems are appropriate) and data scientists (to determine which data are needed for analysis).
Tackling problems associated with database integration and unstructured data sets.
Support for users of our data platform, including advising on best practice.
Integrate into the data platform teams Agile ceremonies, including backlog refinement, sprint planning, estimation, stories, demonstrations and retrospectives and collaborating into process improvements etc.
Application of strong source code control, GitHub / DevOps Repos, push/pull, merge, branching etc.

To be successful you will have the following skills and experience:

Self-driven, comfortable with fast-paced environments, passionate about process and technology and driving positive impact for our business and customer.
Articulate with excellent communication skills with experience of engaging with stakeholders. A credible positive attitude with a focus on quality and detail. Keen to learn and able to adapt to new technology and keep abreast of current industry trendsand practise. Good organisation and time management skills.
5 years' experience in data engineering
Excellent interpersonal skills and is experienced at dealing with stakeholders. Proficient and effective communicator.
Competent/advanced programmer in Python, in particular PySpark.
Understanding of database architectures, warehousing, delta / data lake solutions and medallion approaches
Good knowledge and experience of the Azure platform and Databricks.
DevOps approach to software; create high quality code using traditional software practices, such as building, linting, unit and integration testing, source control, CI/CD, peer reviews, etc.
Document datasets in data catalogue, including ownership, stewardship, dictionaries, glossaries, lineage, sensitivity, etc in Wiki
Work with data owners / stewards to ensure conformance of data with legislation GDPR,data retention, etc.

What's in it for you?
Our competitive salary and package includes an excellent contributory pension and 26 days holiday.

There is also a wider benefits scheme which includes an annual pay review, season ticket loans and loyalty awards for continuous service plus discounts at a widerange of retailers via Benefits on Taps.

We're proud to be here for our local community, offering all of our teams two days paid volunteer leave a year, as well as proudly supporting a lot of local events and charities.

About Us
Thames Water is the UK's largest water and wastewater company.

We make a daily difference to millions of customers by suppling 2.7 billion litres of world-class water to around 10 million homes.

Together, we're building a better future for our customers, our region and our planet.
Thames Water is a unique, rewarding and diverse place to work.

We're also proud to be an equal opportunity employer, Stonewall Diversity Champion and Disability Confident Leader, welcoming individuals from all walks of life and leading the way with an award-winningmental health and wellbeing strategy.

For more information please visit our website.