Senior Data Engineer - Basingstoke, United Kingdom - Reassured Limited

Reassured Limited

Verified Company

Basingstoke, United Kingdom

2 weeks ago

Posted by:

Tom O´Connor

beBee Recruiter

Description

Company Description
Senior Data Engineer

Basingstoke

Reassured Ltd is the largest non-advised life insurance intermediary in the UK with established locations in Basingstoke, Portsmouth, Southampton, Manchester, Bristol, Bournemouth and Chester.

We launched our new Advised business offering in 2021 and continue to grow our sales and support teams across the entire business this year.

We arrange over 15,000 new customer life insurance policies per month with leading sales conversions and customersatisfaction metrics. The business is outbound, B2C sales from internet generated customer enquiries.

As a Senior Data Engineer you will be the lead in the team and your role will be to metamorphose the raw data into something viable and readable before its presentation to the stakeholders.

You will also be required to design, build, test, blend, manage,and optimise the data using all resources available to you.

Key Responsibilities

Designing and implementing performant data ingestion pipelines from multiple sources using Apache Spark (ideally in Azure Databricks)
Delivering and presenting proofs of concept of key technology components to the wider data team and project stakeholders.
Integrating the endtoend data pipelines to take data from source systems to target data repositories ensuring the quality and consistency of data is always maintained
Working with event based / streaming technologies to ingest and process data
Working with other members of the data team and wider business to support delivery of additional project components (API interfaces, Data Models, Data Sharing, ML Endpoints)
Working within an Agile delivery / DevOps methodology to incremental change to the overall data platform to deliver additional data products to provide value to stakeholders.

Qualifications
Knowledge

Excellent level of proficiency in writing SQL
Strong SQL and Python experience.
Strong knowledge of Data Management principles in a Lakehouse Architecture.
Hands on experience designing and delivering solutions using Azure services including Azure Data Factory, Azure Databricks, Azure Synapse, Azure Storage, Azure DevOps.
Experience managing data solutions deployments using Azure DevOps (CI/CD)
Experience with Terraform and Ansible
Experience working with BI Developers to collaborate on the design of data models (Star Schema) for use in Power BI
Experience working with Data Scientists to productionise ML pipelines into the overall data platform solution
Microsoft Azure Data Engineer certifications

Desirable Experience

Experience implementing realtime pipelines to power realtime dashboards
Experience with CDC (Change Data Capture) tools (Arcion, Qlik Replicate, Matillion)
Experience with opensource tools such as Apache Kafka
Experience working with unstructured data including voice data
Working in a heavily regulated industry (Finance, Insurance)

Key Competencies

A logical, analytical and creative approach to problems.
Passion and ability for learning new skills and technologies.
Good communication skills.
A meticulous and organised approach to work, with a thorough attention to detail.
Business and commercial awareness.
The ability to work autonomously whilst working in a team environment.
An awareness of current issues affecting the industry and its technologies

Qualifications:

Educated at graduate level preferred but not essential
A minimum of 5 years experience
Previous experience in the creation of data platforms in a commercial environment.

Additional Information

Benefits:

We offer an excellent range of benefits, and some are accessed upon completion of probation.

Crucially we believe in developing your career and clearly lay out the path for you to be successful and progress.