Data Engineer - London, United Kingdom - Experis LTD

Experis LTD

Verified Company

London, United Kingdom

2 weeks ago

Posted by:

Tom O´Connor

beBee Recruiter

Description

Role:
Data Engineer

Duration:6th months initially(Extension Expected)

Location:
London (2 TO 4 Days a month need to go onsite)

Rate:
£550 per day inside IR35

RESPONSIBILITIES:

Create and maintain optimal data pipeline architecture
Assemble large, complex data sets that meet functional/nonfunctional business requirements
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, redesigning infrastructure for greater scalability, etc.
Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using noSQL, APIs and 'big data' cloud technologies.
Build analytics tools and datasets that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
Work with stakeholders including regional IT and BI teams, other Digital Product platforms and Data & AI teams to build effective integrations and support datarelated technical issues.
Keep our data separated and secure across regional, business line and client boundaries where required.
Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
Work with data and analytics experts to strive for greater functionality in our data systems.

EXPERIENCE AND COMPETENCY REQUIREMENTS:

5+ years' experience as Data Engineer or general developer role with similar experience
Proven experience in developing data pipelines and adhoc data extraction
Excellent command of SQL and PySpark
Strong experience developing on cloud architecture, Azure preferred
Familiarity with databases (e.g. SQL Server, Postgres, MongoDB.

Preferrable SQL server) and REST APIs and UI/UX design:
(Optional)

Demonstrable experience working in a multistage deployment, automated testing, CI/CD, and infrastructure as code environments
Cultural awareness and appreciation for diversity
Excellent communication, organisational, and teamwork skills
Fluent in English is a must

Technology:
ADF, Azure Data Bricks with PySpark & SQL

Secondary (
Good to have): Experience to integrate API based sources using ADB

Database:
SQL Server or Postgres or MongoDB (Preferable SQL Server)

Optional:
Knowledge UI/UX Design and Azure DevOps