Data Engineer - London, United Kingdom - Jefferson Frank

Jefferson Frank

Verified Company

London, United Kingdom

1 week ago

Posted by:

Tom O´Connor

beBee Recruiter

Description

Data Engineer - £85,000 - Hybrid, London Based
I am working with one of the largest telecommunication companies in Europe, turning over roughly £400 million per annum.

They are looking for Data engineers to work on greenfield projects working with big data and working on end-to-end solutions projects.

Ideal Skill set
-
DataLakes:

-
PySpark:

-
SQL:

-
Azure/AWS:

-
Python:

-
Databricks:

-
Agile

Role & Responsibilities

Collaborate with Big Data Solution Architects to design, prototype, implement, and optimize data ingestion pipelines so that data is shared effectively across various business systems.
Build ETL/ELT and Ingestion pipelines and design optimal data storage and analytics solutions using cloud and onperm technologies.
Ensure the design, code and procedural aspects of the solution are production ready, in terms of operational, security and compliance standards.
Participate in daytoday project and product delivery status meetings, and provide technical support for faster resolution of issues.

Skills and Experience

Demonstrable
design & development experience and experience with
big data technologies like
Spark/Flink and Kafka
Proficient in
Python, PySpark, or Java/Scala.

Hands-on experience with some of the following technologies:

Azure/AWS
Data Lake Projects
SQL
ETL/ELT
Databricks
Spring/Guice or any other DI framework,
RESTful Web Services.
Proficient in querying and manipulating data from various DB (relational and big data).
Experience of writing effective and maintainable unit and integration tests for ingestion pipelines.
Experience of using static analysis and code quality tools and building CI/CD pipelines.

Jefferson Frank is the Amazon Web Services (AWS) recruiter of choice. We work with organizations worldwide to find and deliver the best AWS professionals on the planet.

Backed by private equity firm TPG Growth, we have a proven track record servicing theAWS recruitment market and, to date, have worked with over 30,000 organizations globally.