Senior Data Engineer - London, United Kingdom - Jefferson Frank

Jefferson Frank

Verified Company

London, United Kingdom

3 weeks ago

Posted by:

Tom O´Connor

beBee Recruiter

Description

**What job we expect to do:We are looking for a GCP Lead Engineer to join our Data Insights and Analytics team. The role will be responsible for building new data pipelines, maintaining existing ETL pipelines, and optimizing data flows using the GCP cloud stack.

He/she must be self-directed and comfortable supporting the data needs of multiple teams, systems and products.

Skills we expect to bring:

AdvancedGCP knowledge, experience working on and migrating data products from onprem to GCP
Experienceof leading teams to deliver projects
Experiencebuilding and optimizing 'big data' data pipelines, architectures and data sets using GCP services
Experiencebuilding realtime data pipelines including unstructured datasets
Build processes supporting data transformation, data structures as well ETL, cost, space optimization
Strong experience in Data Ingestion and Storage including BigQuery, GCS, Dataflow, Datastream, Dataform, Airflow
Experience with Big data Tools: Hadoop Spark, Kafka
Experience with Stream processing systems: Sparkstreaming, Kafka
Strong problem solving, quantitative and analytical abilities
Excellent communication, collaboration and delegation

What Tools and Technologies do we expect you to know? We understand one cannot be master of all.