Senior Data Engineer - London, United Kingdom - Fintop Consulting Limited

Fintop Consulting Limited

Verified Company

London, United Kingdom

2 weeks ago

Posted by:

Tom O´Connor

beBee Recruiter

Description

About the company:

The Company is a leading name in the Real Estate industry. They are looking for a Senior Data Scientist. You will be responsible for planning and building scalable and repeatable data transformation workflows.

You must write effective code that automatesdata intake, data cleaning, and the changes required to achieve the desired data format.

You must comprehend the requirements for the source and destination data and utilise this information to create data integration solutions in order to complete the required migrations.

Roles & Responsibilities:

Your primary role involves utilizing a variety of technologies and data sources, comprehend, create, and design ETL and data integration solutions
You are required to analyze and arrange unstructured data and combine unprocessed data from several sources.
You'll be responsible to improve the accuracy and dependability of data
You oversee identifying, creating, and putting into practice internal process changes, such as automating manual procedures and improving data delivery.
Use cloudbased infrastructure to host apps and data solutions.
Your role also involves working together with data scientists, analysts, and architects to achieve business objectives.

Expectations & Requirements:

Should possess 5 years of experience as a Data Engineer
Quite an acquaintance in the creation and upkeep of ETL/ELT procedures within a medallion architecture
Must be skilled in SQL and relational databases
Solid understanding of the Azure Data Factory, Azure Synapse, and Azure Data Lake architecture
Proficient verbal and written communication abilities
Should have the ability to analyse both organised and unstructured information
Have great expertise with Azure DevOps experience and knowledge of CI/CD
Prior knowledge of Apache Spark, including scripting using Py

Spark Additional Benefits:
(only if required)