Lead Data Engineer - Camden Area, United Kingdom - Venturi

Venturi Camden Area, United Kingdom

3 days ago

Accounting / Finance

Description

Job Description:
Lead Data Engineer

Location:
Central London (Hybrid: 2 days per week onsite.)
£600-£700 Outside

Company Description:

My Client is a leading financial organisation committed to leveraging cutting-edge technology and data-driven insights to empower stakeholders and drive innovation within the industry.

As they continue to expand their data capabilities, they are seeking a skilled Lead Data Engineer to spearhead the development and implementation of their data platform whilst also advising and consulting on legacy data migrations from on-prem to the cloud to increase carbon neutrality.

Role Overview:

As a Lead Data Engineer, you will play a pivotal role in designing, building, and maintaining their data infrastructure while collaborating closely with senior stakeholders across the organisation.

Your expertise in Azure, Databricks, Spark, Python, and data modelling will be critical in driving the success of their data initiatives.

Key Responsibilities:

Lead the complete development cycle of data engineering projects, maintaining anonymity from conceptualisation through deployment to ensure scalability and top-notch quality.

Leverage internal data platforms to translate data into actionable insights, driving informed business decisions through adept application of analytical methods.

Employ data engineering techniques to automate manual processes, tackling complex business challenges and enhancing efficiency.

Enforce adherence to digital principles, ensuring the integrity, security, and compliance of solutions while meeting both functional and non-functional requirements.

Embed observability into solutions, monitoring production performance, resolving incidents, and addressing underlying risks and issues.
Advocate for client requirements while maintaining discretion and confidentiality.
Standardise best practices and methodologies, sharing knowledge with engineers in an undisclosed manner.

Influence the Data and Distribution architecture and technology stack within cloud-based infrastructure, serving as a hands-on lead in the realm of big data and data lakes.

Encourage a culture of continual learning and innovation, fostering a mindset focused on improvement, automation, and accelerated time to market without leaving traces of identity.

Required Skills and Qualifications:
Demonstrated expertise in architecting systems for real-time transaction processing alongside ETL applications, with a focus on discretion.
A comprehensive of data modelling, data warehousing principles, and the innovative Lakehouse architecture.

Exceptional proficiency in ETL methodologies, preferably utilising Azure Databricks or equivalent technologies (Spark, Spark SQL, Python, SQL), including deep insight into ETL/ELT design patterns.

Proficient in Databricks, SQL, and Python, with a robust understanding of software development life cycles.
Familiarity with columnar and/or time series data design patterns, as well as performance optimisation techniques.
Sound understanding of Infrastructure as Code and scripting languages.
Awareness of Information Security principles to ensure the secure handling and governance of data.
Effective communication of intricate solutions in a clear manner.
Strong analytical and problem-solving skills.
Thorough understanding of Information Security principles for ensuring compliant data management.
Hands-on experience with Agile methodologies (SCRUM, Kanban).

Proven track record as a collaborative team player with exceptional leadership qualities, capable of working across business units, teams, and geographical regions.

Data Engineer

1 week ago

SRG Network London Area, United Kingdom

Data Engineer | Blockchain | London | Hybrid · Data Engineer with a keen focus on blockchain and distributed ledger technology required for a not-for-profit organisation focused on developing the blockchain ecosystem. · The Data Engineer will be pivotal in managing, curating, o ...
Data Engineer

3 days ago

Bolton Associates Camden Area, United Kingdom

We are working on behalf of an International (Re)Insurance client based in London to recruit a Lead/Senior Data Engineer, joining an established team of Analytics Engineers helping optimise the Actuarial teams' efficiency through data automation and the use of emerging technologi ...
Data Engineer

3 days ago

Venture Up Camden Area, United Kingdom

Data Software Engineer– London · Sports Analytics & Statistics Company · Fulltime onsite · *Please note this role cannot sponsor. Please do not apply if you are seeking sponsorship* · A Data Engineer is required for an exciting and innovative Software sports betting company based ...
Data Engineer

3 days ago

Gloo Camden Area, United Kingdom

Data Engineer · £80,000-£95,000 · London, Hybrid · Permanent · I am seeking an experienced Data Engineer who is passionate about designing, optimising, and maintaining AI-native data processing pipelines. Your role will involve tackling complex challenges with robust data pipelin ...
Data Engineer

3 days ago

Axtria - Ingenious Insights Camden Area, United Kingdom

Introduction · Axtria is a global provider of cloud software and data analytics to the Life Sciences industry. We help Life Sciences companies transform the product commercialization journey to drive sales growth and improve healthcare outcomes for patients. We are acutely aware ...
Data Engineer

3 days ago

Eames Consulting Camden Area, United Kingdom

Eames Consulting are delighted to be supporting an established Investment management company that are looking for a Data engineer. · Responsibilities: · Develop and maintain complex SQL queries, customize reports, and optimize data usage. · Create tools to address business challe ...
Data Engineer

3 days ago

Roc Search Camden Area, United Kingdom

Job Title: Data Engineer · Job Type: Permanent · Location: London or Fully remote · Salary: £50,000-£70,000 (Dependant on experience) + Bonus + Benefits · Skills: Python, SQL, Posgress SQL, Snowflake, Powershell · Roc Search`s client provides real-time decisions and active risk m ...
Data Engineer

3 days ago

Gravitas Recruitment Group (Global) Ltd Camden Area, United Kingdom

Data Engineer | Integration | SSIS | SSRS | Azure Logic Apps | Azure API management | DevOps | Azure Data Factory | SQL | Oracle Database | Systems Integration | Integration Architecture · We are thrilled to be partnering with a university who is in the market for a Data Engineer ...
Data Engineer

3 days ago

Harrington Starr Camden Area, United Kingdom

Data Engineer · London · £85,000 · Harrington Starr is currently working with a leading AI-based SAAS business that is looking to hire multiple Data Engineers to help them further grow their already exciting business. · Within this role, you will be responsible for Maintaining, s ...
Data Engineer

2 weeks ago

Tech Kinect London Area, United Kingdom Freelance

Job Description: Data Engineer Contractor · Position Summary: · We are seeking a skilled and experienced Data Engineer Contractor to join our team on a contractual basis. As a Data Engineer Contractor, you will be responsible for designing, developing, and maintaining data pipeli ...
Data Engineer

3 days ago

Scalexperts Camden Area, United Kingdom

Data Engineer - Databricks - £70-75,000 - London/Hybrid · Scalexperts are partnered with an education business who after making a few recent senior leadership hires in Data & Technology are now scaling their Data Engineering function. · They are looking for a Data Engineer to joi ...
Data Engineer

3 days ago

83DATA Camden Area, United Kingdom

Data Engineer/Scientist · London (Hybrid) · £50,000-£60,000 (+bens) · 83DATA are partnered with a leading Internet provider seeking the skills of a Data Engineer/Scientist. The successful candidate can expect to be tasked to connect data sources to pre-existing Azure data infrast ...
Data Engineer

3 days ago

Stanbrook Consulting Camden Area, United Kingdom

Role Responsibilities: We are seeking an experienced data engineer to join the Surveillance IT team. The successful candidate will be responsible for developing data ingestion pipelines and frameworks that support trade surveillance analysts in their strategic decision-making. · ...
Data Engineer

3 days ago

Aurum Search Limited Camden Area, United Kingdom

Our client, a leading energy-focused trading house are seeking a commodity pricing focused developer/data engineer for their European Cross Commodities portfolio in London. · The role will be focused on using pricing data for the commercial trading teams, and playing a key role b ...
Data Engineer

3 days ago

Travelex Camden Area, United Kingdom

Job Title: Data Engineer · Job Type: Full Time, Permanent · Working location: London, Hybrid · Role Purpose · At Travelex we are developing modern data services, which will be at the heart of our relationship with our customers. Our data architecture is becoming more service-orie ...
Data Engineer

3 days ago

Selby Jennings Camden Area, United Kingdom

I am working with a venture-backed research-driven crypto technology company that specialise in building trading and MEV-related infrastructure and services, based in London. They are looking to add a data engineer to their tech function. Background in or strong understanding of ...
Data Engineer

3 days ago

Morgan McKinley Camden Area, United Kingdom

Duration - 12 months · We are seeking a Data Engineer who will be responsible for processing and managing our high-quality multimedia datasets for use by our researchers and engineers. The ideal candidate will have a strong background in data engineering, experience in data proce ...
Data Engineer

2 weeks ago

Durlston Partners London Area, United Kingdom

Data Engineer - Macro Hedge Fund - London - Up to £150k + Bonus · Note: I have a plethora of live Data Engineering opportunities. Therefore, even if you don't feel your profile is relevant for the role mentioned below, we encourage you to apply anyway to discuss one of the other ...
Data Engineer

3 days ago

Harrington Starr Camden Area, United Kingdom

Data Engineer Opportunity – AI for Finance Leader in London - £75,000-£85,000 · Harrington Starr are currently partnered with an AI/Data leader within the Financial Services space in London. Their ground-breaking software is helping investors to achieve superhuman performance. · ...
Data Engineer

3 days ago

Better Days Recruitment Camden Area, United Kingdom Permanent, Full time

My client is a not-for-profit organisation focused on developing the blockchain/DLT ecosystem. · Due to ongoing growth they are now looking for an experienced Data Engineer to join their team. · This role is pivotal in managing, curating, optimising, and securing datasets specifi ...