Jobs
>
London

    Lead Data Engineer - London, United Kingdom - Venturi

    Venturi
    Venturi London, United Kingdom

    5 days ago

    Venturi background
    Description

    Job Description:
    Lead Data EngineerLocation: Central London (Hybrid: 2 days per week onsite.)£600-£700

    Outside Company Description:

    My Client is a leading financial organisation committed to leveraging cutting-edge technology and data-driven insights to empower stakeholders and drive innovation within the industry.

    As they continue to expand their data capabilities, they are seeking a skilled Lead Data Engineer to spearhead the development and implementation of their data platform whilst also advising and consulting on legacy data migrations from on-prem to the cloud to increase carbon neutrality.


    Role Overview:


    As a Lead Data Engineer, you will play a pivotal role in designing, building, and maintaining their data infrastructure while collaborating closely with senior stakeholders across the organisation.

    Your expertise in Azure, Databricks, Spark, Python, and data modelling will be critical in driving the success of their data initiatives.


    Key Responsibilities:


    Lead the complete development cycle of data engineering projects, maintaining anonymity from conceptualisation through deployment to ensure scalability and top-notch quality.

    Leverage internal data platforms to translate data into actionable insights, driving informed business decisions through adept application of analytical methods.

    Employ data engineering techniques to automate manual processes, tackling complex business challenges and enhancing efficiency.

    Enforce adherence to digital principles, ensuring the integrity, security, and compliance of solutions while meeting both functional and non-functional requirements.

    Embed observability into solutions, monitoring production performance, resolving incidents, and addressing underlying risks and issues.
    Advocate for client requirements while maintaining discretion and confidentiality.
    Standardise best practices and methodologies, sharing knowledge with engineers in an undisclosed manner.

    Influence the Data and Distribution architecture and technology stack within cloud-based infrastructure, serving as a hands-on lead in the realm of big data and data lakes.

    Encourage a culture of continual learning and innovation, fostering a mindset focused on improvement, automation, and accelerated time to market without leaving traces of identity.


    Required Skills and Qualifications:
    Demonstrated expertise in architecting systems for real-time transaction processing alongside ETL applications, with a focus on discretion.
    A comprehensive of data modelling, data warehousing principles, and the innovative Lakehouse architecture.

    Exceptional proficiency in ETL methodologies, preferably utilising Azure Databricks or equivalent technologies (Spark, Spark SQL, Python, SQL), including deep insight into ETL/ELT design patterns.

    Proficient in Databricks, SQL, and Python, with a robust understanding of software development life cycles.
    Familiarity with columnar and/or time series data design patterns, as well as performance optimisation techniques.
    Sound understanding of Infrastructure as Code and scripting languages.
    Awareness of Information Security principles to ensure the secure handling and governance of data.
    Effective communication of intricate solutions in a clear manner.
    Strong analytical and problem-solving skills.
    Thorough understanding of Information Security principles for ensuring compliant data management.

    Hands-on experience with Agile methodologies (SCRUM, Kanban).Proven track record as a collaborative team player with exceptional leadership qualities, capable of working across business units, teams, and geographical regions.

  • Understanding Recruitment

    Data Engineer

    1 day ago

    Understanding Recruitment London, United Kingdom

    **Data Engineer** · A brand new and exciting opportunity has recently arisen for a Data Engineer with an extensive knowledge in designing, developing and managing ETL processes and writing SQL code to join the UK's Largest Government department based remote. As the Data Engineery ...

  • ITECCO

    Data Engineer

    8 hours ago

    ITECCO London, United Kingdom

    Data Engineer - Education Industry - London - £65,000 · I am looking for an experienced **Data Engineer** to join a **renowned Education organisation** based in **London**. This is an excellent opportunity for someone to join a large team and drive significant change in data infr ...

  • eFinancialCareers

    Data Engineer

    1 day ago

    eFinancialCareers London, United Kingdom

    Join us as a Data Engineer · - This is an exciting opportunity to use your technical expertise to collaborate with colleagues and build effortless, digital first customer experiences · - You'll be simplifying the bank through developing innovative data driven solutions, inspiring ...

  • eFinancialCareers

    Data Engineer

    1 day ago

    eFinancialCareers London, United Kingdom

    **Summary**: · A globally leading, systematic, quant trading firm are looking for a Data Engineer to join their technical team in London. · The successful Data Engineer will be utilising both analytical and technical skillsets, building data pipelines in the Python and PyData sta ...

  • eFinancialCareers

    Data Engineer

    1 day ago

    eFinancialCareers London, United Kingdom

    An exciting Data Engineering opportunity has become available within a multinational oil and gas company. The end client has a requirement for multiple engineering positions, to be part of a cross-disciplinary team working closely with other Data Engineers,Software Engineers, Dat ...

  • Nigel Frank International

    Data Engineer

    1 day ago

    Nigel Frank International London, United Kingdom

    **Data Engineer - London - £65k** · Currently, I am working closely with a leading transport service organisation. Their purpose is to provide passenger transport services across the United Kingdom, and they have been doing this successfully for decades. · Whilst they offer up a ...

  • Harnham

    Data Engineer

    1 day ago

    Harnham London, United Kingdom

    **Data Engineer** · **London - Hybrid - Remote** · **£65,000** · Do you want to own the migration to a cloud platform? Are you looking to modernize a market-leading company to properly utilize its data and analytics? If so, this could be the role for you. · This insurance broker ...

  • ITECCO

    Data Engineer

    8 hours ago

    ITECCO London, United Kingdom

    **Job Title**: Data Engineer · **Location**: London · **Salary**: £45,000 plus pension and quarterly bonus · My client is currently recruiting for an experienced **Data Engineer** to join a leading **hospitality** company in the**City of London** on a full-time basis. · Extensive ...

  • eFinancialCareers

    Data Engineer

    1 day ago

    eFinancialCareers London, United Kingdom

    **Summary**: · A sponsor of London's PyData and ML meetups is looking to hire a Python / Data Engineer to join their core team in London. The successful Data Engineer will be building ETL data pipelines in Python and Kafka on Linux platforms, and will be working with a widerange ...

  • Jefferson Frank

    Data Engineer

    1 day ago

    Jefferson Frank London, United Kingdom

    **About the job** · With the world's leading organisations looking to cloud solutions to innovate, disrupt and deliver growth, we help reimagine and reinvent entire businesses on the cloud. Through rapid prototyping and multi-cloud architecture, we've rebuilt telecom companies,tr ...

  • Data Idols

    Data Engineer

    1 day ago

    Data Idols London, United Kingdom

    **Data Engineer** Data Idols are excited to be working with one of the top 100 companies in the world to recruit a Data Engineer A company which owns multiple brands and who are investing heavily into 'all things data' to revolutionise their extraordinary team. · **Skills and Exp ...

  • Nigel Frank International

    Data Engineer

    1 day ago

    Nigel Frank International London, United Kingdom

    **Data Engineer - London - £65k DoE** · I am currently working with a market-leading organisation who are looking to for a Data Engineer to join their team and help them in their goal of enhancing the way data is used in their specialist industry. In this role you will use data f ...

  • Method Resourcing

    Data Engineer

    1 day ago

    Method Resourcing London, United Kingdom

    **Data Engineer | Python | SQL | GCP | BigQuery | Data Studio | ETL | DBT | Stitch | Fivetran | Singer | £40,000-£50,00** · Method Resourcing are currently working with a Media Publication company that report on the world of data and provide publications to over 300,000 data prof ...

  • eFinancialCareers

    Data Engineer

    1 day ago

    eFinancialCareers London, United Kingdom

    **Summary**: · A market-leading quant trading hedge fund are looking for a data engineer to join their London-based operations team, building data and trading pipelines from scratch. The successful data engineer will be developing Extract, Transform, Load (ETL) pipelinesin Python ...

  • Sanderson

    Data Engineer

    1 day ago

    Sanderson London, United Kingdom

    **Role**: Data Engineer · **Salary**: £80k · **Location**: City of London · **Hybrid working**:3 days a week in the office · One of the UK's leading insurance companies is looking for a Data Engineer to join their team this is a fantastic opportunity for somebody that is looking ...

  • Plexus

    Data Engineer

    8 hours ago

    Plexus London, United Kingdom

    Plexus have partnered with a decentralised credit and lending platform who are at the forefront of credit and lending infrastructure in the web3 space. They have an established product, strong team and great backing. · They're looking for a Data Engineer to help make their platfo ...

  • Harnham

    Data Engineer

    1 day ago

    Harnham London, United Kingdom

    **DATA ENGINEER** · **LONDON BASED** · **£75,000-85,000 PER ANNUM** · This large-scale UK retailer are hiring for a new Data Engineer. Your primary focus will be to build and expand the company's data pipelines. The company uses Serverless AWS technology and prides itself on usin ...

  • Salt Search

    Data Engineer

    1 day ago

    Salt Search London, United Kingdom

    **Data Engineer | £400-£425/day| 6 Months | OUTSIDE IR35 | Hybrid/London | AWS | JSON | Python | Github** · One of my key clients is looking for a Data Engineer to join the team at a very exciting time. Working closely with the 1st line of defence to ensure that the firm's collec ...

  • Anson McCade Ltd - IT and Finance Recruitment

    Data Engineer

    1 day ago

    Anson McCade Ltd - IT and Finance Recruitment London, United Kingdom

    *MUST be able/willing to go through SC Clearance* · I am working with a mid-sized consultancy who are on the hunt for a Data Engineer to join their growing engineering function in London. This is an exciting opportunity for a Data Engineer with extensive experience working with c ...

  • eFinancialCareers

    Data Engineer

    1 day ago

    eFinancialCareers London, United Kingdom

    **Permanent Role** · **London Based (Hybrid)** · **No Sponsorship** · **Role** · - Test/evaluate new alternative datasets in collaboration with quant researchers and data teams · - Once identified with machine learning and statistical methods, automate the extraction of predictiv ...