Jobs
>
London

    Senior Data Engineer - United Kingdom - Primus Connect

    Primus Connect
    Primus Connect United Kingdom

    5 days ago

    Default job background
    Description


    Senior Data Engineer (Databricks, Spark, Python)Remote (UK based)- 6 months rolling£550 - £650 per dayOutside IR35A Senior Data Engineer with broad knowledge of Databricks is needed to join a leading consultancy renowned for its innovative approach and expertise in delivering state-of-the-art data solutions.

    As a proud Databricks Partner, our client is at the forefront of driving transformation and excellence in data strategies for businesses across various sectors.

    This contract role is an exceptional opportunity for a Senior data engineering professional looking to make a substantial impact while enjoying the flexibility of a fully remote, outside IR35 contract.

    As the Senior Data Engineer, you will play a pivotal role in designing and implementing cutting-edge data solutions utilising Databricks technologies.


    Key Responsibilities:
    Architect and execute efficient data solutions leveraging Azure Data Factory, Synapse, Databricks, and Azure DevOps.
    Develop, maintain, and optimise data models and ETL pipelines for premier data processing efficiency.
    Design and implement processes to ingest data from various sources into Databricks.
    Use Databricks to integrate, consolidate, and cleanse data to ensure it is accurate and ready for analysis.
    Develop, test, and maintain robust, scalable data pipelines using Databricks.
    Utilise Databricks' support for languages like Python, Scala, SQL, and R to process and transform data.
    Design and implement data models that effectively represent business processes and requirements.

    Optimise data storage in Databricks for efficient querying and analysis, leveraging Delta Lake for ACID transactions and versioned data management.

    Translate complex business requirements into technical specifications in collaboration with various teams.
    Implement and maintain data governance policies and practices, ensuring data quality and consistency.
    Manage data access and security within Databricks, aligning with organizational policies and compliance requirements.
    Engage with clients to support architectural designs and solve technical queries.
    Remain abreast of the latest developments and Databricks technologies, ensuring best practices in data governance and security compliance.


    Essential Skills and Qualifications:


    A minimum 5 years' experience in data engineeringMinimum 2-3 projects delivered with hands-on experience in DatabricksExpertise in data modeling, ETL development, and data warehousing.

    Familiarity with Databricks medallion architectureExperience working with Delta Live Tables Familiarity with Unity CatalogStrong programming experience using PythonExperience with distributed computing with SparkStreaming experience using technologies such as KafkaStrong problem-solving abilities, capable of adapting quickly in a dynamic environment.

    Excellent communication skills, with experience in mentoring and collaborative teamwork.
    Prior experience in client-facing roles is highly advantageous.
    Proficiency in Agile and DevOps methodologies.

    Databricks Data Engineering Professional certification is highly desirableContract Highlights:
    Competitive day rate of £550 - £650.Fully remote work, offering unparalleled flexibility.
    A 6-month contract outside IR35, providing freedom and independence in your professional engagements.
    An opportunity to engage with innovative projects and leadership roles within a high-growth, value-driven consultancy.


    Application Process:


    To apply for this opportunity, please click apply or send your CV to - Primus Connect champions diversity and inclusion, welcoming applications from all qualified individuals.

    Join us for an enriching contract experience that promises professional growth and a collaborative working environment.
  • ITECCO

    Data Engineer

    23 hours ago

    ITECCO London, United Kingdom

    **Job Title**: Data Engineer · **Location**: London · **Salary**: £45,000 plus pension and quarterly bonus · My client is currently recruiting for an experienced **Data Engineer** to join a leading **hospitality** company in the**City of London** on a full-time basis. · Extensive ...

  • eFinancialCareers

    Data Engineer

    2 days ago

    eFinancialCareers London, United Kingdom

    **Summary**: · A sponsor of London's PyData and ML meetups is looking to hire a Python / Data Engineer to join their core team in London. The successful Data Engineer will be building ETL data pipelines in Python and Kafka on Linux platforms, and will be working with a widerange ...

  • ITECCO

    Data Engineer

    23 hours ago

    ITECCO London, United Kingdom

    Data Engineer - Education Industry - London - £65,000 · I am looking for an experienced **Data Engineer** to join a **renowned Education organisation** based in **London**. This is an excellent opportunity for someone to join a large team and drive significant change in data infr ...

  • eFinancialCareers

    Data Engineer

    1 day ago

    eFinancialCareers London, United Kingdom

    **Permanent Role** · **London Based (Hybrid)** · **No Sponsorship** · **Role** · - Test/evaluate new alternative datasets in collaboration with quant researchers and data teams · - Once identified with machine learning and statistical methods, automate the extraction of predictiv ...

  • Understanding Recruitment

    Data Engineer

    2 days ago

    Understanding Recruitment London, United Kingdom

    **Data Engineer** · A brand new and exciting opportunity has recently arisen for a Data Engineer with an extensive knowledge in designing, developing and managing ETL processes and writing SQL code to join the UK's Largest Government department based remote. As the Data Engineery ...

  • Jefferson Frank

    Data Engineer

    2 days ago

    Jefferson Frank London, United Kingdom

    **About the job** · With the world's leading organisations looking to cloud solutions to innovate, disrupt and deliver growth, we help reimagine and reinvent entire businesses on the cloud. Through rapid prototyping and multi-cloud architecture, we've rebuilt telecom companies,tr ...

  • eFinancialCareers

    Data Engineer

    2 days ago

    eFinancialCareers London, United Kingdom

    **Summary**: · A globally leading, systematic, quant trading firm are looking for a Data Engineer to join their technical team in London. · The successful Data Engineer will be utilising both analytical and technical skillsets, building data pipelines in the Python and PyData sta ...

  • eFinancialCareers

    Data Engineer

    2 days ago

    eFinancialCareers London, United Kingdom

    Join us as a Data Engineer · - This is an exciting opportunity to use your technical expertise to collaborate with colleagues and build effortless, digital first customer experiences · - You'll be simplifying the bank through developing innovative data driven solutions, inspiring ...

  • Nigel Frank International

    Data Engineer

    2 days ago

    Nigel Frank International London, United Kingdom

    **Data Engineer - London - £65k** · Currently, I am working closely with a leading transport service organisation. Their purpose is to provide passenger transport services across the United Kingdom, and they have been doing this successfully for decades. · Whilst they offer up a ...

  • Nigel Frank International

    Data Engineer

    2 days ago

    Nigel Frank International London, United Kingdom

    **Data Engineer - London - £65k DoE** · I am currently working with a market-leading organisation who are looking to for a Data Engineer to join their team and help them in their goal of enhancing the way data is used in their specialist industry. In this role you will use data f ...

  • eFinancialCareers

    Data Engineer

    1 day ago

    eFinancialCareers London, United Kingdom

    An exciting Data Engineering opportunity has become available within a multinational oil and gas company. The end client has a requirement for multiple engineering positions, to be part of a cross-disciplinary team working closely with other Data Engineers,Software Engineers, Dat ...

  • Salt Search

    Data Engineer

    2 days ago

    Salt Search London, United Kingdom

    **Data Engineer | £400-£425/day| 6 Months | OUTSIDE IR35 | Hybrid/London | AWS | JSON | Python | Github** · One of my key clients is looking for a Data Engineer to join the team at a very exciting time. Working closely with the 1st line of defence to ensure that the firm's collec ...

  • Harnham

    Data Engineer

    2 days ago

    Harnham London, United Kingdom

    **Data Engineer** · **London - Hybrid - Remote** · **£65,000** · Do you want to own the migration to a cloud platform? Are you looking to modernize a market-leading company to properly utilize its data and analytics? If so, this could be the role for you. · This insurance broker ...

  • Anson McCade Ltd - IT and Finance Recruitment

    Data Engineer

    2 days ago

    Anson McCade Ltd - IT and Finance Recruitment London, United Kingdom

    *MUST be able/willing to go through SC Clearance* · I am working with a mid-sized consultancy who are on the hunt for a Data Engineer to join their growing engineering function in London. This is an exciting opportunity for a Data Engineer with extensive experience working with c ...

  • eFinancialCareers

    Data Engineering

    2 days ago

    eFinancialCareers London, United Kingdom

    They are seeking an experienced Azure Data engineer to come onboard in a permanent capacity. · The role will require you to work in a well-developed BI and Analytics team where you will utilise your Azure skill set and build data solutions. The business has reported year on year ...

  • eFinancialCareers

    Data Engineering

    2 days ago

    eFinancialCareers London, United Kingdom

    We are currently hiring for multiple Data Engineering positions across our businesses within asset management and commodities and global markets. We are interested in speaking to Data Engineers across varying levels of experience to discuss our ongoingwork and potential opportuni ...

  • Sanderson

    Data Engineer

    2 days ago

    Sanderson London, United Kingdom

    **Role**: Data Engineer · **Salary**: £80k · **Location**: City of London · **Hybrid working**:3 days a week in the office · One of the UK's leading insurance companies is looking for a Data Engineer to join their team this is a fantastic opportunity for somebody that is looking ...

  • Plexus

    Data Engineer

    23 hours ago

    Plexus London, United Kingdom

    Plexus have partnered with a decentralised credit and lending platform who are at the forefront of credit and lending infrastructure in the web3 space. They have an established product, strong team and great backing. · They're looking for a Data Engineer to help make their platfo ...

  • Data Idols

    Data Engineer

    1 day ago

    Data Idols London, United Kingdom

    **Data Engineer** Data Idols are excited to be working with one of the top 100 companies in the world to recruit a Data Engineer A company which owns multiple brands and who are investing heavily into 'all things data' to revolutionise their extraordinary team. · **Skills and Exp ...

  • eFinancialCareers

    Data Engineer

    2 days ago

    eFinancialCareers London, United Kingdom

    Referment are working with a fast growing and high performing private capital asset manager who are looking to onboard a talented Data Engineer to work on complex internal systems supporting the investment strategies of the fund. · This is a great opportunity that will suit a dat ...