Jobs
>
Leeds

    Lead Data Engineer - Leeds, United Kingdom - HCLTech

    Default job background
    Description

    Job Description

    Lead Data Engineer:

    We need some strong Data engineer profiles... they need good experience with

    Pyspark, Python, SQL, ADF and preferably Databricks experience

    Job description:

    • Building new data pipelines and optimizing data flows using the Azure cloud stack.
    • Building data products from scratch.
    • Support Business Analysts and Data Architects with discovery and best practices.
    • Self-directed and comfortable supporting the data needs of multiple teams, systems and products.

    What's required ?

    • Advanced Azure knowledge and experience working and migrating data products from on-prem to Azure.
    • Experience building and optimizing 'big data' data pipelines, architectures and data sets using Py-spark.
    • Experience building real-time data pipelines using Event-hub, storage queues and Azure stream analysis.
    • Strong analytic skills related to working with unstructured datasets.
    • Build processes supporting data transformation, data structures, metadata, dependency and workload management.
    • Cloud Big Data Analytics in Azure Synapse Analytics, Azure Analysis Services
    • Data Ingestion and Storage including Azure Data Factory, Azure Databricks, Azure Data Lake, Kafka and Spark Streaming, Azure EventHub/IoT Hub, and Azure Stream Analytics

    Experience with Object-oriented/ object function scripting languages: Python preferred


  • Circle Recruitment

    Data Engineer

    1 week ago


    Circle Recruitment Leeds, United Kingdom

    **Data Engineer** · **From £ 400 - £ 500 p/d - inside IR35** · **Hybrid Newcastle/Leeds** · **6-month contract** · We are seeking a Data Engineer for our government client. The role location is hybrid, based between 2 days a week on-site and the remainder of the week working remo ...

  • TransUnion

    Data Engineering

    3 days ago


    TransUnion Leeds, United Kingdom

    TransUnion's Job Applicant Privacy Notice · **What We'll Bring**: · We Are TransUnion: · TransUnion is a major credit reference agency, and we offer specialist services in fraud, identity and risk management, automated decisioning and demographics. We support organisations across ...

  • Harnham

    Data Engineer

    1 week ago


    Harnham Leeds, United Kingdom

    **Data Engineer** · **Up to £120,000 per annum** · **WFH: fully remote** · We have a fantastic new opportunity for a data engineer at an exciting new and innovative fintech company · **The Company** · This is a remittance company that is currently going through an extraordinary p ...

  • NonStop Consulting Ltd

    Data Engineer

    1 week ago


    NonStop Consulting Ltd Leeds, United Kingdom

    NonStop Consulting is looking to recruit a **Data Engineer** for a government department, with a mid term contract, 60-80% remote schedule and a competitive rate. · This is a fantastic opportunity for someone who is looking to join the public sector and gain reputable experience, ...

  • NonStop Consulting Ltd

    Data Engineer

    1 week ago


    NonStop Consulting Ltd Leeds, United Kingdom

    NonStop Consulting is looking to recruit a Data Engineer for a government department, with a mid term contract, 60-80% remote schedule and a competitive rate. · This is a fantastic opportunity for someone who is looking to join the public sector and gain reputable experience, whi ...


  • Harnham - Data & Analytics Recruitment Leeds, United Kingdom

    **Senior Data Engineer** · **Remote - 1 day per month in London per month** · **Up to £80, 000** · **Permanent** · An opportunity for a Senior Data Engineer has opened up at a massive media company, who are looking to build out their APIs and query the datasets. · **The Company** ...


  • Harnham - Data & Analytics Recruitment Leeds, United Kingdom

    **Senior Data Engineer** · **Fully Remote** · **Up to £85, 000** · **Permanent** · A major telecommunications company is looking for a Data Engineer to join them and assist with their migration to AWS. · **The Company** · An exciting opportunity for a Senior Data Engineer, or an ...

  • NonStop Consulting Ltd

    Data Engineer Azure

    1 week ago


    NonStop Consulting Ltd Leeds, United Kingdom

    NonStop Consulting is looking to recruit a professional Data Engineer for an esteemed Central Government department, available for hybrid work in either Leeds or Newcastle on an initial 6 months contract with potential extension to be confirmed. · This Public Sector client is loo ...

  • Harnham

    Lead Data Engineer

    1 week ago


    Harnham Leeds, United Kingdom

    **Lead Data Engineer** · **Up to £100,000 per annum** · **Location** - Fully remote · We have a fantastic opportunity for a Lead Data Engineer · **The Company** · The company is a growing group of committed colleagues, in financially responsible schools around the world, all of w ...


  • Page Group Leeds, United Kingdom

    To maintain Engineering documentation for the Manufacturing Department. · Carry out projects within the Manufacturing Department to improve efficiency and reduce costs · **Client Details** · One of the world's leading engineering companies which helps customers to use electrical ...


  • KMH Group Leeds, United Kingdom Full time

    Senior Data Cabling Engineer · Location: Covering the Leeds area · Salary: £25 - £35k basic, Negotiable, DOE + Overtime & Vehicle · Contract: Permanent, Full Time · The Benefits awarded to the successful Cabling Engineer: · • Competitive salary · • Company van & mobile phone for ...


  • SR2 Leeds, United Kingdom

    "A company of the 22nd century" · While they're not working on flying cars just yet, that's a quote on Glassdoor from an employee who reckons that the work/life balance, the professional & personal growth, the emphasis on environment, social responsibility & community engagement, ...


  • Corecom Consulting Leeds, United Kingdom Full time

    I'm working with an industry leading brand that are currently undertaking a large scale data transformation across the whole group. · You will be joining an fast paced Engineering team that need support from an analytical perspective. Your responsibilities will include extracting ...


  • Oscar Technology Leeds, United Kingdom

    My Client, a consultancy are looking for a Data Engineer to join them on an inital 6 month contract. · **Requirements**: · - Experience with SQL/NoSQL databases · - CI/CD · - AWS, Azure · - Worked within an agile environment · - Broad IT knowledge · Oscar Technology is acting as ...

  • Broster Buchanan Ltd

    Data Engineer

    8 hours ago


    Broster Buchanan Ltd Brierfield, United Kingdom

    My client is looking for an experienced Data Migration and Backend Engineer to join their growing business on a permanent, fully remote basis. The main purpose of the role is migrating customer data for new and existing clients from 3rd party systems ontotheir internal systems, a ...

  • Fruition IT Resources Limited

    Data Engineer

    1 week ago


    Fruition IT Resources Limited Leeds, United Kingdom

    Job Description · Data Engineer · Leeds - on site 2x per week · up to £55,000 · Looking to join a dynamic team in the financial sector? Fruition IT are looking for an experienced Data Engineer to join a leading company specializing in financial solutions. · Working closely with ...

  • Fruition IT

    Data Engineer

    5 days ago


    Fruition IT Leeds, United Kingdom

    Data Engineer · Leeds - on site 2x per week · up to £55,000 · Looking to join a dynamic team in the financial sector? Fruition IT are looking for an experienced Data Engineer to join a leading company specializing in financial solutions. · Working closely with the Senior Data E ...

  • The Cloud Recruitment Company

    Data Engineer

    5 days ago


    The Cloud Recruitment Company Leeds, United Kingdom

    Data Engineer: · Full time permanent role · Fully remote working · Key Responsibilities: · • Design and construct dependable, resilient, and precise data pipelines in accordance with established best practices. · • Establish the necessary infrastructure to ensure efficient extra ...

  • Moda in Pelle

    Data Engineer

    31 minutes ago


    Moda in Pelle Leeds, United Kingdom

    Data Engineer · Full time - 40hrs a week · Head office based - Leeds · Salary- Competitive · Hybrid · Founded in 1975, Moda in Pelle has been crafting beautiful shoes for over 40 years. We take great pride in combining British sophistication with fine Italian quality and gor ...

  • Careeraddict

    Data Engineer

    2 days ago


    Careeraddict Leeds, United Kingdom

    2 days ago Be among the first 25 applicants · This range is provided by CareerAddict. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. · Base pay range · Data Engineer · Leeds - on site 2x per week · up to £55,000 · Lookin ...