Senior Data Engineer - Hertfordshire, United Kingdom - Xcede

    Xcede
    Xcede Hertfordshire, United Kingdom

    2 weeks ago

    Default job background
    Technology / Internet
    Description

    SENIOR DATA ENGINEER

    (Hertfordshire HQ – circa x1 day a week in office)

    Xcede are delighted to be working with a well-renowned insurance company based in Hertfordshire. The company have an excellent Data Science and Machine Learning unit supported by a group of Data Engineers who are responsible for Data Pipelines. As a bonus - Data Engineers are also able to help with ML model deployment and MLOps.

    Responsibilities

    • Design and implement both Data Pipelines for both structured and unstructured data.
    • Support and improve ML infrastructure – particularly Azure ML.
    • Contribute to MLOps across the organisation.

    Requirements

    • An academic background in Statistics, Mathematics, or Computer Science (or similar)
    • A number of years of commercial work as a Senior Data Engineer (responsible for taking decisions, rather than just writing code)
    • An ability to write production quality Python code.
    • Strong SQL Skills
    • Experienced creating data pipelines in a cloud (preferably Azure) environment
    • TDD & CI/CD experience
    • Containerisation experience (Docker, Kubernetes, etc.)
    • MongoDB (or NoSQL) experience
    • Terraform experience
    • Previous experience in managing the ML lifecycle with MLFlow