Jobs
>
London

    Data Engineering Manager - London, United Kingdom - Trainline

    Show more Collapse job
    Default job background
    Full time
    Description
    Job Description

    As a Data Engineering Manager at Trainline you will...

    • A committed lead and coach to an agile team of polyglot Data Platform Engineers, building a cutting-edge data lakehouse platform on AWS using Kafka and cloud-native streaming technologies, Iceberg, Trinio, DataHub and Airflow.
    • Be a brilliant people manager for the Data Engineering function that motivates and engages their team to develop their skills and increase their impact.
    • Deliver the platform to enable deliver world class data products, including the latest in LLM and other AI technologies.
    • Lead the technical direction of the cross-functional team, making good choices on technologies and approach to get the biggest impact for the least risk.
    • Foster an obsession with quality and engineering excellence through automated, repeatable processes using CI/CD, TDD, BDD.
    • Drive incremental growth in dev ops maturity, building tools and practices that allow repeatable and efficient delivery of models to production, with strong governance in the workflow and continuous monitoring of models in production.
    • Own the operation of the products built by your team and continuously improve operation performance.
    • Lead and coach a self-organised Agile team and continuously improve agile maturity and delivery predictability.
    Qualifications

    We'd love to hear from you if you...

    • Thrive in a diverse, open and collaborative environment.
    • Expert in JVM technologies (primarily Scala but ideally with a working knowledge of Clojure or Java) and a familiarity with other key languages (especially Python).
    • Expert in key data engineering platforms such as Kafka or other streaming technologies, data lakes (AWS S3, Iceberg, Parquet), analytics technologies (Trinio, Spark), automation technologies (Airflow, ML Flow) and data governance (DataHub).
    • People management and technical leadership experience.
    • Are passionate about agile software delivery with a track record of leading effective agile and lean software teams.
    • A consistent background in software development in high volume environments
    • Have a strong background in Dev Ops, deploying, managing and maintaining services using Docker, Terraform and AWS CLI tools to achieve infrastructure-as-code and automated deployments.
    • Have an excellent working knowledge of AWS services (EMR, ECS, IAM, EC2, S3, DynamoDB, MSK).

    Our Technology Stack

    • Scala and Python
    • Kafka, Spark, Kafka Streams, Kinesis, Akka and KSQL
    • AWS, S3, Iceberg, Parquet, Glue and Spark/EMR for our Data Lake
    • Elasticsearch, Dynamodb and Redis
    • Starburst and Athena
    • Airflow and ML Flow
    Additional Information

    Why should you jump on board?

    We pay special attention to learning and development and organise quarterly company learning days as well as offering a learning budget that can be put towards resources of your choice. We will cover the costs of your professional subscriptions and give you access to our very own learning platform.

    At Trainline, we care about the wellness of our employees. We host puppy therapy sessions, in-office yoga and run Mental Health First Aider training courses as well as having an Employee Assistance Program as one of our many company benefits.

    We regularly throw fun social events such pub quizzes, karaoke nights and our large-scale Summer and Winter Festivals every year. Additionally, we love hosting meetups in our amazing event spaces and having the opportunity to support internal and external community groups.

    We also hold companywide hackathons and our annual Trainline Tech Summit, which provides Trainliners with an opportunity to stand up and share their story, learnings, or new skills with their colleagues in a safe environment.

    Our flexi-first approach

    We believe in the importance of a healthy work-life balance and the value of a flexible workforce. Our flexi-first approach outlines our commitment to a hybrid way of working and our expectations of Trainliners. A key part of what makes Trainline special is our people and the value we get from the buzz and energy of our workplaces, and that's why we're proud to offer the best of both worlds. In practice this means in–office attendance at least 40% of the time over a 12-week period for all Trainliners. These in-office days are typically team led to help us connect, collaborate and create together.

    Our Values

    • Think Big - We're building the future of rail
    • Own It - We care about every customer, partner and journey
    • Do Good - We make a positive impact
    • Travel Together - We're one team

    Interested in finding out more about what it's like to work at Trainline? Why not check out what our employees say about us on Glassdoor? You can also find out more information by following us on LinkedIn or our 'Life at Trainline' Instagram account.

    We value open expression at Trainline, we believe it's the diversity of experience, backgrounds and perspectives of our employees that makes us who we are. We encourage everybody to play a part in changing the way people travel across the world.


    We have other current jobs related to this field that you can find below

  • APEX APPOINT LTD

    Engineering Manager

    3 weeks ago


    APEX APPOINT LTD London, United Kingdom Full time

    Are you a seasoned leader in engineering looking for an exciting opportunity to shape and execute functional strategies within a thriving business environment? We are in search of a Head of Engineering to lead a team in delivering exceptional results. · Role Overview: · As the He ...

  • Jefferson Frank

    Engineering Manager

    3 weeks ago


    Jefferson Frank London, United Kingdom

    **Engineering Manager, £110,000, London (2 days per week)** · Jefferson Frank have partnered with a long standing organisation within the United Kingdom who is going through a stage of expansion and such have highlighted a necessity for a technical leader to join the business, an ...

  • Jefferson Frank

    Engineering Manager

    2 weeks ago


    Jefferson Frank London, United Kingdom

    Engineering Manager - £95-105K - London - Internet Services · Engineering Manager - £95-105K - London - Internet Services · You will have a passion for leading and growing engineering teams while also being responsible for the timely planning and delivery of the projects the team ...

  • NonStop Consulting Ltd

    Engineering Manager

    3 weeks ago


    NonStop Consulting Ltd London, United Kingdom

    Dev Ops Engineer - AMAZING RATE - Hybrid · Gain valuable experience while impacting the lives of millions · If this sounds like something that you would like doing, you're in luck because we are currently recruiting an Engineering Manager for a great project that is ran by a depa ...


  • Bywaters London, United Kingdom Full time

    Bywaters, a leader in environmental sustainability, is committed to excellence and equality in the workplace. We are currently seeking a skilled MRF Engineering Manager to oversee the maintenance and enhancement of our Materials Recovery Facility (MRF) equipment and systems. · Re ...

  • Be-IT Resourcing

    Engineering Manager

    3 weeks ago


    Be-IT Resourcing Central, United Kingdom

    Would you like the opportunity to work as an Engineering Manager for a multinational tech Unicorn? · You'll be responsible for leading and empowering a team, working with some of the best engineers in Scotland, building products that are used by over 150 million users internation ...


  • Lynx Recruitment Ltd London, United Kingdom

    **Software Engineering Manager - Remote -**£85,000pa - £95,000pa · Due to growth a Software Engineering Manager is required by an award-winning technology consultancy paying £85,000 - £95,000 depending on experience. · My client is fast-growing, digital experience agency, develop ...


  • GradBay London, United Kingdom

    Company Description · We are a leading global engineering and supply chain consultancy with a focus on consumer and medical devices. Our unique advantage is our full lifecycle capability from concept development through to scaling manufacturing. Elsewhere, these skills and servic ...

  • Howells Solutions

    Data Engineer Manager

    3 weeks ago


    Howells Solutions London, United Kingdom

    **Data Engineer Manager** · **London** · Howells are currently recruiting for a successful construction company who are a market leader in regeneration, energy and FM services. · You will be working with a friendly team, AWS consultants and associated specialists to design, deplo ...


  • Vodafone UK London, United Kingdom

    **Software Engineering Manager** · Posting Country:United Kingdom Date Posted:04-Feb-2023 Full Time / Part time:Full Time Contract Type:Permanent At Vodafone, we're working hard to build a better future. A more connected, inclusive and sustainable world. As a dynamic global commu ...


  • Harnham London, United Kingdom

    **Data Engineering Manager** · **Up to £100,000** · **London** · **The Company**: · **This role is with a global organisation who are looking to revamp its data engineering remit. They cover a variety of interesting sectors such as Pharmaceutical, Healthcare, and Financial Servic ...


  • Prince Resourcing Group Ltd London, United Kingdom

    **Do you have strong.Net and Azure experience? Do you have experience leading a small team or would you like a step into a management position? Are you interested in the world of AI, Machine Learning and AR and working for a start up with excitingfuture plans?** If so, please car ...


  • Morgan Hunt Recruitment London, United Kingdom

    Morgan Hunt are delighted to be working with a leading FE College in the Central London to recruit for a Automotive/Engineering Curriculum Manager. · To be successful, you will have extensive experience of delivering outstanding teaching and learning within education and training ...

  • Thyme Tech

    Engineering Manager

    4 weeks ago


    Thyme Tech london, United Kingdom £95,000

    Engineering Manager - Digital Health - UK/Remote - Up to £95k + Benefits · If you're interested in tech for good, here is the opportunity to work with a health start-up committed to transforming the UK healthcare system. · Our client are looking for an Engineering Manager to join ...

  • Hyatt Regency London Stratford

    Engineering Manager

    2 weeks ago


    Hyatt Regency London Stratford London (Greater), United Kingdom Full time

    Engineering Manager - Stratford, London · Just some of the benefits you will enjoy as a Engineering Manager12 complimentary nights a year across Hyatt Hotels worldwide · Discounted hotel stays across Hyatt not just for you but also your family and friends from the day you start · ...

  • Reward Gateway

    Engineering Manager

    4 weeks ago


    Reward Gateway london, United Kingdom

    In May 2023 Reward Gateway was acquired by Edenred. Edenred is a leading digital platform for services and payments for people at work, connecting 52 million users and 2 million partner merchants in 45 countries via close to 1 million corporate clients. · With our shared missions ...

  • Canonical

    Engineering Manager

    1 week ago


    Canonical London, United Kingdom

    Redefine the embedded Linux experience with the smallest, most secure, and most reliable operating system in the IoT market. This is an opportunity for a technical engineering manager passionate about open source software, Linux, containers, security, and the developer experience ...

  • Bits

    Engineering Manager

    1 week ago


    Bits London, United Kingdom Full time

    Please only apply if your happy to be based in our Camden (London) office 4-days a week and have the below experience and skillset. · Role: Back End · Experience level: Lead, Manager · Tech stack/tooling used: , AWS, NoSQL, Typescript · Core skills we consider, AWS, NoSQL, Typesc ...

  • CTI

    Engineering Manager

    1 week ago


    CTI London, United Kingdom Full time

    Location: London / Hybrid · Industry: Fintech · Salary: £105K-£125K + Benefits · Engineering Manager for a scaling challenger bank. · Requirements: · Should still have some fullstack hands-on experience (React, Node, Typescript, AWS) · Product focused and drive planning and deliv ...

  • Space Executive

    Engineering Manager

    1 week ago


    Space Executive England, United Kingdom

    Business Introduction · Our client is a rapidly growing systems integrator supporting corporate and global clients throughout EMEA. With a UK head office in London - the business employs UK engineering staff and collaborates with local service providers throughout EMEA deliverin ...