Jobs
>
London

    Staff Data Engineer - United Kingdom - Kpler group

    Kpler group
    Kpler group United Kingdom

    1 week ago

    Default job background
    Description

    At Kpler, we simplify global trade information and provide valuable insights. Founded in 2014, our goal is to help over 10,000 organisations by offering the best intelligence on commodities, energy, and maritime through a single platform.

    Working at Kpler means you'll be a key player in turning complex data into strategic resources for our clients. Your role involves creating data-driven stories that empower clients in their industries.

    Your expertise helps Kpler navigate markets successfully. Your journey starts here, where innovation meets impact. Join our team of 500+ talented people from 35+ countries worldwide.

    What you'll do:

    We are looking for a Staff Data Engineer to join our freight team. This team is in charge of all feature s to provide analytics about the fleet of vessels (world wild) activity to our clients.Some of the exciting projects you could work on include:


    • Building a new pipeline to feed a live database which is used by clients and research teams to produce useful insight on the commodity market


    • Building new features for our core platform including metrics & forecasting as well as scaling and stabilizing our data pipelines

    As a Staff Data Engineer, you will:


    • Encourage code reviews in your team,


    • Act as a mentor for our junior engineers as the Tech lead for the freight team


    • Monitor the quality and performance of deliverables (using SLI/SLO, alerts, dashboards),


    • Helps the product manager define development-ready tickets


    • Find efficient ways to tackle challenges using the relevant and up to date technologies


    • Work across the stack to deliver new features from start-to-finish


    • Own meaningful parts of our service, have an impact, grow with the company


    • Actively share knowledge and document insights to support continuous team improvement and collaboration


    • We also expect you to be able to build API to propagate the data across the systemOur

    Tech stack includes:


    • VueJs and more on the frontend


    • Python, Scala, Postgresql, ElasticSearch, Kafka, Spark, Snowflake and more on the backend


    • AWS, terraform and ansible for DevOps tools

    You may be a fit if..
    • You have at least 8 years of experience in a similar role including significant experience in Java, Scala or equivalent language. Typescript, Spark, Python are a plus.
    • You value clean code, performance and details.
    • You are familiar with building ETL and data pipelines, using asynchronous framework is a plus.
    • You are comfortable with SQL and NoSQL databases for OLTP and OLAP usages.
    • You have demonstrated that you can learn and adapt quickly
    • You want to work in a fast, high-growth startup environment
    • You are fluent in English and have experience working in an international environment

    We're a dynamic company dedicated to nurturing connections and innovating solutions that tackle market challenges head-on. If you're driven by customer satisfaction and thrive on turning ideas into reality, then you've found your ideal destination. Are you prepared to embark on this exciting journey with us?

    we make things happen

    We act decisively and with purpose, and we like to go the extra mile.

    we build
    together

    We foster relationships and develop creative solutions to address market challenges with cool features and solutions.

    hey, how can i help you today?

    Being accessible and supportive to colleagues and clients with a friendly approach is essential.

    Our People Pledge

    Don't meet every single requirement? Research shows that women and people of color are less likely than others to apply if they feel like they don't match 100% of the job requirements. Don't let the confidence gap stand in your way, we'd love to hear from you We understand that experience comes in many different forms and are dedicated to adding new perspectives to the team.

    Kpler is committed to providing a fair, inclusive and diverse work-environment. We believe that different perspectives lead to better ideas, and better ideas allow us to better understand the needs and interests of our diverse, global community. We welcome people of different backgrounds, experiences, abilities and perspectives and are an equal opportunity employer.

    By applying, I confirm that I have read and accept the Staff Privacy Notice

    #J-18808-Ljbffr
  • Nigel Frank International

    Data Engineer

    3 days ago

    Nigel Frank International London, United Kingdom

    Data Engineer - fully remote - £60,000 · Nigel Frank are teamed up with an industry leading organisation that are currently looking to hire a Data Engineer to join their team. This organisation has been going through major growth over the past few years, with significant investme ...

  • Circle Recruitment

    Data Engineer

    1 week ago

    Circle Recruitment London, United Kingdom

    **Data Engineer** · **£600 - £700/Day Inside IR35** · **London, Hybrid** · **6 Months** · We are seeking a Data Engineer for our Government client based in London. This role will be office based 2 days per week and the remaining remote. The Data Engineer role will be and initial ...

  • Data Idols

    Data Engineer

    1 week ago

    Data Idols London, United Kingdom

    **Senior Data Engineer** Data Idols are proud to be working with an iconic UK brand to assist them in hiring a Senior Data Engineer as they undertake a digital and data-driven journey that will transform the business. Data is at the heart of the organisation and forms a key parto ...

  • Harnham

    Data Engineer

    4 days ago

    Harnham London, United Kingdom

    **Data Engineer** · **£500 a day, outside IR35.** · **Hybrid, London-based.** · **6-Month Contract.** · **The Company** · A great opportunity to join an insurance company in a recently set-up and growing team. You will join the business as a Data Engineer playing a major role in ...

  • Data Idols

    Data Engineer

    1 week ago

    Data Idols London, United Kingdom

    **Data Engineer** Data Idols are excited to be working with one of the top 100 companies in the world to recruit a Data Engineer A company which owns multiple brands and who are investing heavily into 'all things data' to revolutionise their extraordinary team. · **Skills and Exp ...

  • The Consultancy Group

    Data Engineer

    5 days ago

    The Consultancy Group London, United Kingdom

    We are seeking a talented Data Engineer with Salesforce experience to join a leading consultancy. In this role, you will be responsible for building and maintaining our data infrastructure and integrating our Salesforce system with other data sources. Youwill work closely with ou ...

  • Method Resourcing

    Data Engineer

    2 weeks ago

    Method Resourcing London, United Kingdom

    **Data Engineer | Python | SQL | GCP | BigQuery | Data Studio | ETL | DBT | Stitch | Fivetran | Singer | £40,000-£50,00** · Method Resourcing are currently working with a Media Publication company that report on the world of data and provide publications to over 300,000 data prof ...

  • VALLUM ASSOCIATES LIMITED

    Data Engineer

    1 week ago

    VALLUM ASSOCIATES LIMITED London, United Kingdom

    **Mid-Senior Data Engineer - Energy & Financial Solutions (Commodities/Trading) - Permanent** · **Location: London or Swindon (Hybrid remote working)** · **Salary : Mid 70-85k, Snr 85-100k + bonus** · Are you an experienced or passionate Data Engineer looking to broaden your hori ...

  • eFinancialCareers

    Data Engineer

    1 week ago

    eFinancialCareers London, United Kingdom

    **Data Engineer - Macro Hedge Fund - Base up to £150k + Bonus** · You take pride in your ability to not only manage complex pipelines, processes, and models but build the pipelines from scratch to ensure their efficacy. Your last greenfield project seems like a lifetime ago. Comp ...

  • ITECCO

    Data Engineer

    1 week ago

    ITECCO London, United Kingdom

    Data Engineer - Education Industry - London - £65,000 · I am looking for an experienced **Data Engineer** to join a **renowned Education organisation** based in **London**. This is an excellent opportunity for someone to join a large team and drive significant change in data infr ...

  • Morgan McKinley

    Data Engineer

    1 week ago

    Morgan McKinley London, United Kingdom

    **Data Engineer** · **6 month rolling contract - up to £700 PD Inside - London/Hybrid** · I am currently looking for a Data Engineer to join a global financial services organisation on a 6-month rolling contract. As the Data Engineer, you will be extensively involved in hands-on ...

  • Harnham

    Data Engineer

    5 days ago

    Harnham London, United Kingdom

    **DATA ENGINEER** · **LONDON - HYBRID** · **£60, ,000** · **THE COMPANY**: · One of the UK's leading independent (re)insurance broker firms is looking for a skilled Data Engineer to have ownership of the cloud migration project they will be piloting in the New Year. The company h ...

  • Anson McCade Ltd - IT and Finance Recruitment

    Data Engineer

    2 days ago

    Anson McCade Ltd - IT and Finance Recruitment London, United Kingdom

    **About the Role** · As a**Data Engineer** you will be expected to carry out the following roles: · - You will have experience in developing, testing, and suppoting the collection & intergration of data. · - Bring structure to orders of work through modelling data requirements, s ...

  • eFinancialCareers

    Data Engineer

    1 week ago

    eFinancialCareers London, United Kingdom

    **Summary**: · A market-leading quant trading hedge fund are looking for a data engineer to join their London-based operations team, building data and trading pipelines from scratch. The successful data engineer will be developing Extract, Transform, Load (ETL) pipelinesin Python ...

  • Nigel Frank International

    Data Engineer

    6 days ago

    Nigel Frank International London, United Kingdom

    **Data Engineer - Azure - London** · I am currently working with a market leading organisation in the travel industry. They are heavily invested in expanding their data and analytics team with a view to being more data driven. This is a fantastic opportunity to help shape their d ...

  • eFinancialCareers

    Data Engineer

    2 days ago

    eFinancialCareers London, United Kingdom

    Join us as a Data Engineer, Streaming · - This is an exciting opportunity to use your technical expertise to collaborate with colleagues and build effortless, digital first customer experiences · - You'll be simplifying the bank through developing innovative data driven solutions ...

  • Data Idols

    Data Engineer

    1 week ago

    Data Idols London, United Kingdom

    **Data Engineer** Are you a mid-level **Data Engineer** skilled in **Azure technologies**, seeking an new 'feel-good' permanent opportunity? Data Idols are proud to be supporting a HealthTech client, who use remote-first technology focusing on engagingpatients across their health ...

  • eFinancialCareers

    Data Engineer

    1 week ago

    eFinancialCareers London, United Kingdom

    **Summary**: · A globally leading, systematic, quant trading firm are looking for a Data Engineer to join their technical team in London. · The successful Data Engineer will be utilising both analytical and technical skillsets, building data pipelines in the Python and PyData sta ...

  • Highams

    Data Engineer

    1 week ago

    Highams London, United Kingdom

    **Data Engineer - Insurance** · This is an exciting opportunity to join a global organisation within the London Insurance Market. · Hybrid working - 3 days pw in their City of London office · As a Data Engineer, you will have experience of building large scale, cloud-based distri ...

  • Mexa Solutions LTD

    Data Engineer

    5 days ago

    Mexa Solutions LTD London, United Kingdom

    **Data Engineer** · **Hybrid - London** · **£55,000 - £75,000** · **Your opportunity to work for a leading, Global, Consultancy.** · As the Data Engineer, you will be working on a huge variety of technologies and platforms, partnering with Clients to improve business growth. · Yo ...