Jobs
>
London

    Staff Data Engineer - United Kingdom - Kpler group

    Kpler group
    Kpler group United Kingdom

    1 week ago

    Default job background
    Description

    Founded in 2014, our goal is to help over 10,000 organisations by offering the best intelligence on commodities, energy, and maritime through a single platform.

    Working at Kpler means you'll be a key player in turning complex data into strategic resources for our clients.

    Your role involves creating data-driven stories that empower clients in their industries.
    Your expertise helps Kpler navigate markets successfully. Join our team of 500+ talented people from 35+ countries worldwide.
    We are looking for a Staff Data Engineer to join our freight team.

    This team is in charge of all feature s to provide analytics about the fleet of vessels (world wild) activity to our clients.

    Some of the exciting projects you could work on include:


    • Building a new pipeline to feed a live database which is used by clients and research teams to produce useful insight on the commodity market
    • Building new features for our core platform including metrics & forecasting as well as scaling and stabilizing our data pipelines
    As a Staff Data Engineer, you will:


    • Act as a mentor for our junior engineers as the Tech lead for the freight team
    • Monitor the quality and performance of deliverables (using SLI/SLO, alerts, dashboards),
    • Helps the product manager define development-ready tickets
    • We also expect you to be able to build API to propagate the data across the systemOur
    VueJs and more on the frontend


    • Python, Scala, Postgresql, ElasticSearch, Kafka, Spark, Snowflake and more on the backend
    • AWS, terraform and ansible for DevOps tools

    You have at least 8 years of experience in a similar role including significant experience in Java, Scala or equivalent language.

    Typescript, Spark, Python are a plus.
    You value clean code, performance and details.
    You are familiar with building ETL and data pipelines, using asynchronous framework is a plus.
    You are comfortable with SQL and NoSQL databases for OLTP and OLAP usages.
    You are fluent in English and have experience working in an international environment
    We foster relationships and develop creative solutions to address market challenges with cool features and solutions.
    hey, how can i help you today?

    Research shows that women and people of color are less likely than others to apply if they feel like they don't match 100% of the job requirements.

    We believe that different perspectives lead to better ideas, and better ideas allow us to better understand the needs and interests of our diverse, global community.

  • Understanding Recruitment

    Data Engineer

    1 week ago

    Understanding Recruitment London, United Kingdom

    **Data Engineer** · A brand new and exciting opportunity has recently arisen for a Data Engineer with an extensive knowledge in designing, developing and managing ETL processes and writing SQL code to join the UK's Largest Government department based remote. As the Data Engineery ...

  • Lynx Recruitment Ltd

    Data Engineer

    5 days ago

    Lynx Recruitment Ltd London, United Kingdom

    **Data Engineer - London - £45,000 - £65,000** · **Hybrid working - 1/2 days a week in the office maximum** · Data Engineer/Junior DataArchitectrequired by an award-winning technology consultancy based in London paying £45,000 - £65,000 depending on experience plus bonus and bene ...

  • eFinancialCareers

    Data Engineer

    1 week ago

    eFinancialCareers London, United Kingdom

    Join us as a Data Engineer · - This is an exciting opportunity to use your technical expertise to collaborate with colleagues and build effortless, digital first customer experiences · - You'll be simplifying the bank through developing innovative data driven solutions, inspiring ...

  • eFinancialCareers

    Data Engineer

    5 days ago

    eFinancialCareers London, United Kingdom

    cer Financial are working alongside a bank who are based in the City of London, they are looking for a Data Engineer to join them on a permanent basis · **The Responsibilities of a Data Engineer Will Include**: · - Design, develop, and hold accountability for data engineering ser ...

  • eFinancialCareers

    Data Engineer

    3 days ago

    eFinancialCareers London, United Kingdom

    An exciting Data Engineering opportunity has become available within a multinational oil and gas company. The end client has a requirement for multiple engineering positions, to be part of a cross-disciplinary team working closely with other Data Engineers,Software Engineers, Dat ...

  • Harnham

    Data Engineer

    1 week ago

    Harnham London, United Kingdom

    **Data Engineer** · **London - Hybrid - Remote** · **£65,000** · Do you want to own the migration to a cloud platform? Are you looking to modernize a market-leading company to properly utilize its data and analytics? If so, this could be the role for you. · This insurance broker ...

  • Harnham

    Data Engineer

    1 week ago

    Harnham London, United Kingdom

    **Data Engineer** · **London** · **Up to £45,000 + Competitive Bonus and Benefits** · **The Company** · This is an exciting opportunity to join a disruptive challenger bank. You will work in a dedicated engineering function with the chance to learn and pick up the newest Big Data ...

  • Experis LTD

    Data Engineer

    6 days ago

    Experis LTD London, United Kingdom

    **Role: Data Engineer** · **Duration:6th months initially(Extension Expected)** · **Location: London (2 TO 4 Days a month need to go onsite)** · **Rate: £550 per day inside IR35** · **RESPONSIBILITIES**: · - Create and maintain optimal data pipeline architecture · - Assemble larg ...

  • eFinancialCareers

    Data Engineer

    2 days ago

    eFinancialCareers London, United Kingdom

    5+ years data engineering experience ideally within global financial markets firm · - Strong experience with Snowflake and is related ecosystem · - Redshift, Synapse, Big Query, SQL, RDS, Spanner, Erwin, Lucid and DB Schema · - Data analytics/visualisation in Tableau, PowerBI or ...

  • Jefferson Frank

    Data Engineer

    1 week ago

    Jefferson Frank London, United Kingdom

    **Mid level Data Engineer** · **£50,000 - £60,000 DOE** · **Edinburgh/The Midlands/London - Primarily Remote** · My client are one of the biggest names in technology and modern cloud consulting, they boast a world class data and analytics centre and are looking to add to their te ...

  • Jefferson Frank

    Data Engineer

    1 week ago

    Jefferson Frank London, United Kingdom

    **Junior Data Engineer** · **£40,000 - £60,000 DOE** · **Remote with occasional (quarterly) travel** · My client are one of the biggest names in technology and modern cloud consulting, they boast a world class data and analytics centre and are looking to add to their team. They p ...

  • Nigel Frank International

    Data Engineer

    3 days ago

    Nigel Frank International London, United Kingdom

    Data Engineer - fully remote - £60,000 · Nigel Frank are teamed up with an industry leading organisation that are currently looking to hire a Data Engineer to join their team. This organisation has been going through major growth over the past few years, with significant investme ...

  • Jefferson Frank

    Data Engineer

    1 week ago

    Jefferson Frank London, United Kingdom

    **AWS Data Engineer - Senior Level - Fintech - London** · **Flexible to remote and hybrid working.** · They are proud to be working on unique and impactful problems in the ESG and sustainability space, using a modern and varied tech stack. · They have built a relaxed, collaborati ...

  • Circle Recruitment

    Data Engineer

    1 week ago

    Circle Recruitment London, United Kingdom

    **Data Engineer** · **£600 - £700/Day Inside IR35** · **London, Hybrid** · **6 Months** · We are seeking a Data Engineer for our Government client based in London. This role will be office based 2 days per week and the remaining remote. The Data Engineer role will be and initial ...

  • Data Idols

    Data Engineer

    1 week ago

    Data Idols London, United Kingdom

    **Senior Data Engineer** Data Idols are proud to be working with an iconic UK brand to assist them in hiring a Senior Data Engineer as they undertake a digital and data-driven journey that will transform the business. Data is at the heart of the organisation and forms a key parto ...

  • Harnham

    Data Engineer

    4 days ago

    Harnham London, United Kingdom

    **Data Engineer** · **£500 a day, outside IR35.** · **Hybrid, London-based.** · **6-Month Contract.** · **The Company** · A great opportunity to join an insurance company in a recently set-up and growing team. You will join the business as a Data Engineer playing a major role in ...

  • Data Idols

    Data Engineer

    1 week ago

    Data Idols London, United Kingdom

    **Data Engineer** Data Idols are excited to be working with one of the top 100 companies in the world to recruit a Data Engineer A company which owns multiple brands and who are investing heavily into 'all things data' to revolutionise their extraordinary team. · **Skills and Exp ...

  • The Consultancy Group

    Data Engineer

    5 days ago

    The Consultancy Group London, United Kingdom

    We are seeking a talented Data Engineer with Salesforce experience to join a leading consultancy. In this role, you will be responsible for building and maintaining our data infrastructure and integrating our Salesforce system with other data sources. Youwill work closely with ou ...

  • Method Resourcing

    Data Engineer

    1 week ago

    Method Resourcing London, United Kingdom

    **Data Engineer | Python | SQL | GCP | BigQuery | Data Studio | ETL | DBT | Stitch | Fivetran | Singer | £40,000-£50,00** · Method Resourcing are currently working with a Media Publication company that report on the world of data and provide publications to over 300,000 data prof ...

  • eFinancialCareers

    Data Engineer

    1 week ago

    eFinancialCareers London, United Kingdom

    **Data Engineer - Macro Hedge Fund - Base up to £150k + Bonus** · You take pride in your ability to not only manage complex pipelines, processes, and models but build the pipelines from scratch to ensure their efficacy. Your last greenfield project seems like a lifetime ago. Comp ...