Jobs
>
London

    Software Engineer, Model Performance - London, United Kingdom - DeepMind

    Default job background
    Description

    At Google DeepMind, we value diversity of experience, knowledge, backgrounds and perspectives and harness these qualities to create extraordinary impact. We are committed to equal employment opportunity regardless of sex, race, religion or belief, ethnic or national origin, disability, age, citizenship, marital, domestic or civil partnership status, sexual orientation, gender identity, pregnancy, or related condition (including breastfeeding) or any other basis as protected by applicable law. If you have a disability or additional need that requires accommodation, please do not hesitate to let us know.

    Snapshot

    We are looking for a software engineer passionate about improving the performance of cutting-edge ML models on hardware accelerators. You will be part of a team responsible for deploying models, e.g. large language models (LLMs), at scale for use throughout Alphabet. This involves working across the stack, from ML frameworks to compilers, with the aim to serve models at maximum efficiency.

    About Us

    Artificial Intelligence could be one of humanity's most useful inventions. At Google DeepMind, we're a team of scientists, engineers, machine learning experts and more, working together to advance the state of the art in artificial intelligence. We use our technologies for widespread public benefit and scientific discovery, and collaborate with others on critical challenges, ensuring safety and ethics are the highest priority.

    The Role

    The rising use of large language models (LLMs) demands efficient and performant serving solutions. As a member of the deployment team you will help us improve the efficiency of our model serving stack, and optimize the performance of the latest models on Google's fleet of hardware accelerators - throughout the entire LLM deployment lifecycle.

    This involves:

    • Collaborating with research teams to ensure models are production-ready.
    • Optimizing the serving environment with other infrastructure teams.
    • Streamlining the release process for cutting-edge research.
    • Improving low-level performance of models on hardware.
    • Enhancing request handling and distribution across systems.

    This role provides an opportunity to work on a broad set of problems and gain a broad understanding of ML models and hardware performance.

    Key responsibilities:

    Depending on your skills and interests, some of your responsibilities will be:

    • Improve efficiency of ML model serving on hardware accelerators
    • Profile models to identify performance bottlenecks and opportunities
    • Write low-level code targeting hardware accelerators
    • Implement model sharding techniques to efficiently partition models across accelerators
    • Identify the best hardware setup for deploying a diverse set of models
    • Work closely with ML compiler teams to improve efficiency
    • Design and implement optimisations for distributed serving systems, e.g. reducing network transfers and redundant computations

    About You

    In order to set you up for success as a Software Engineer at Google DeepMind, we look for the following skills and experience:

    • Interpersonal skills, such as discussing technical ideas effectively with colleagues
    • Excellent knowledge of either C++ or Python

    In addition we are looking for experience with at least two of the following:

    • Experience programming hardware accelerators (GPUs, TPUs etc) via ML frameworks (e.g. JAX, PyTorch) or low-level programming models (e.g. CUDA, OpenCL)
    • Profiling software to find performance bottlenecks
    • Leveraging compiler infrastructure to improve performance on hardware
    • Distributed ML systems optimization
    • Training and using large models (>10 billion parameters)
    • Interest in AI and basic knowledge of AI algorithms and models (e.g. Transformer)

    Application deadline: 5pm BST, Friday 3rd May 2024

    #J-18808-Ljbffr


  • eFinancialCareers London, United Kingdom

    **Responsibilities**: · - **The role is part of the firm's Quantitative Research team and develops, builds, enhances, and supports return attribution, risk, portfolio construction, and asset allocation models that generate daily and monthly analysis and reports across bothfixed i ...


  • MBDA Stevenage, United Kingdom

    **_Stevenage_** · **MBDA is a leading defence organisation that is proud to support our Armed Forces in protecting our nations. We collaborate with governments to achieve a shared goal of defending our freedom.** · **Salary**: Up to **£65,000** depending on experience · **What we ...


  • Apple Inc. London, United Kingdom

    Do you have an uncommon desire to seek out and solve exceedingly difficult challenges rather than the easy ones? Do you believe that truly valuable and meaningful accomplishments are the result of pushing the limits of perseverance? Do you believe that a world-class team with rel ...


  • Apple Inc. United Kingdom

    Cambridge , Cambridgeshire , United Kingdom · Do you have an uncommon desire to seek out and solve exceedingly difficult challenges rather than the easy ones? Do you believe that truly valuable and meaningful accomplishments are the result of pushing the limits of perseverance? ...


  • South East Water Snodland, United Kingdom

    **Can you take decisions to ensure asset performance objectives are met?** · *** · **Are you persuasive in presenting options to others? If so, then don't miss this opportunity** · **We want to be the water company people want to be supplied by and want to work for.** · *** · You ...


  • MS Amlin London, United Kingdom Full time

    ABOUT MS AMLIN · MS Amlin is part of a global top-10 insurance group MS&AD, with three main legal entities' operating in the Lloyd's, UK, Continental European and Bermudian markets. We have an enviable reputation for our customer knowledge, claims service and the specialist insu ...


  • AMLIN London, United Kingdom Full time

    ABOUT MS AMLIN · MS Amlin is part of a global top-10 insurance group MS&AD, with three main legal entities' operating in the Lloyd's, UK, Continental European and Bermudian markets. We have an enviable reputation for our customer knowledge, claims service and the specialist insur ...


  • MBDA Stevenage, United Kingdom

    **_Stevenage_** · **MBDA is a leading defence organisation. We are proud of the role we play in supporting the Armed Forces who protect our nations. We partner with governments to work together towards a common goal, defending our freedom.** · **Salary**: Up to £50k dependent on ...


  • MBDA Stevenage, United Kingdom

    **_Together. For the future of defence._** · **Salary**: Circa £44,000 + dependent on experience + bonus + benefits · **Hybrid working pattern**: Where possible, we will seek to accommodate a blended approach to on-site and remote working **- **such as 4 days per week on site, 1 ...


  • MBDA Stevenage, United Kingdom

    **Together. For the future of defence.** · **Salary**: Circa £44,000 + dependent on experience + bonus + benefits · **Hybrid working pattern**: Where possible, we will seek to accommodate a blended approach to on-site and remote working **- **such as 4 days per week on site, 1 da ...


  • MBDA Miissle System Stevenage, Hertfordshire, United Kingdom

    MBDA is a leading defence organisation that is proud to support our Armed Forces in protecting our nations. We collaborate with governments to achieve a shared goal of defending our freedom. · Salary : Up to £65,000 depending on experience What we can offer you: · Bonus of up ...


  • Apple Inc. St Albans, Hertfordshire, United Kingdom

    Saint Albans , Hertfordshire , United Kingdom · Do you have an uncommon desire to seek out and solve exceedingly difficult challenges rather than the easy ones? Do you believe that truly valuable and meaningful accomplishments are the result of pushing the limits of perseverance ...


  • MBDA Stevenage, Hertfordshire, United Kingdom

    Stevenage · MBDA is a leading defence organisation. We are proud of the role we play in supporting the Armed Forces who protect our nations. We partner with governments to work together towards a common goal, defending our freedom. Salary: Up to £50k dependent on experience Wh ...

  • JPMorgan Chase Bank, N.A.

    Risk Model Review

    1 week ago


    JPMorgan Chase Bank, N.A. London, United Kingdom

    As part of Risk Management and Compliance, you are at the center of keeping JPMorgan Chase strong and resilient. You help the firm grow its business in a responsible way by anticipating new and emerging risks, and using your expert judgement to solve real-world challenges that im ...


  • JPMorgan Chase Bank, N.A. London, United Kingdom

    As part of Risk Management and Compliance, you are at the center of keeping JPMorgan Chase strong and resilient. You help the firm grow its business in a responsible way by anticipating new and emerging risks, and using your expert judgement to solve real-world challenges that im ...


  • Pontoon London, United Kingdom

    **Job title**: Quantitative Risk Modeller · **Location**: London · **Duration**: 6 months initially · **The role**: · The Market Risk Model Risk and Validation (MRAV) team is responsible principally for providing effective, robust and independent oversight of, and challenge and s ...

  • Canada Life

    Head of Modelling

    2 weeks ago


    Canada Life London, United Kingdom

    **Please note this position is being recruited under the SMCR regime.** · Canada Life UK looks after the retirement, investment and protection needs of individuals, families and companies. We help to build better futures for our customers, our intermediaries and our employees by ...


  • eFinancialCareers London, United Kingdom

    **Responsibilities**: · - Manage the annual review of models used by the bank for measuring market and Counterparty credit risk, suggesting improvements and action plans. · - Validating Interest Rate, Inflation, Equity and Property derivatives but also market and counterparty cre ...

  • Gleeson Recruitment Group

    Finance Analyst

    1 week ago


    Gleeson Recruitment Group London, United Kingdom

    A supporting role to deliver improved profitability to the Ecommerce business through the provision of insightful, accurate and timely financial reporting and modelling. · Main responsibilities · - Perform detailed profitability analysis of our Performance Marketing investments, ...

  • JPMorgan Chase Bank, N.A.

    Model Risk Quant

    1 week ago


    JPMorgan Chase Bank, N.A. London, United Kingdom

    The Model Risk Governance and Review Group (MRGR) oversees model risk at the firm, conducts independent model reviews and provides guidance around a model's appropriate usage. · As a model risk quant within MRGR Credit Portfolio team, you will carry out validation and governance ...