Jobs
>
London

    Research Engineer - London, United Kingdom - UK Civil Service

    Default job background
    Description

    Job summary

    The AI Safety Institute is the first state-backed organisation focused on advanced AI safety for the public interest.� We launched at the AI Safety Summit because we believe taking responsible action on this extraordinary technology requires a capable and empowered group of technical experts within government.

    Our staff includes senior alumni from OpenAI, Google DeepMind, start-ups and the UK government, and ML professors from Oxford and Cambridge.� We are now calling on the world�s top technical talent to build the institute from the ground up.� This is a truly unique opportunity to help shape AI safety at an international level.

    We have ambitious goals and need to move fast.

    Develop and conduct evaluations on advanced AI systems
    We will characterise safety-relevant capabilities, understand the safety and security of systems, and assess their societal impacts.

    Drive foundational AI safety research
    We will launch moonshot research projects and convene world-class external researchers.

    Facilitate information exchange
    We will establish clear information-sharing channels between the Institute and other national and international actors. These include stakeholders such as policymakers and international partners.

    Our Inclusive Environment
    We are building an inclusive culture to make the Department a brilliant place to work where our people feel valued, have a voice and can be their authentic selves. We value difference and diversity, not only because we believe it is the right thing to do, but because it will help us be more innovative and make better decisions.

    What we Value:

  • Diverse Perspectives:�We believe that a range of experiences and backgrounds is essential to our success. We welcome individuals from underrepresented groups to join us in this crucial mission.
  • Collaborative Spirit:�We thrive on teamwork and open collaboration, valuing every contribution, big or small.
  • Innovation and Impact:�We are dedicated to making a real-world difference in the field of frontier AI safety and capability, and we encourage innovative thinking and bold ideas.
  • Job description

    About the Role

    Research Engineers build and maintain scientific software to enable high quality research.� They are uniquely placed to bridge the world of software engineering and research, and at the AI Safety Institute will be involved in challenging and diverse projects at the cutting edge of advanced AI development.

    As a Research Engineer you will either be embedded within one or more of our research teams, or you will sit in a cross-cutting group of Research Engineers within the Platform Team.

    In either case you will be collaborating with research scientists and people running evaluations and user studies on the one hand, and with our Platform Team on the other.� You might also on-board, run and improve existing evaluations from the wider research community, as well as up-scaling new evaluation methods developed in-house.

    We draw on a wide range of disciplines, and value a diversity of research expertise across our five workstreams. You will be primarily associated with one of our workstreams (please specify in your application which you�re most interested in), however, sometimes your work will intersect multiple workstreams.

  • Chem/bio: studying how LLMs and more specialised AI systems are advancing biological and chemical capabilities relating to harmful outcomes.� This includes potential uplift to novice actors and future scenarios like design of biological agents
  • Cyber misuse: studying how LLMs and more specialised AI systems may aid in cyber-criminality and the adequacy of cybersecurity measures against AI systems
  • Safeguards: evaluating the strength and efficacy of safety and security components of advanced AI systems against diverse threats which could circumvent safeguards
  • Societal impacts: evaluating a range of impacts of advanced models that could have widespread implications for our societal fabric ( undermining trust in information, psychological wellbeing, cognitive wellbeing, unequal outcomes)
  • Autonomous systems: Testing for precursors to loss of control by measuring relevant capabilities in long-horizon computer-based tasks. Examples are sub-tasks of autonomous replication, AI development and self-improvement, as well as adaptation to human attempts to intervene and the ability to profitably interact with and manipulate humans. This includes trajectories that start from a misuse event as well as cases of misalignment.
  • The Platform Team will be providing the foundational infrastructure for our research projects.� You will build on top of our platform to create bespoke, load-bearing infrastructure and tools for individual research projects.� You will be able to independently run and analyse your own experiments to diagnose problems and understand our research work and tech stack in detail.

    You will spend your time working not just on infrastructure code but also in the planning and execution of research projects, such as a wide range of evaluations of cutting-edge AI systems.� This includes working on analysing and visualising the outcomes of complex evaluation or fine-tuning procedures and managing large data sets.

    As a research engineer it is your responsibility to make the hard trade-offs between when code needs to be load-bearing enough to support multiple experiments and when it is better to write �good enough" code to quickly prove or disprove a hypothesis.

    In this you will work very closely with our Research Scientists who will often be the main users for the tools you build.

    Existing Civil Servants and applicants from accredited NDPBs are eligible to apply, but will only be considered on loan basis (Civil Servants) or secondment (accredited NDPBs). Prior agreement to be released on a loan basis must be obtained before commencing the application process. In the case of Civil Servants, the terms of the loan will be agreed between the home and host department and the Civil Servant. This includes grade on return.

    Person specification

    This role may be a great fit if you:

  • Have excellent knowledge of training, fine-tuning, scaffolding, prompting, deploying, and/or evaluating current cutting-edge machine learning systems such as large language models
  • Have substantial experience working in a similar role in industry, relevant open-source collectives, or academia
  • Have experience conducting your own research, but most importantly as part of a cross-functional team
  • Possess a strong curiosity in understanding AI systems�and have the ability to develop data collection, analysis and visualization interfaces to do so
  • Have substantial experience in building software systems to meet research requirementsand have led or been a significant contributor to relevant software projects, demonstrating cross-functional collaboration skills
  • Deeply care about the user experience of a diverse range of users, from machine learning researchers to domain experts, to wide and diverse groups of human evaluators
  • Work autonomously and in a self-directed way with high agency, thriving in a constantly changing environment and a steadily growing team, while figuring out the best and most efficient ways to solve a particular problem
  • Bring your own voice and experiencebut also an eagerness to support your colleagues together with a willingness to do whatever is necessary for the team�s success and find new ways of getting things done within government
  • Have a sense of mission, urgency, and responsibility for success,�demonstrating problem-solving abilities and preparedness to acquire any missing knowledge necessary to get the job done
  • Core requirements

  • You should be able to spend at least 4 days per week on working with us
  • You should be able to join us for at least 12 months
  • You should be able work from our office in London (Whitehall) for parts of the week, but we provide flexibility for remote work
  • Benefits

    Alongside your salary of �85,000, Department for Science, Innovation & Technology contributes �11,473 towards you being a member of the Civil Service Defined Benefit Pension scheme.

    The Department for Science, Innovation and Technology offers a competitive mix of benefits including:

  • A culture of flexible working, such as job sharing, homeworking and compressed hours.
  • Automatic enrolment into the , with an average employer contribution of 27% of the base salary.
  • A minimum of 25 days of paid annual leave, increasing by 1 day per year up to a maximum of 30.
  • An extensive range of learning & professional development opportunities, which all staff are actively encouraged to pursue.
  • Access to a range of retail, travel and lifestyle employee discounts.
  • The Department operates a discretionary hybrid working policy, which provides for a combination of working hours from your place of work and from your home in the UK. The current expectation for staff is to attend the office or non-home based location for 40-60% of the time over the accounting period.


  • Venn Group London, United Kingdom

    **Research Systems Engineer · Agency Reference Number: 46713** · Venn Group is working exclusively with a prestigious University who are recruiting for Research Systems Engineer who will help support the research computing team in their mobilization of projects and enhancing thei ...


  • ADLIB London, United Kingdom

    **Pioneering tech company with world-leading technology.**: · - **Work on exciting projects in progressive tech-driven environment.**: · - **Collaborative research teams working on high impact projects.** · A pioneering tech company working in the world of natural language proces ...


  • eFinancialCareers London, United Kingdom

    Financial information drives the markets and Bloomberg has a wide variety and diverse set of information sources available on its flagship product - The Bloomberg Terminal. This includes structured content such as market ticks or company fundamentals data,as well as semi-structur ...


  • eFinancialCareers London, United Kingdom

    Textual data is key to understanding how events in the world impact our clients. As the amount of unstructured data has increased, natural language processing has become a key tool for Bloomberg to deliver analytics faster, more accurately, and at a largerscale than ever before. ...


  • Broster Buchanan Ltd London, United Kingdom

    The role: · - Developing all different aspects of the Gateway and Technology Ecosystem including · - Search, Content Management, APIs, Visualisations and Integrations · - Working to an agile methodology · - Working in sprints · - Documenting code, conducting code reviews for the ...


  • Experis LTD London, United Kingdom

    **Senior Research Software Development Engineer** · As the Senior Research Software Development Engineer, you'll be in the prime position to impact the design of this exciting new storage system by supporting the development of the software driving the system. · Working with a gl ...

  • DeepRec

    Research Engineer

    12 hours ago


    DeepRec London, United Kingdom

    Job Description · Join a leader in generative AI technologies, who have recently secured Series A funding to advance our work in digital avatars and human clones. · Role: Research Engineer · Location: London · Salary: Up to £80,000 · Innovation in Product Development: Utilize yo ...

  • DeepRec

    Research Engineer

    2 days ago


    DeepRec United Kingdom

    Join a leader in generative AI technologies, who have recently secured Series A funding to advance our work in digital avatars and human clones. · Role: Research Engineer · Location: London · Salary: Up to £80,000 · Innovation in Product Development: Utilize your expertise in ...

  • Enigma (formerly DS Group)

    Research Engineer

    4 days ago


    Enigma (formerly DS Group) London, United Kingdom

    Job Description · Research Scientist - Diffusion - Machine Learning - ML - AI Models - Protein Biology - Python - London - Hybrid · Research Engineer (Diffusion) · Company Summary · At an innovative company in the intersection of AI and biology, there is an exciting opportunity ...

  • Seabound

    Research Engineer

    6 days ago


    Seabound United Kingdom

    Background · The shipping industry is notoriously difficult to decarbonize, accounting for ~3% of global CO2 emissions. If it were a country, it would be the 6th largest emitter in the world (ranking just above Germany). · Recent global regulations from the International Mariti ...

  • Heyne Tillett Steel

    Research Engineers

    2 days ago


    Heyne Tillett Steel London, United Kingdom

    Heyne Tillett Steel is an award-winning structural and civil engineering practice with a reputation for intelligent design and innovative, practical and sustainable solutions. We are currently working on exciting and innovative projects throughout the UK for many leading develope ...

  • MBN Solutions

    Research Engineer

    6 days ago


    MBN Solutions United Kingdom

    Senior Research Engineer – Startup LLM - £130k +equity – Remote (UK/EU) · Are you passionate about building groundbreaking technology and shaping the future of AI? · We're tackling this challenge by building a decentralized marketplace for compute power specifically designed for ...

  • Science Solutions Recruitment

    Research Engineers

    6 days ago


    Science Solutions Recruitment England, United Kingdom

    As a global leader in chemicals and biotechnology, this is an exciting opportunity to join their Biotechnology division to be a part of the growth towards sustainabilty. · They currently have an exciting opportunity for a Research Scientist to join the Biotechnology department, ...

  • Oxford Knight

    Research Engineer

    1 week ago


    Oxford Knight London, United Kingdom Full time

    Summary · Unique trading firm that uses world-class technology to generate and implement outstanding research ideas, underpinned by a truly collaborative culture. Looking for a talented Research Engineer to research, test and deploy new trading strategies, as well as designing a ...

  • Algo Capital Group

    Research Engineers

    3 days ago


    Algo Capital Group London, United Kingdom

    Quantitative Research Engineer - Market Microstructure · Our client is a leading Hedge Fund headquartered in London and is seeking a Quantitative Research Engineer to join their equities trading desk. The firms team integrates innovative technology and trading strategies, while ...

  • Autodesk, Inc.

    Research Engineers

    5 days ago


    Autodesk, Inc. London, United Kingdom

    Research Engineer, Machine Learning Geometry page is loaded Research Engineer, Machine Learning Geometry · Apply locations London, GBR time type Full time posted on Posted 2 Days Ago job requisition id 24WD78057 Job Requisition ID # · 24WD78057 Position Overview · The work we d ...


  • Workingmums United Kingdom

    Research Engineering & Maintenance Coordinator · Vacancy: Research Engineering & Maintenance Coordinator · Location: Billingham Job Family: Admin As the Research Engineering & Maintenance Coordinator you will manage the development, implementation and accuracy of engineering sy ...

  • RoEx

    Research Engineer

    6 days ago


    RoEx London, United Kingdom

    Job Title: Research Engineer · Location: London, UK (Hybrid) · RoEx specialises in AI-powered mixing, mastering and audio enhancement software for the creative industries, offering products like Automix and Mix Check Studio. We aim to do for music production what Instagram filte ...

  • RoEx

    Research Engineer

    6 days ago


    RoEx London, United Kingdom

    Job Description · Job Title: Research Engineer · Company: RoEx - · Location: London, UK (Hybrid) · Company Description: · RoEx specialises in AI-powered mixing, mastering and audio enhancement software for the creative industries, offering products like Automix and Mix Check S ...

  • Atla Ai

    Research Engineer

    1 day ago


    Atla Ai London, United Kingdom

    Atla is committed to engineering safe, beneficial AI systems that will have a massive positive impact on the future of humanity. We are a London-based start-up building the most capable AI evaluation models. Become part of our growing world-class team, backed by Y Combinator, Cre ...