Jobs
>
London

    Research Scientist - London, United Kingdom - UK Civil Service

    UK Civil Service
    UK Civil Service London, United Kingdom

    1 day ago

    Default job background
    Description

    Job summary

    The AI Safety Institute is the first state-backed organisation focused on advanced AI safety for the public interest.� We launched at the AI Safety Summit because we believe taking responsible action on this extraordinary technology requires a capable and empowered group of technical experts within government.

    Our staff includes senior alumni from OpenAI, Google DeepMind, start-ups and the UK government, and ML professors from Oxford and Cambridge.� We are now calling on the world�s top technical talent to build the institute from the ground up.� This is a truly unique opportunity to help shape AI safety at an international level.

    We have ambitious goals and need to move fast.

    Develop and conduct evaluations on advanced AI systems
    We will characterise safety-relevant capabilities, understand the safety and security of systems, and assess their societal impacts.

    Drive foundational AI safety research
    We will launch moonshot research projects and convene world-class external researchers.

    Facilitate information exchange
    We will establish clear information-sharing channels between the Institute and other national and international actors. These include stakeholders such as policymakers and international partners.

    Our Inclusive Environment
    We are building an inclusive culture to make the Department a brilliant place to work where our people feel valued, have a voice and can be their authentic selves. We value difference and diversity, not only because we believe it is the right thing to do, but because it will help us be more innovative and make better decisions.

    �What we Value:

  • Diverse Perspectives:�We believe that a range of experiences and backgrounds is essential to our success. We welcome individuals from underrepresented groups to join us in this crucial mission.
  • Collaborative Spirit:�We thrive on teamwork and open collaboration, valuing every contribution, big or small.
  • Innovation and Impact:�We are dedicated to making a real-world difference in the field of frontier AI safety and capability, and we encourage innovative thinking and bold ideas.

    • Job description

    About the Role

    As a Research Scientist at AISI, your work will help to set directions for AI system evaluations and to establish robust evaluation frameworks for AI systems.� You will lead and contribute to projects designed to be integrated into our evaluation suite, evaluating advanced model capabilities and safeguards, as well as more speculative work aimed at mitigations and system understanding.�

    We draw on a wide range of disciplines, and value a diversity of research expertise across our five workstreams. You will be primarily associated with one of our workstreams (please specify in your application which you�re most interested in), however, sometimes your work will intersect multiple workstreams.

    Workstreams:

  • Chem/bio: studying how LLMs and more specialised AI systems are advancing biological and chemical capabilities relating to harmful outcomes.� This includes potential uplift to novice actors and future scenarios like design of biological agents
  • Cyber misuse: studying how LLMs and more specialised AI systems may aid in cyber-criminality and the adequacy of cybersecurity measures against AI systems
  • Safeguards: evaluating the strength and efficacy of safety and security components of advanced AI systems against diverse threats which could circumvent safeguards
  • Societal impacts: evaluating a range of impacts of advanced models that could have widespread implications for our societal fabric ( undermining trust in information, psychological wellbeing, cognitive wellbeing, unequal outcomes)
  • Autonomous systems: Testing for precursors to loss of control by measuring relevant capabilities in long-horizon computer-based tasks. Examples are sub-tasks of autonomous replication, AI development and self-improvement, as well as adaptation to human attempts to intervene and the ability to profitably interact with and manipulate humans. This includes trajectories that start from a misuse event as well as cases of misalignment.

    • You will work closely with the Workstream Lead, Research Engineers and other Research Scientists, as well as benefit from support from our cross-functional Platform Team.� You will also collaborate with external topic-level experts, contractors, partner organisations and policy makers to coordinate and build on external research.

    There will be significant scope to contribute to the strategy of your workstream team and to design experiments with set-ups of increasing complexity.

    Existing Civil Servants and applicants from accredited NDPBs are eligible to apply, but will only be considered on loan basis (Civil Servants) or secondment (accredited NDPBs). Prior agreement to be released on a loan basis must be obtained before commencing the application process. In the case of Civil Servants, the terms of the loan will be agreed between the home and host department and the Civil Servant. This includes grade on return.

    Person specification

    For this role, you will likely have conducted ML research, research in a domain relevant to your primary workstream, or research at the intersection of your domain and frontier AI systems.

    We expect experts in both ML and a specific domain relevant to one of our workstreams to be rare, so we encourage you to apply no matter which research expertise you�re excited to bring to the institute.�

    We look for some of the following skills, experience and attitudes:

  • PhD or equivalent research experience in a field related to your workstream, or in machine learning
  • Strong Python skills and at least basic machine learning experience
  • Experience with large language models, potentially related to prompt engineering, tooling, or fine tuning
  • Statistics expertise (, coding in R for power calculations and statistical testing)
  • Possess a strong curiosity in understanding AI systems and studying the security implications of this technology
  • Motivated to conduct research that is not only curiosity driven but also solves concrete open questions in governance and policy making
  • Work autonomously and in a self-directed way with high agency,�thriving in a constantly changing environment and a steadily growing team, while figuring out the best and most efficient ways to solve a particular problem
  • Bring your own voice and experience but also an eagerness to support your colleagues together with a willingness to do whatever is necessary for the team�s success and find new ways of getting things done within government
  • Have a sense of mission, urgency, and responsibility for success,�demonstrating problem-solving abilities and preparedness to acquire any missing knowledge necessary to get the job done

    • Given the changing nature of the field, it�s most of all important to us to build a team with strong problem-solving skills and a preparedness to acquire any missing knowledge necessary to get the job done.

    Owing to the rapid shaping of the field of advanced AI, you will likely be up to date with the latest advancements in advanced AI development.

    Core requirements

  • You should be able to spend at least 4 days per week on working with us
  • You should be able to join us for at least 12 months
  • You should be able work from our office in London (Whitehall) for parts of the week, but we provide flexibility for remote work

    • Benefits

    Alongside your salary of �85,000, Department for Science, Innovation & Technology contributes �11,473 towards you being a member of the Civil Service Defined Benefit Pension scheme.

    The Department for Science, Innovation and Technology offers a competitive mix of benefits including:

  • A culture of flexible working, such as job sharing, homeworking and compressed hours.
  • Automatic enrolment into the , with an average employer contribution of 27% of the base salary.
  • A minimum of 25 days of paid annual leave, increasing by 1 day per year up to a maximum of 30.
  • An extensive range of learning & professional development opportunities, which all staff are actively encouraged to pursue.
  • Access to a range of retail, travel and lifestyle employee discounts.
  • The Department operates a discretionary hybrid working policy, which provides for a combination of working hours from your place of work and from your home in the UK. The current expectation for staff is to attend the office or non-home based location for 40-60% of the time over the accounting period.
  • S3 Science

    Research Scientist

    6 days ago

    S3 Science London, United Kingdom

    Our client is in a phase of rapid expansion and are looking to grow its Research and Discovery group by recruiting a Preclinical Scientist. The Research & Discovery Department is working on ground-breaking science in the rare disease field. · **The Role**: · The role will specifi ...

  • VRS Recruitment

    Research Scientist

    1 week ago

    VRS Recruitment London, United Kingdom

    Exciting opportunity to work with a successful pharmaceutical company, at the cutting edge of pharmaceutical development. · As a key member of the team you will be responsible for designing, developing and running LC-MS methods to quantify proteins in _in vitro_ and _in vivo_ sam ...

  • JPMorgan Chase Bank, N.A.

    Ai Research Scientist

    3 days ago

    JPMorgan Chase Bank, N.A. London, United Kingdom

    The goal of J.P. Morgan AI Research is to explore and advance cutting-edge research in AI, to develop and discover principles of impact to J.P. Morgan's clients and businesses. · We seek to hire researchers to develop novel optimization techniques, tools, and frameworks to model ...

  • Meta

    Research Scientist Intern, Responsible Ai

    1 week ago

    Meta London, United Kingdom

    Meta was built to help people connect and share, and over the last decade our tools have played a critical part in changing how people around the world communicate with one another. With over a billion people using the service and more than fifty offices around the globe, a caree ...

  • Spotify

    Summer Internship, Research Scientist Intern

    2 days ago

    Spotify London, United Kingdom InternshipSHIP

    Students- Spotify has more than 400M listeners in more than 180 markets around the world, who use our music, podcast, and audiobook services to find what delights, entertains, educates, and informs them. Personalization provides the technology to serve them what they expect to fi ...

  • Stealth AI Startup

    Research Scientist

    6 days ago

    Stealth AI Startup London, United Kingdom

    Job Description · Join Us in Pioneering the Future of Generative AI for Speech and Audio · Are you ready to be at the forefront of groundbreaking technology in generative AI? Our early-stage start-up seeks a talented and ambitious Research Scientist to join our dynamic team. If ...

  • Understanding Recruitment

    Research Scientist

    1 week ago

    Understanding Recruitment London, United Kingdom

    Research ScientistHow will your next-level research transform worldwide safety?We are looking for a Research Scientist to join this central Oxford AI team that focuses on the latest technology, including technology to create superhuman perception using camera arrays. As a Researc ...

  • MSACL Connect

    Research Scientist

    6 days ago

    MSACL Connect London, United Kingdom

    Translating Pre-Clinical Research to Clinical Patient Care · The vitamin D metabolism mass spectrometry group is recruiting a Postdoctoral Research Scientist to design and conduct research projects in our recently established analytical chemistry translational endocrinology labo ...

  • Quantum Flagship

    Research Scientist

    6 days ago

    Quantum Flagship London, United Kingdom

    Research Scientist Applied Quantum Algorithms · Our team is leading the development, implementation, and application of quantum algorithms to computational problems of practical interest. We are seeking a research scientist with experience in designing and implementing quantum a ...

  • COL Limited

    Research Scientists

    6 days ago

    COL Limited London, United Kingdom

    Please note that due to a high volume of very talented applicants, there may be a lag of several weeks between submission and follow-up from Apollo Research on your application. In the long run, we aim to explain and perhaps reverse engineer arbitrary mechanisms of arbitrary neur ...

  • Google

    Research Scientist

    1 week ago

    Google London, United Kingdom

    PhD degree in Computer Science, a related field, or equivalent practical experience. · Candidates will typically have 2 years of experience leading a research agenda. · One or more scientific publication submission(s) for conferences, journals, or public repositories. · Candid ...

  • Professor Doctor Obi

    Research Scientist

    1 day ago

    Professor Doctor Obi London, United Kingdom

    The Quantitative Stem Cell Biology lab, headed by Dr Silvia Santos, is seeking a Senior Laboratory Research Scientist (SLRS). The postholder will drive a research project and contribute to collaborative projects within the lab. · The Quantitative Stem Cell Biology lab, headed by ...

  • Energy Jobline CVL

    Research Scientist

    1 week ago

    Energy Jobline CVL London, United Kingdom

    Permanent Position – Part Time · Competitive Salary · My client is focussed on redefining how we look at animal health. They are combining bioinformatic AI with cutting-edge research to investigate and identify gaps in the gut microbiome. · Due to continued growth, they are lo ...

  • Hyper Recruitment Solutions Ltd

    Research Scientist

    6 days ago

    Hyper Recruitment Solutions Ltd England, United Kingdom

    As the Metabolite Identification Scientist you will be responsible for leading the delivery of metabolite characterisation studies in support of human or animal health drug discovery. · You will be responsible for the training of others to perform all aspects of metabolite chara ...

  • Abs Data

    Research Scientists

    3 days ago

    Abs Data London, United Kingdom

    Research Scientist/Engineer, Empirical Scientific Approaches in Global · Business DivisionsInvestment Bank Your role Do you want to apply your expertise in coding to propel hypothesis-driven empirical research? We're looking for a Research Scientist/Engineer to: · build tools a ...

  • Notpla Limited

    Research Scientist

    2 weeks ago

    Notpla Limited London, United Kingdom

    The Role · At Notpla, we create disappearing packaging carefully engineered for a healthy planet. Founded on the belief that nature knows best, we're an innovative, ideas and action-oriented scale-up developing and manufacturing packaging solutions from seaweed and plants that d ...

  • Quadram Institute

    Research Scientist

    6 days ago

    Quadram Institute United Kingdom

    This includes conducting MPS-based projects for academic and commercial research; developing advanced MPS and OOAC models to support QIB science in the area of food, microbiome and host interactions; providing training/supervision to QIB staff and students; The post-holder will w ...

  • CK Group- Science, Clinical and Technical

    Research Scientist

    6 days ago

    CK Group- Science, Clinical and Technical London, United Kingdom

    CK Group are working in partnership with a leading UK life sciences biotechnology company to recruit an experienced Principal Scientist with expert virology knowledge, to join them at their site based in East London on a permanent basis. · Provide scientific expertise, leadershi ...

  • Google DeepMind

    Research Scientists at

    6 days ago

    Google DeepMind London, United Kingdom

    Job Application for Research Scientists at Google DeepMind at DeepMind · Research Scientists at Google DeepMind · London, UK Snapshot · If you are interested in a career as a Research Scientist at Google DeepMind, and thrive on pushing boundaries and achieving ambitious goa ...

  • Orchard Therapeutics

    Scientist: Research

    2 weeks ago

    Orchard Therapeutics London, United Kingdom

    Principal Scientist, Cell and Gene Technical Development · This is an exciting opportunity for a well-qualified candidate to join an international company focused on transforming the lives of patients with rare disorders through innovative gene therapies. · OTL) is looking for ...