Software Engineer - AI Safety Institute

Department for Science, Innovation & Technology

Apply before 11:55 pm on Wednesday 28th August 2024



Reference number



£85,000 - £115,000
Base salary of between £42,495 (L4) - £55,805 (L5) which is supplemented with an allowance between £42,505 to £54,781
A Civil Service Pension with an average employer contribution of 27%

Job grade

L4, L5

Contract type

Fixed term
Temporary (not fair and open)

Length of employment

12 to 24 months

Business area

AI Safety Institute

Type of role

Information Technology

Working pattern

Flexible working, Full-time, Part-time

Number of jobs available




Job summary

The AI Safety Institute is the first state-backed organisation focused on advanced AI safety for the public interest. We launched at the AI Safety Summit because we believe taking responsible action on this extraordinary technology requires a capable and empowered group of technical experts within government.

Our staff includes senior alumni from OpenAI, Google DeepMind, start-ups and the UK government, and ML professors from Oxford and Cambridge. We are now calling on the world’s top technical talent to build the institute from the ground up. This is a truly unique opportunity to help shape AI safety at an international level.

We have ambitious goals and need to move fast.

Develop and conduct evaluations on advanced AI systems
We will characterise safety-relevant capabilities, understand the safety and security of systems, and assess their societal impacts.

Drive foundational AI safety research
We will launch moonshot research projects and convene world-class external researchers.

Facilitate information exchange
We will establish clear information-sharing channels between the Institute and other national and international actors. These include stakeholders such as policymakers and international partners.

Our Inclusive Environment
We are building an inclusive culture to make the Department a brilliant place to work where our people feel valued, have a voice and can be their authentic selves. We value difference and diversity, not only because we believe it is the right thing to do, but because it will help us be more innovative and make better decisions.

 What we Value:

  • Diverse Perspectives: We believe that a range of experiences and backgrounds is essential to our success. We welcome individuals from underrepresented groups to join us in this crucial mission.
  • Collaborative Spirit: We thrive on teamwork and open collaboration, valuing every contribution, big or small.
  • Innovation and Impact: We are dedicated to making a real-world difference in the field of frontier AI safety and capability, and we encourage innovative thinking and bold ideas.

Job description

About the Role

Our Platform Team is enabling our core work of evaluating cutting edge advanced AI Systems. This requires a mix of skills: Creating expert interfaces and highly accessible red-teaming frontends, providing fast and secure inference channels for internal and external models, as well as MLOps capabilities for hosting and fine-tuning our own models.

This is a cross-functional team that collaborates closely with scientists, domain experts, and research engineers to develop brand new evaluation tools that leverage emerging research, while maintaining high levels of privacy and security integrity.

We will be working with a mixture of our own custom and open-source evaluation, analysis and visualisation frameworks.

While much of our work will require prototyping and proving out completely new approaches, our expectation is to ultimately deliver a rock-solid core platform that the rest of AISI and our partners can depend on.


You will be expected to bring your own experience and opinions when it comes to software architecture, and the design of the user-facing parts of our evaluations platform.

On any given day you will be interacting with researchers, research engineers, UX designers or our operations team to define requirements; turn those requirements into designs, prototypes or production code in collaboration with other engineers; and make sure that our platform is bug-free, stable and covered with a solid amounts of tests to withstand the ever-increasing evaluation traffic.  All while ensuring privacy and security requirements of the highest standards.

We do not expect candidates to fulfil all these qualifications and we urge you to apply if you are inspired by this work.

Existing Civil Servants and applicants from accredited NDPBs are eligible to apply, but will only be considered on loan basis (Civil Servants) or secondment (accredited NDPBs). Prior agreement to be released on a loan basis must be obtained before commencing the application process. In the case of Civil Servants, the terms of the loan will be agreed between the home and host department and the Civil Servant. This includes grade on return.

Person specification

You will need experience in one or more of the following areas:

  • Frontend or Tools Development
  • Backend / API Design
  • DevOps / MLOps / ML Infrastructure
  • Privacy and Security Engineering
  • Engineering Management & Leadership

We welcome applications from candidates who are generalists.

This role may be a great fit if you:

  • Have substantial experience in building software systems to meet user requirements, managing increasing scale, and upholding high privacy and security standards.
  • Have led or been a significant contributor to relevant software projects, demonstrating cross-functional collaboration skills
  • Deeply care about the user experience of a diverse range of users, from machine learning researchers to domain experts, to wide and diverse groups of human evaluators
  • Build tools to accelerate not just users' but also your own workflows whenever off-the-shelf solutions are not readily available or good enough
  • Work autonomously and in a self-directed way with high agency, thriving in a constantly changing environment and a steadily growing team, while figuring out the best and most efficient ways to solve a particular problem
  • Bring your own voice and experience but also an eagerness to support your colleagues together with a willingness to do whatever is necessary for the team’s success and find new ways of getting things done within government
  • Have a sense of mission, urgency, and responsibility for success, demonstrating problem-solving abilities and preparedness to acquire any missing knowledge necessary to get the job done

Machine Learning:

  • We do not require you to have extensive expertise with AI Foundation Models. Familiarity with training, fine-tuning and running inference on cutting-edge large language models will be helpful but not required
  • While we are hiring specifically for our Platform Team, you will still have opportunities to embed with and work closely with our Research and Evaluation teams if this fits your interests and the needs of our projects

Core requirements

  • You should be able to spend at least 4 days per week on working with us
  • You should be able to join us for at least 12 months
  • You should be able work from our office in London (Whitehall) for parts of the week, but we provide flexibility for remote work
Alongside your salary of £85,000, Department for Science, Innovation & Technology contributes £11,473 towards you being a member of the Civil Service Defined Benefit Pension scheme. Find out what benefits a Civil Service Pension provides.

The Department for Science, Innovation and Technology offers a competitive mix of benefits including:

  • A culture of flexible working, such as job sharing, homeworking and compressed hours.
  • Automatic enrolment into the Civil Service Pension Scheme, with an average employer contribution of 27% of the base salary.
  • A minimum of 25 days of paid annual leave, increasing by 1 day per year up to a maximum of 30.
  • An extensive range of learning & professional development opportunities, which all staff are actively encouraged to pursue.
  • Access to a range of retail, travel and lifestyle employee discounts.
  • The Department operates a discretionary hybrid working policy, which provides for a combination of working hours from your place of work and from your home in the UK. The current expectation for staff is to attend the office or non-home based location for 40-60% of the time over the accounting period.

Selection process details

Application Process

To apply for this post, you will need to complete the online application process, this should be completed no later than Wednesday 28th August 2024 at 23:55 and will involve completing the sections in the online application outlined in this pack. 

We reserve the right to close this vacancy with a two week notice period. Please submit your application as early as possible to ensure that you are considered for the role.

To apply for this post, you will be required to provide your CV and a personal statement (500 word limit) setting out your answers to the questions below:-

  • Why are you interested in joining the AISI right now?
  • What are the most important technical projects UK government needs to undertake within the next few months to advance AI Safety?
  • What do you want to be doing to drive those projects forward?
  • Is there anything else about your skills, experience or background you’d like us to be aware of?

Sift and interview process

Candidates should expect to go through some or all of the following stages once an application has been submitted:-

Coding Test - To be completed within 72 hours 

Initial Interview

Technical take home test

Formal interview and review of take home test

Third stage interview

Final Stage interview

Sift and interview dates

Candidates will be sifted on an ad-hoc basis once your application has been submitted. If successful in first sift, we will contact you to arrange initial interviews or coding tests to be taken.

Reasonable Adjustment

We are proud to be a disability confident leader and we welcome applications from disabled candidates and candidates with long-term conditions.

We fully support adjustments throughout our recruitment process and we encourage candidates to discuss their adjustment needs by emailing the job contact which can be found under the contact point for applicants section.

We do not have an exhaustive list of adjustments that we support but just some examples include additional time to complete your application form, behaviour questions up to 72 hours prior to interview and having extra time at interview.

If you are experiencing accessibility problems with any attachments on this advert, please contact the email address in the 'Contact point for applicants' section.

If successful and transferring from another Government Department a criminal record check may be carried out.

New entrants are expected to join on the minimum of the pay band.

A location based reserve list of successful candidates will be kept for 12 months. Should another role become available within that period you may be offered this position.

Please note terms and conditions are attached. Please take time to read the document to determine how these may affect you.

Any move to the Department for Science, Innovation and Technology from another employer will mean you can no longer access childcare vouchers. This includes moves between government departments. You may however be eligible for other government schemes, including Tax Free Childcare. Determine your eligibility

DSIT does not normally offer full home working (i.e. working at home); but we do offer a variety of flexible working options (including occasionally working from home). 

In order to process applications without delay, we will be sending a Criminal Record Check to Disclosure and Barring Service on your behalf.

However, we recognise in exceptional circumstances some candidates will want to send their completed forms direct. If you will be doing this, please advise Government Recruitment Service of your intention by emailing stating the job reference number in the subject heading. 

Applicants who are successful at interview will be, as part of pre-employment screening, subject to a check on the Internal Fraud Database (IFD). This check will provide information about employees who have been dismissed for fraud or dishonesty offences. This check also applies to employees who resign or otherwise leave before being dismissed for fraud or dishonesty had their employment continued. Any applicant’s details held on the IFD will be refused employment. 

A candidate is not eligible to apply for a role within the Civil Service if the application is made within a 5 year period following a dismissal for carrying out internal fraud against government.

Nationality Requirements

If you do not meet the standard nationality requirements as detailed below, then we would still encourage you to submit an application.  We may be able to explore other options such as seconding you in from either your current employer or a third party organisation.

Not meeting the nationality rules set out below should not be seen as an automatic barrier to applying for this role.


Feedback will only be provided if you attend an interview or assessment.


Successful candidates must undergo a criminal record check.
People working with government assets must complete baseline personnel security standard (opens in new window) checks.

Nationality requirements

This job is broadly open to the following groups:

  • UK nationals
  • nationals of the Republic of Ireland
  • nationals of Commonwealth countries who have the right to work in the UK
  • nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities with settled or pre-settled status under the European Union Settlement Scheme (EUSS) (opens in a new window)
  • nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities who have made a valid application for settled or pre-settled status under the European Union Settlement Scheme (EUSS)
  • individuals with limited leave to remain or indefinite leave to remain who were eligible to apply for EUSS on or before 31 December 2020
  • Turkish nationals, and certain family members of Turkish nationals, who have accrued the right to work in the Civil Service
Further information on nationality requirements (opens in a new window)

Working for the Civil Service

The Civil Service Code (opens in a new window) sets out the standards of behaviour expected of civil servants.

We recruit by merit on the basis of fair and open competition, as outlined in the Civil Service Commission's recruitment principles (opens in a new window).
The Civil Service embraces diversity and promotes equal opportunities. As such, we run a Disability Confident Scheme (DCS) for candidates with disabilities who meet the minimum selection criteria.
This vacancy is part of the Great Place to Work for Veterans (opens in a new window) initiative.
Once this job has closed, the job advert will no longer be available. You may want to save a copy for your records.

Contact point for applicants

Job contact :

  • Name :
  • Email :

Recruitment team

  • Email :

Further information

Appointment to the Civil Service is governed by the Civil Service Commission’s Recruitment Principles. If you feel that your application has not been treated in accordance with the recruitment principles, and wish to make a complaint, then you should contact in the first instance . If you are not satisfied with the response that you receive, then you can contact the Civil Service Commission. For further information on bringing a complaint to the Civil Service Commission please visit their web pages: Click here to visit Civil Service Commission/Complaints


DSIT T&Cs v1.2 Opens in new window (docx, 179kB)

Share this page