Staff Software Engineer, AI Reliability Engineering

Anthropic

Staff Software Engineer, AI Reliability Engineering Overview

Company Name Anthropic
Job Role Staff Software Engineer, AI Reliability Engineering
Qualifications Bachelor’s
Category IT Jobs
Job Type Full Time
Location London

Anthropic is seeking a highly skilled Staff Software Engineer specializing in AI Reliability Engineering to join their team in London. The primary focus of this role is to ensure the robustness, resilience, and safety of Anthropic’s AI systems, particularly the Claude language model, by working across various teams to improve system reliability and incident response capabilities.

About the Role

The AI Reliability Engineering (AIRE) team collaborates closely with multiple departments to enhance the dependability of critical AI serving pathways. This involves working on everything from SDK interactions to network layers, API infrastructure, and hardware accelerators. The engineer will help develop service level objectives that balance system availability with latency, design and implement comprehensive monitoring solutions, and support high-availability infrastructure across multiple regions and cloud providers. During incidents, the engineer will lead response efforts, ensuring rapid recovery and thorough post-incident analysis. Additionally, they will support the safety-critical aspects of model serving, which are essential for both operational reliability and Anthropic’s safety commitments.

Key Responsibilities

  • Develop and refine Service Level Objectives for large language model deployment systems, ensuring a balance between system uptime, response speed, and development agility.
  • Create and maintain monitoring and observability tools to track system health and performance throughout the token processing pipeline.
  • Design and help implement high-availability serving infrastructure that spans multiple geographic regions and cloud platforms to ensure system resilience.
  • Lead incident management efforts for critical AI services, coordinating swift responses, conducting incident reviews, and implementing improvements to prevent recurrence.
  • Support the reliability and safety of safeguard models that are crucial for system security and ethical commitments.

Candidate Profile

  • Strong background in distributed systems, infrastructure, or reliability engineering, with a focus on building dependable software solutions.
  • Curious and brave, comfortable engaging with unfamiliar systems during incidents and assisting in resolution efforts even without extensive prior knowledge.
  • Ability to think holistically about system architecture, identifying potential failure points and system seams.
  • Excellent at building collaborative relationships across teams, fostering a team-oriented environment rather than acting as an outsider.
  • Ownership mindset with a focus on user impact and system outcomes, even for systems not directly under their control.
  • Exceptional communication skills to partner effectively across departments and articulate technical concepts clearly.
  • Diverse experience in building product stacks, scaling databases, managing large distributed systems, or related fields.
  • Preferred experience includes roles as an SRE, Production Engineer, or similar reliability-focused positions on large-scale systems.
  • Experience operating large-scale model serving or training infrastructure involving over 1000 GPUs.
  • Knowledge of ML hardware accelerators such as GPUs, TPUs, or Trainium, and familiarity with ML-specific networking technologies like RDMA and InfiniBand.
  • Expertise in AI-specific observability tools and frameworks, with experience in chaos engineering and resilience testing.
  • Contributions to open-source infrastructure or ML tooling are a plus.

Compensation and Benefits

The annual salary for this role ranges from £325,000 to £390,000 GBP, reflecting the seniority and expertise required. The company offers a hybrid working model, requiring staff to be in the office at least 25% of the time, with some roles possibly needing more in-person presence. Benefits include competitive pay, generous vacation and parental leave, flexible working hours, and optional equity donation matching. The companyâ??s London office provides a collaborative environment for team members.

Additional Information

Anthropic is committed to diversity and inclusion, encouraging candidates from underrepresented groups to apply. They emphasize that not all candidates will meet every qualification but value diverse experiences and perspectives. The company also prioritizes safety and transparency, with clear communication about the application process and visa sponsorship policies.

Applicants are advised to apply via the official channels, ensuring their eligibility for visa sponsorship if needed. The company states that they will make reasonable efforts to secure visas for successful candidates and employ legal support for immigration processes.

Anthropic is a research-focused organization dedicated to developing safe, interpretable, and steerable AI systems. They value impact-driven work, collaboration, and scientific rigor, aiming to advance AI safety and trustworthiness through empirical research and large-scale efforts.


Degree Requirement: Bachelor’s

Visa Sponsorship Promising

To apply for this job please visit job-boards.greenhouse.io.