Sr. Software Engineer, Inference

  • Full Time
  • London
  • £225000 - £325000 per yearly USD / Year

Anthropic

Sr. Software Engineer, Inference Overview

Company Name Anthropic
Job Role Sr. Software Engineer, Inference
Qualifications Not Specified
Category IT Jobs
Job Type Full Time
Location London

Join a dynamic team at Anthropic, where our mission is to develop reliable, interpretable, and steerable AI systems that benefit users and society. Our Inference team plays a crucial role in delivering Claude to millions of users worldwide through advanced distributed systems.

Key Responsibilities

  • Design, develop, and maintain distributed systems that deliver Claude to millions of users globally.
  • Create resilient and adaptable systems that respond in real-time to real-world events.
  • Develop intelligent request routing, load balancing, and traffic management systems across thousands of AI accelerators.
  • Enhance compute efficiency across the fleet by implementing autoscaling and orchestrating production, research, and experimental workloads.
  • Build and manage production-grade deployment pipelines for the seamless release of new models to users.
  • Provide high-performance inference infrastructure that supports researchers in developing next-generation models.
  • Integrate new AI accelerator platforms and facilitate inference for new model architectures.

Minimum Qualifications

  • Proficiency in Python or Rust programming languages.
  • Experience in software engineering with a focus on building and operating distributed systems in a production environment.
  • Familiarity with containerized infrastructure, such as Kubernetes, and at least one major cloud platform (AWS, GCP, or Azure).
  • Results-driven mindset with a focus on flexibility and impactful outcomes.
  • Willingness to take on additional responsibilities beyond the standard job description.
  • Desire to expand knowledge in machine learning systems and infrastructure.
  • Ability to thrive in environments where technical excellence contributes to both business success and research advancements.
  • Awareness of the societal implications of your work.

Preferred Qualifications

  • Significant experience with high-performance, large-scale distributed systems.
  • Experience implementing and deploying machine learning systems at scale.
  • Experience building load balancing, request routing, or traffic management systems.
  • Familiarity with LLM inference optimization, batching, and caching strategies.
  • Deep experience operating Kubernetes and cloud infrastructure at scale.
  • Experience with AI accelerator platforms (GPUs, TPUs, or emerging hardware).

Compensation and Benefits

  • Annual salary between £225,000 and £325,000 GBP.
  • Generous vacation and parental leave policies.
  • Flexible working hours.
  • Optional equity donation matching.
  • Collaborative office environment.

We encourage applicants from all backgrounds to apply, even if they do not meet every qualification. Our team values diverse perspectives and aims to create a safe and inclusive workplace.

To apply, please submit your resume and cover letter through our application portal. We look forward to reviewing your application!


Degree Requirement: Not Specified

Visa Sponsorship Promising

To apply for this job please visit job-boards.greenhouse.io.