Sr. Software Engineer, Inference
Anthropic
Sr. Software Engineer, Inference Overview
| Company Name | Anthropic |
| Job Role | Sr. Software Engineer, Inference |
| Qualifications | Not Specified |
| Category | IT Jobs |
| Job Type | Full Time |
| Location | London |
Join a dynamic team at Anthropic, where our mission is to develop reliable, interpretable, and steerable AI systems that benefit users and society. Our Inference team plays a crucial role in delivering Claude to millions of users worldwide through advanced distributed systems.
Key Responsibilities
- Design, develop, and maintain distributed systems that deliver Claude to millions of users globally.
- Create resilient and adaptable systems that respond in real-time to real-world events.
- Develop intelligent request routing, load balancing, and traffic management systems across thousands of AI accelerators.
- Enhance compute efficiency across the fleet by implementing autoscaling and orchestrating production, research, and experimental workloads.
- Build and manage production-grade deployment pipelines for the seamless release of new models to users.
- Provide high-performance inference infrastructure that supports researchers in developing next-generation models.
- Integrate new AI accelerator platforms and facilitate inference for new model architectures.
Minimum Qualifications
- Proficiency in Python or Rust programming languages.
- Experience in software engineering with a focus on building and operating distributed systems in a production environment.
- Familiarity with containerized infrastructure, such as Kubernetes, and at least one major cloud platform (AWS, GCP, or Azure).
- Results-driven mindset with a focus on flexibility and impactful outcomes.
- Willingness to take on additional responsibilities beyond the standard job description.
- Desire to expand knowledge in machine learning systems and infrastructure.
- Ability to thrive in environments where technical excellence contributes to both business success and research advancements.
- Awareness of the societal implications of your work.
Preferred Qualifications
- Significant experience with high-performance, large-scale distributed systems.
- Experience implementing and deploying machine learning systems at scale.
- Experience building load balancing, request routing, or traffic management systems.
- Familiarity with LLM inference optimization, batching, and caching strategies.
- Deep experience operating Kubernetes and cloud infrastructure at scale.
- Experience with AI accelerator platforms (GPUs, TPUs, or emerging hardware).
Compensation and Benefits
- Annual salary between £225,000 and £325,000 GBP.
- Generous vacation and parental leave policies.
- Flexible working hours.
- Optional equity donation matching.
- Collaborative office environment.
We encourage applicants from all backgrounds to apply, even if they do not meet every qualification. Our team values diverse perspectives and aims to create a safe and inclusive workplace.
To apply, please submit your resume and cover letter through our application portal. We look forward to reviewing your application!
Degree Requirement: Not Specified
Visa Sponsorship Promising
To apply for this job please visit job-boards.greenhouse.io.