Senior Software Engineer

Senior Software Engineer Overview

A well-funded AI engineering organization is seeking a Senior Software Engineer to join their team in Cambridge, England. This role involves deploying, extending, and optimizing a leading open-source LLM inference engine across two key programs: a scaling inference initiative and a high-assurance/regulated-environment initiative.

Responsibilities

• Deploy, instrument, and monitor open-weight models served via the inference engine.
• Build new engine features to support novel hardware architectures.
• Extend the engine for accuracy, explainability, and accountability in regulated settings.
• Contribute upstream to the relevant open-source community.
• Optimize inference performance focusing on latency, throughput, and hardware utilization.

Requirements

• Senior-level experience in Python and low-level programming languages such as C, C++, Rust, or CUDA.
• Direct contributions to a major inference or serving engine or similar machine learning infrastructure project (e.g., PyTorch, Ray).
• Strong grasp of LLM inference internals, including key-value caching, batching, and quantization.
• Experience with upstream contributions to active open-source software communities.
• Hardware accelerator optimization experience, particularly with GPUs or TPUs.
• A genuine enthusiasm for AI-assisted development, with LLMs and agents as core tools.
• Experience in regulated environments and AI safety involvement is a plus, as well as depth in MLOps and CI/CD practices.

Benefits

• Competitive salary package.
• Opportunity to work in a well-funded AI engineering organization.
• Engagement in innovative projects within the AI and machine learning space.

Degree Requirement: Not Specified

Visa Sponsorship May be