Senior Software Engineer

  • Full Time
  • UK

IC Resources Recruitment

Senior Software Engineer Overview

Company Name IC Resources Recruitment
Job Role Senior Software Engineer
Qualifications Not Specified
Category IT Jobs
Job Type Full Time
Location Rest of UK

A well-funded AI engineering organization is seeking a Senior Software Engineer to enhance, deploy, and optimize a leading open-source LLM inference engine. This role involves working on two primary initiatives: a scaling inference project and a high-assurance initiative within regulated environments.

Key Responsibilities

  • Deploy, instrument, and monitor open-weight models served via the inference engine.
  • Build new features for the engine to support novel hardware architectures.
  • Extend the engine to ensure accuracy, explainability, and accountability in regulated settings.
  • Contribute upstream to the relevant open-source community.
  • Optimize inference performance, focusing on latency, throughput, and hardware utilization.

Qualifications and Skills

  • Senior-level proficiency in Python, along with low-level programming skills in C/C++, Rust, or CUDA.
  • Direct contributions to a major inference or serving engine or similar machine learning infrastructure project (e.g., PyTorch, Ray).
  • Strong grasp of LLM inference internals, including KV caching, batching, and quantization.
  • Experience with upstream contributions to active open-source software communities.
  • Expertise in optimizing hardware accelerators (GPU/TPU, etc.).
  • A genuine enthusiasm for AI-assisted development, particularly with LLMs and agents as core tools.
  • Experience in regulated environments, AI safety involvement, and depth in MLOps/CI/CD is a plus.

Benefits

  • Competitive salary package.
  • Opportunity to work in a well-funded AI engineering organization.
  • Remote working flexibility.

Degree Requirement: Not Specified

Visa Sponsorship May be

To apply for this job please visit ic-resources.com.