Senior Software Engineer
IC Resources Recruitment
Senior Software Engineer Overview
| Company Name | IC Resources Recruitment |
| Job Role | Senior Software Engineer |
| Qualifications | Not Specified |
| Category | IT Jobs |
| Job Type | Full Time |
| Location | Rest of UK |
A well-funded AI engineering organization is seeking a Senior Software Engineer to enhance, deploy, and optimize a leading open-source LLM inference engine. This role involves working on two primary initiatives: a scaling inference project and a high-assurance initiative within regulated environments.
Key Responsibilities
- Deploy, instrument, and monitor open-weight models served via the inference engine.
- Build new features for the engine to support novel hardware architectures.
- Extend the engine to ensure accuracy, explainability, and accountability in regulated settings.
- Contribute upstream to the relevant open-source community.
- Optimize inference performance, focusing on latency, throughput, and hardware utilization.
Qualifications and Skills
- Senior-level proficiency in Python, along with low-level programming skills in C/C++, Rust, or CUDA.
- Direct contributions to a major inference or serving engine or similar machine learning infrastructure project (e.g., PyTorch, Ray).
- Strong grasp of LLM inference internals, including KV caching, batching, and quantization.
- Experience with upstream contributions to active open-source software communities.
- Expertise in optimizing hardware accelerators (GPU/TPU, etc.).
- A genuine enthusiasm for AI-assisted development, particularly with LLMs and agents as core tools.
- Experience in regulated environments, AI safety involvement, and depth in MLOps/CI/CD is a plus.
Benefits
- Competitive salary package.
- Opportunity to work in a well-funded AI engineering organization.
- Remote working flexibility.
Degree Requirement: Not Specified
Visa Sponsorship May be
To apply for this job please visit ic-resources.com.