Software Engineer, Model Inference, DeepMind

  • Full Time
  • London

Google

Software Engineer, Model Inference, DeepMind Overview

Company Name Google
Job Role Software Engineer, Model Inference, DeepMind
Qualifications Not Specified
Category IT Jobs
Job Type Full Time
Location London

As a Software Engineer in Model Inference at Google DeepMind, you will play a crucial role in advancing AI technology. Your work will involve collaborating with top-tier researchers and engineers to optimize and deploy large language models (LLMs) like Gemini on Google’s production infrastructure. This position offers a unique opportunity to work on a variety of challenging problems within a mission-driven team.

Responsibilities

  • Collaborate with research teams to understand and implement next-generation modeling approaches with production considerations.
  • Work alongside infrastructure teams to develop serving infrastructure that maximizes efficiency and performance, addressing speed, scale, and quality bottlenecks.
  • Identify automation opportunities to streamline tasks, reduce redundancies, and enhance the velocity of model releases.
  • Gain in-depth knowledge of serving frameworks, pre-processing pipelines, caching mechanisms, and related technologies.
  • Utilize roofline analysis, hardware profiling, and systems analysis to detect and resolve performance bottlenecks across ML frameworks, compilers, custom kernels, and serving infrastructure on hardware accelerators.

Requirements

  • A Bachelor’s degree or equivalent practical experience.
  • At least 8 years of experience in software development.
  • Minimum of 2 years of experience in deploying and maintaining machine learning models in a live production environment.
  • Experience in profiling, configuring, or executing machine learning workloads on hardware accelerators such as GPUs or TPUs.
  • Proven experience in designing, building, or optimizing model serving infrastructure or inference backends.
  • Familiarity with developing serving infrastructure and programming hardware accelerators via ML frameworks or low-level programming models.
  • Experience in profiling software to identify performance bottlenecks and optimizing distributed ML systems.

Benefits

  • Competitive salary ranging from $207,000 to $300,000 (USD) plus a target bonus of 20% and equity options.
  • Comprehensive benefits package including health, wellness, and retirement plans.

This role is based in either London, UK, or Mountain View, CA, USA, and is not eligible for visa sponsorship.


Degree Requirement: Not Specified

Visa Sponsorship May be

To apply for this job please visit www.google.com.