Senior GPU Performance Software Engineer, AI/ML

Google

Senior GPU Performance Software Engineer, AI/ML Overview

Company Name Google
Job Role Senior GPU Performance Software Engineer, AI/ML
Qualifications Bachelor’s
Category IT Jobs
Job Type Full Time
Location London

Google is seeking a highly skilled Senior GPU Performance Software Engineer specializing in AI and machine learning to join their team in London, UK. This role involves developing and optimizing GPU systems to support Google’s extensive machine learning workloads, with a focus on large language models (LLMs). The successful candidate will be responsible for maintaining benchmarks that reflect real-world Google production environments, industry standards, and the broader ML community. These benchmarks will be used to identify performance opportunities, improve GPU acceleration via XLA and Triton, and guide software releases.

Key Responsibilities

  • Develop and sustain benchmarking datasets for training and deploying large language models, ensuring they are representative of actual Google workloads and industry benchmarks. Use these to identify performance bottlenecks and guide hardware and software improvements.
  • Work closely with Google product teams such as DeepMind to resolve ML model performance issues. This includes onboarding new models onto GPU hardware and enabling efficient large-scale training and inference.
  • Perform architectural simulations of GPU designs and conduct roofline analyses to inform hardware development and optimization strategies.
  • Analyze system performance metrics to detect bottlenecks, then design and implement solutions to enhance efficiency across Google’s GPU infrastructure.
  • Execute performance benchmarking on GPU hardware using internal and external tools to evaluate and improve system capabilities.

Qualifications

  • A bachelorâ??s degree or equivalent practical experience in a relevant technical field.
  • At least five years of experience in software development with proficiency in one or more programming languages.
  • Five or more years working with data structures and algorithms.
  • Extensive experience (five or more years) with machine learning algorithms, tools, and concepts such as AI, deep learning, or natural language processing.
  • At least three years of experience in testing, maintaining, or launching software products, with a minimum of one year in software design and architecture.

Preferred Qualifications

  • Advanced degrees such as a Masterâ??s or PhD in Computer Science or related fields.
  • One year or more in a technical leadership role.
  • Experience with hardware and compiler co-design or high-performance computing (HPC).
  • Proficiency in GPU programming using CUDA, Triton kernels, or similar technologies.
  • Background in compiler optimizations or related areas is advantageous.

About the Role

Googleâ??s software engineers develop innovative technologies that impact billions of users worldwide. The role involves working on projects that extend beyond web search, including distributed systems, networking, data storage, security, and AI. As part of this team, you will work on specific projects critical to Googleâ??s operations, with opportunities to switch teams as the company evolves. The ideal candidate will be versatile, demonstrate leadership qualities, and be eager to tackle new challenges across the full technology stack.

Team Focus

The Machine Learning Omega team is dedicated to optimizing GPU systems for Googleâ??s internal ML workloads. Responsibilities include modeling, benchmarking, and performance evaluation to maximize efficiency. The teamâ??s work guides hardware decisions and ensures Googleâ??s GPU fleet operates at peak performance for training and inference tasks.

Additional Information

Google emphasizes equal opportunity employment and is committed to creating a diverse workforce. They do not specify whether this role offers visa sponsorship, and the posting does not mention sponsorship options. Candidates requiring visa support should inquire directly or review Google’s policies for further guidance.


Degree Requirement: Bachelor’s

Visa Sponsorship Promising

To apply for this job please visit www.google.com.