Software Engineer, Model Inference, DeepMind
Software Engineer, Model Inference, DeepMind Overview
| Company Name | |
| Job Role | Software Engineer, Model Inference, DeepMind |
| Qualifications | Not Specified |
| Category | IT Jobs |
| Job Type | Full Time |
| Location | London |
At Google DeepMind, we are dedicated to creating the world’s first general-purpose learning agent. As a Software Engineer specializing in Model Inference, you will play a crucial role in measuring the intelligence of our prototypes. Your work will involve collaborating with a talented team of Machine Learning and Neuroscience researchers to develop systems for agent testing, which may include using 2D and 3D games and physics simulators. You will also be responsible for creating visual representations of results, establishing competitive leaderboards for agents, and testing new algorithms on robotic systems.
In this position, you will be instrumental in optimizing and deploying large language models (LLMs) like Gemini onto Google’s production infrastructure, thereby impacting a wide range of applications for users. This role requires a blend of technical skills and collaborative problem-solving to ensure efficiency and quality throughout the LLM deployment process. You will have the chance to engage in both individual contributor and team lead opportunities, making this role suitable for candidates from both Software Engineering and Research Engineering backgrounds. We encourage applicants with diverse interests in serving to apply.
Responsibilities
- Collaborate closely with Research teams to understand next generation modeling approaches, ensuring they are designed and implemented with production considerations in mind.
- Work with infrastructure teams to deliver serving infrastructure that is designed for maximum efficiency and performance, addressing bottlenecks in speed, scale, and quality.
- Identify opportunities to automate tasks, eliminate redundancies, build performant tests, and improve the overall velocity of model releases.
- Gain a deep understanding of serving frameworks, pre-processing pipelines, caching mechanisms, and other relevant technologies.
- Leverage roofline analysis, hardware-level profiling, and systems analysis to identify and eliminate performance bottlenecks across ML frameworks, compilers (XLA), custom kernels (Pallas), and serving infrastructure on hardware accelerators (TPUs/GPUs).
Requirements
- A BachelorĂ¢??s degree or equivalent practical experience.
- At least 8 years of experience in software development.
- Minimum of 2 years of experience in deploying and maintaining machine learning models in a production environment.
- Experience with profiling, configuring, or executing machine learning workloads on hardware accelerators such as GPUs or TPUs.
- Proven experience in designing, building, or optimizing model serving infrastructure or inference backends.
Benefits
- Opportunity to work at the forefront of AI research and development.
- Collaborative environment with interdisciplinary teams focused on solving global challenges.
- Diverse learning opportunities and varied career pathways.
- Commitment to safety and ethics in AI development.
Degree Requirement: Not Specified
Visa Sponsorship May be
To apply for this job please visit www.google.com.