Staff Machine Learning Engineer, LLM Inference Optimization
Nebius · Zurich EN
MakeYouFirst tailors your CV to this job, writes the cover letter, finds the recruiter’s email and sends the application from your own mailbox, once you approve it.
In brief
Nebius is hiring: Staff Machine Learning Engineer, LLM Inference Optimization in Zurich.
Duties
- Own a platform-level optimization pillar such as quantization, speculative decoding, KV-cache optimization, engine selection, or long-context serving.
- Create reusable evaluation, benchmarking, and rollout frameworks across multiple model families.
- Provide technical direction to MLEs, Applied Scientists, GPU kernel engineers, and infrastructure engineers on shared performance goals.
- Optimize LLM and VLM endpoints for latency, throughput, memory efficiency, GPU utilization, quality, and cost per token.
Excerpt from the ad
About Nebius: Nebius is leading a new era in cloud infrastructure for the global AI economy. We are building a full-stack AI cloud platform that supports developers and enterprises from data and model training through…
Source: ad by Nebius, published on Arbeitnow. MakeYouFirst summarises this ad; the advertiser remains responsible for its content.
Similar jobs
-
Senior Generative AI Engineer EN
SwissPeak Partners GmbH · Zurich
Occupancy: 100% / Start date: 01.06.2026/ Initial duration: 12 months We are looking for an experienced Senior Data Scientist to help design and deliver…
Published on 25 October 2026
-
Senior ML Engineer (Technical Lead) EN
Zerolook · Zurich
Looking for a role where you can use your ML skills to redefine how an entire industry solves core problems? We have that! Zerolook ($1.9M raised in August…
Published on 21 October 2026
-
Senior Generative AI Engineer EN
SwissPeak Partners GmbH · Zurich
Occupancy: 100% / Start date: 01.06.2026/ Initial duration: 12 months We are looking for an experienced Senior Data Scientist to help design and deliver…
Published on 19 October 2026
-
Senior Machine Learning Engineer, LLM Inference Optimization EN
Nebius · Zurich
About Nebius: Nebius is leading a new era in cloud infrastructure for the global AI economy. We are building a full-stack AI cloud platform that supports…
Published on 24 September 2026
-
Machine Learning Engineer EN
DeepJudge · Zurich
About us: Founded by former Google search engineers with PhDs in AI from ETH Zurich, DeepJudge helps legal teams unlock and apply the knowledge inside their…
Published on 11 September 2026
-
Data/ML engineer, fusion data EN
Fusionality · Lausanne
Fusionality is building the measurement, simulation, and control stack for the fusion energy reactors of the future. Spun out of EPFL’s Swiss Plasma Center…
Published on 22 October 2026