Staff Machine Learning Engineer (AI Serving)

Role Overview

Join Reddit’s Machine Learning Platform team as a Staff Machine Learning Engineer (AI Serving). You will help build and scale a large-scale ML inference platform, designing production ML and Generative AI systems with real-time observability.

Responsibilities

• Lead development of a highly available, low-latency GPU-based ML model serving system (design, implementation, maintenance).
• Design and develop ML and Generative AI systems in cloud production environments, including:
  • Rapid prototyping
  • High-performance feature hydration
  • Operating at Kubernetes scale
• Create and lead a unified GPU model export framework to convert trained models into optimized GPU inference models.
• Ensure real-time ML observability to track feature/model performance and operational health.
• Champion scalability, reliability, performance, and usability for platform users.

Requirements

• 7+ years in ML Engineering, AI Platform Engineering, or Cloud AI Deployment.
• Strong Python proficiency and deep experience with modern AI/ML frameworks.
• Experience operating Kubernetes (at scale).
• Strong background in cloud technologies supporting an ML platform, including AWS and Google Cloud Storage, plus Infrastructure as Code (Terraform).
• Strong understanding of model serving/inference pipelines and monitoring/observability for AI systems.
• Excellent communication skills; able to explain technical AI concepts to non-technical stakeholders.

Nice-to-haves

• Experience with tools/frameworks such as Triton, Dynamo, vLLM, PyTorch.
• Proficiency in other common ML languages/frameworks (e.g., Go).