Senior Software Engineer (GenAI Platform)

Role Overview

Join Reddit’s Machine Learning Platform team as a Senior Software Engineer (GenAI Platform). You’ll lead development of a large-scale GenAI Platform, focusing on the LLM Gateway, enterprise RAG applications, and agentic AI workflows, while driving adoption of MLOps/LLMOps practices.

Responsibilities

• Design, implement, and maintain the LLM Gateway, including unified API endpoints.
• Build and manage enterprise-grade RAG applications using:
  • Embeddings
  • Vector search
  • Retrieval pipelines
• Implement and support agentic AI workflows.
• Drive MLOps/LLMOps adoption, including:
  • CI/CD automation
  • Versioning
  • Testing
  • LLM/ML lifecycle management
• Ensure scalability, reliability, performance, and usability for platform users.

Requirements

• 5+ years experience in ML Engineering, AI Platform Engineering, or Cloud AI deployment.
• Deep experience with cloud-based technologies supporting ML platforms (e.g., AWS, and infrastructure tooling).
• Strong knowledge of model serving, inference pipelines, and monitoring/observability for AI systems.
• Proficiency in common programming languages used in ML systems (notably Python; also e.g., Go).
• Ability to operate orchestration systems like Kubernetes at scale.
• Excellent communication skills, including explaining technical AI concepts to non-technical stakeholders.

Nice to Have

• Experience with modern AI/ML frameworks, such as LangChain, Vertex AI Agent Builder, TensorFlow, and PyTorch.
• Experience with Google Cloud Storage.
• Familiarity with infrastructure-as-code, especially Terraform.