Senior Backend Engineer (AI Agents)

Role Overview

Level AI is hiring a Senior Backend Engineer (AI Agents) to design and build scalable backend systems that power real-time AI Agents in enterprise environments. You’ll work at the intersection of distributed systems, cloud infrastructure, and AI-powered applications.

Responsibilities

• Design and build scalable backend systems powering AI Agents in real-time enterprise settings
• Develop agent orchestration frameworks
• Build systems for agent memory, context management, and state persistence across interactions
• Architect low-latency inference pipelines integrating LLMs/SLMs and external tools/services
• Implement evaluation frameworks to measure agent performance
• Collaborate with Applied AI/ML, Product, and Solutions teams
• Drive best practices in observability, monitoring, safety, and guardrails for AI systems

Requirements

• Strong fundamentals in system design, concurrency, and performance optimization
• Experience designing systems for real-time processing, streaming, or event-driven architectures
• 5+ years of backend engineering experience in distributed systems or platform engineering
• Experience with databases (SQL + NoSQL) and data modeling for high-scale systems
• Hands-on experience with Docker, Kubernetes, and cloud platforms (AWS/GCP/Azure)
• Strong experience building high-scale, production-grade backend systems
• Strong understanding of API design (REST, gRPC) and microservices architectures
• Experience with real-time decisioning systems or workflow orchestration engines

Nice-to-haves / Additional Signals

• Understanding of prompting strategies, context windows, and model behavior optimization
• Exposure to evaluation systems (offline/online evals, A/B testing for AI)
• Experience with RAG pipelines, vector databases, or retrieval systems
• Familiarity with agent frameworks, tool calling, or multi-step reasoning systems
• Experience building or integrating LLMs/conversational AI products in production