Senior Artificial Intelligence/Machine Learning Platform Engineer

Role overview

As a Senior AI/ML Platform Engineer at Lyra Health, you will build the platforms, infrastructure, and services needed to deliver ML and generative AI products. You will create backend infrastructure for scalable, resilient, high-performance systems, expose AI-based product services, and operate applications in production.

Key responsibilities

• Build AI/ML backend infrastructure to support scalable and resilient solutions
• Develop and expose services that power AI-based products
• Deploy and manage production applications and code daily
• Lead cross-functional initiatives and help drive execution with strong ownership

Requirements

• Python with strong, high-quality production coding
• Experience deploying and running services with Docker and Kubernetes
• Experience with LLM orchestration frameworks (e.g., LangChain, LlamaIndex)
• Familiarity integrating with foundation model APIs (e.g., OpenAI, Anthropic, AWS Bedrock)
• Experience with async Python web frameworks such as FastAPI
• Ability to handle data streaming (e.g., WebSockets, Server-Sent Events)
• Experience setting up and maintaining vector databases
• Ability to build RAG (Retrieval-Augmented Generation) solutions
• 4+ years delivering production-ready products

Nice-to-haves

• Experience with relational and low-latency databases
• Building systems from scratch and rapidly learning new technologies
• Experience with Graph Databases (e.g., Neo4j, AWS Neptune) and GraphRAG
• LLM observability/monitoring (e.g., Langfuse) for latency, token usage, and output quality
• Using Protobuf messages
• Production experience in Java/Kotlin
• Cloud infrastructure experience, especially AWS
• Experience with Celery
• Experience handling highly sensitive healthcare data
• Provide mentorship and guidance to other team members