xelys jobs xelys jobs

Senior Machine Learning Engineer (Voice Agents)

Hugging Face

Full remote - Paris, FR 73 days ago via WTTJ

See how well this job matches your profile

Sign up to get an AI match score and generate a tailored application in seconds.

Get your match score

About the role

Join Hugging Face, a leading AI company, as a Senior Machine Learning Engineer specializing in voice agents. In this role, you will take architectural ownership of our open-source library for real-time voice agents and our new product, hf-voice. You will design the developer API, build the serving side, and support existing deployments. This position offers a flexible work environment, health insurance, unlimited PTO, equity, and opportunities for growth and training. Key missions: Architectural ownership of large parts of speech-to-speech pipeline design, latency budget, and reliability of the realtime loop.. Integration of new ASR, TTS, and end-to-end speech models, while keeping the abstractions clean.. Designing the developer API and the streaming protocol, including session lifecycle, transport, authentication, and error semantics. Profile: - Practical experience with LLMs or multimodal models in production. Clear written communication and a habit of collaborating async and in public - You have shipped something realtime: streaming, WebSockets or WebRTC, audio or video pipelines, live inference - Experience building developer-facing infrastructure at an AI or developer-tools company: inference APIs, agent infrastructure, or something comparable - Senior engineer, able to own a substantial part of an architecture and drive it forward autonomously - Substantial open-source contributions to a Python library. Comfortable with async Python and distributed systems, including their failure modes - Motivated by voice and conversational AI - If you're interested in joining us, but don't tick every box above, we still encourage you to apply! We're building a diverse team whose skills, experiences, and backgrounds complement one another. We're happy to consider where you might be able to make the biggest impact - GPU serving, quantization, or on-device inference experience - Experience shipping to embedded or robotics targets - Contributions to llama.cpp or another low-level inference runtime - A public track record: talks, blog posts, demos - Hands-on work with ASR, TTS or end-to-end speech models, including evaluation of latency and quality trade-offs - Contributions to a voice-agent framework such as speech-to-speech, pipecat, LiveKit Agents, Vocode or TEN - Audio pipeline knowledge: VAD, echo cancellation, jitter buffers, barge-in and turn detection

Scraped 9/10/2026