Senior AI Runtime Engineer

About the role

Join Modular, a cutting-edge AI platform company, as a Senior AI Runtime Engineer. In this role, you will optimize performance for diverse customer AI models across various CPU and GPU hardware platforms. You will design and develop runtime and cross-stack optimizations, port the Modular runtime stack to new hardware platforms, and collaborate with various teams to achieve state-of-the-art end-to-end performance. Enjoy a range of benefits, including health insurance, a 401k plan, a generous work-from-home stipend, and unlimited paid time off. Key missions: Conception et développement d'un runtime optimisé pour divers matériels CPU et GPU, en améliorant l'efficacité.. Collaboration avec les équipes de compilation, de noyaux, de service et de modèles pour concevoir des technologies de pointe.. Engagement avec les clients pour comprendre leurs exigences en matière de performance et leurs cas d'utilisation. Profile: - Experience in C++ programming and complex software systems - 5+ years of experience working on high-performance computing systems - Proficiency with one or more profiling tools (CPU or GPU) - Experience with CPU or GPU runtime optimizations and performance analysis on CPUs, GPUs, or AI accelerators - Creativity and curiosity for solving complex problems, a team-oriented attitude that enables you to work well with others, and alignment with our culture - For candidates who fall outside of the listed requirements, we nevertheless encourage you to apply as we may have upcoming openings that are lower/higher level than the ones advertised - Advanced degree in Computer Science or a related area is a plus - Exposure to MLIR, LLVM, and/or the Mojo programming language - Experience with ML graph optimizations, parallel / distributed programming, heterogeneous ML computation, and/or code generation