Senior Software Developer (LLM Infrastructure)
Wealthsimple
See how well this job matches your profile
Sign up to get an AI match score and generate a tailored application in seconds.
Get your match scoreTags
About the role
Role overview
Join Wealthsimple as a Senior Software Developer on the Machine Learning Infrastructure team. You will design and implement the backend and infrastructure that power the company’s AI systems, partnering with data scientists, platform engineers, and engineering leaders to scale GenAI securely and efficiently.
Responsibilities
- Build and maintain infrastructure to host and serve open-source language models reliably on cloud/GPU systems.
- Implement intelligent model-routing frameworks to optimize performance, cost, and latency.
- Develop evaluation and benchmarking tooling to test, validate, and compare model performance.
- Drive cost-optimization and infrastructure efficiency initiatives.
Requirements
- 6+ years of software engineering experience building production-ready distributed systems or data/platform infrastructure.
- Proven ability to design and operate highly performant, observable backend systems.
- Strong Python skills and infrastructure tooling experience.
- Practical experience with the modern AI/LLM ecosystem, such as:
- Serving open-source models
- vLLM, Ray, model routing, and/or evaluation frameworks.
- Experience with LLM infrastructure tools including LiteLLM, vLLM, Ray, and AWS Bedrock (as applicable).
- Container and cloud infrastructure experience:
- Kubernetes, Terraform, and AWS GPU infrastructure.
- Data/streaming familiarity:
- Kafka, PostgreSQL, Redshift, Snowflake.
- FastAPI and backend API development.
Nice to haves
- Strong end-to-end ownership of technical projects with high autonomy.
About Wealthsimple
Wealthsimple is a technology-driven financial services company that builds platforms for investing and financial management. The company focuses on scalable engineering and applies AI/ML capabilities in its product and infrastructure, operating in a modern, platform-oriented engineering environment.
Scraped 8/19/2026