xelys jobs xelys jobs

Senior Software Developer (LLM Infrastructure)

Wealthsimple

full-remoteseniorpermanentbackenddevops Full remote 99 days ago via WTTJ

See how well this job matches your profile

Sign up to get an AI match score and generate a tailored application in seconds.

Get your match score

Tags

PythonFastAPIKubernetesTerraformAWS GPU infrastructureKafkaPostgreSQLRedshiftSnowflakeLLM Infrastructure

About the role

Role overview

Join Wealthsimple as a Senior Software Developer on the Machine Learning Infrastructure team. You will design and implement the backend and infrastructure that power the company’s AI systems, partnering with data scientists, platform engineers, and engineering leaders to scale GenAI securely and efficiently.

Responsibilities

  • Build and maintain infrastructure to host and serve open-source language models reliably on cloud/GPU systems.
  • Implement intelligent model-routing frameworks to optimize performance, cost, and latency.
  • Develop evaluation and benchmarking tooling to test, validate, and compare model performance.
  • Drive cost-optimization and infrastructure efficiency initiatives.

Requirements

  • 6+ years of software engineering experience building production-ready distributed systems or data/platform infrastructure.
  • Proven ability to design and operate highly performant, observable backend systems.
  • Strong Python skills and infrastructure tooling experience.
  • Practical experience with the modern AI/LLM ecosystem, such as:
    • Serving open-source models
    • vLLM, Ray, model routing, and/or evaluation frameworks.
  • Experience with LLM infrastructure tools including LiteLLM, vLLM, Ray, and AWS Bedrock (as applicable).
  • Container and cloud infrastructure experience:
    • Kubernetes, Terraform, and AWS GPU infrastructure.
  • Data/streaming familiarity:
    • Kafka, PostgreSQL, Redshift, Snowflake.
  • FastAPI and backend API development.

Nice to haves

  • Strong end-to-end ownership of technical projects with high autonomy.

About Wealthsimple

Wealthsimple is a technology-driven financial services company that builds platforms for investing and financial management. The company focuses on scalable engineering and applies AI/ML capabilities in its product and infrastructure, operating in a modern, platform-oriented engineering environment.

Scraped 8/19/2026