MLOps Engineer
Evlo AI
midpermanentbackenddevops Austin, TX 122 days ago via LinkedIn
See how well this job matches your profile
Sign up to get an AI match score and generate a tailored application in seconds.
Get your match scoreTags
MLOpsPythonDockerKubernetesHelmMLflowKubeflowTerraformAWSTriton Inference Server
About the role
Role Overview
MLOps Engineer responsible for building and maintaining scalable, reliable MLOps infrastructure that moves models from training to production. You’ll design automated pipelines, standardize tooling across environments, and ensure high availability and monitoring for large-scale inference.
Responsibilities
- Design and implement automated end-to-end ML pipelines for training, evaluation, model registration, and deployment (e.g., Kubeflow/MLflow).
- Deploy, scale, and manage ML inference services on Kubernetes (EKS/GKE) using serving frameworks such as:
- Triton Inference Server
- Seldon Core
- TorchServe
- Build robust feature store integrations to serve real-time and batch features consistently across training and serving.
- Implement automated monitoring, alerting, and logging for production issues like:
- Data drift
- Concept drift
- Latency anomalies
- Partner with infrastructure teams to manage GPU/CPU resources, optimizing cost and latency for high-throughput endpoints.
Requirements
- 3–6 years of experience in MLOps, DevOps, or software engineering with strong production ML deployment focus.
- Proficiency with containerization and orchestration:
- Docker
- Kubernetes (including Helm charts and operators)
- Hands-on ML lifecycle tooling:
- MLflow, Kubeflow, Prefect, or Airflow
- Strong Python skills.
- Infrastructure as code experience with Terraform.
- Cloud familiarity with AWS, GCP, or Azure.
Bonus
- Triton Inference Server experience
- Custom CUDA optimization
- Real-time feature engineering using Redis or Feast
About Evlo AI
Evlo AI is an AI-focused company building production systems that support machine learning at scale. The role emphasizes deploying and operating ML models reliably in real-world inference environments, bridging ML development with production infrastructure.
Scraped 7/23/2026