MLOps Engineer
Entarian
seniorpermanentbackenddevops Arlington, VA 123 days ago via LinkedIn
See how well this job matches your profile
Sign up to get an AI match score and generate a tailored application in seconds.
Get your match scoreTags
MLOpsMLflowKubeflowAWS SageMakerPrometheusGrafanaKubernetesCI/CDData Drift DetectionOpenTelemetry
About the role
Role Overview
Entarian is seeking an MLOps Engineer to ensure the seamless deployment, monitoring, and optimization of AI models in production. You will build and maintain end-to-end machine learning pipelines with a focus on automation, observability, data drift detection, and secure operations.
Responsibilities
- Model Deployment: Deploy and manage ML models in production for scalability and low latency using tools such as MLflow, Kubeflow, or AWS SageMaker.
- Monitoring & Observability: Create and maintain dashboards (e.g., Grafana, Prometheus, Kibana) to track real-time model health and historical trends.
- Data Drift Detection: Implement drift detection pipelines using Evidently AI or Alibi Detect, triggering alerts and/or retraining when needed.
- Logging & Tracing: Set up centralized logging and tracing using ELK Stack and/or OpenTelemetry for inference events, errors, and audit trails.
- Pipeline Automation: Build CI/CD pipelines using GitHub Actions or Jenkins to automate model updates, testing, and deployment.
- Security & Compliance: Apply secure-by-design practices (encryption, access controls) and align with regulations such as GDPR and NIST AI RMF.
- Collaboration: Work closely with data scientists, AI integration engineers, and DevOps teams to align performance with business and infrastructure needs.
- Optimization: Improve production performance using techniques like quantization or pruning; ensure efficient cloud resource usage (AWS/Azure/GCP).
- Documentation: Maintain clear documentation for pipelines, dashboards, and monitoring.
Requirements
- 5+ years experience in MLOps, DevOps, or software engineering with focus on AI/ML systems.
- Experience deploying models in production using MLflow, Kubeflow, or cloud platforms (AWS SageMaker, Azure ML).
- Hands-on observability experience with Prometheus, Grafana, or Datadog.
- Python and SQL proficiency; familiarity with JavaScript or Go is a plus.
- Containerization and orchestration: Docker, Kubernetes.
- CI/CD experience: GitHub Actions, Jenkins.
- Logging/time-series: ELK Stack, OpenTelemetry, InfluxDB/TimescaleDB.
- Drift detection: Evidently AI, Alibi Detect.
- Visualization: Plotly, Seaborn.
- AI/ML metrics and drift methods (e.g., precision/recall/AUC, KS test, PSI).
- Knowledge of AI vulnerabilities (e.g., data poisoning, adversarial attacks) and mitigation tools such as Adversarial Robustness Toolbox (ART).
- Strong debugging/problem-solving and cross-functional communication.
Desired Qualifications
- Experience with LLM monitoring tools such as LangSmith or Helicone.
- Familiarity with compliance frameworks including GDPR and HIPAA.
- Contributions to open-source MLOps projects and/or participation in #MLOps / #AIOps communities.
Clearance Requirement
- Must be US citizen and eligible to obtain a Department of Homeland Security EOD clearance (favorable background investigation).
Scraped 7/22/2026