Machine Learning Engineer
Workday
full-remoteseniorpermanentbackend Full remote 193 days ago via WTTJ
See how well this job matches your profile
Sign up to get an AI match score and generate a tailored application in seconds.
Get your match scoreTags
Machine LearningMLOpsPythonNLPLLMRAGReinforcement LearningPyTorchInformation RetrievalPySpark
About the role
Role Overview
Workday is hiring a Machine Learning Engineer for the AI Platform team, working on the Agent Evaluation Platform project. You’ll design, deploy, and evaluate AI agents and production ML systems that support Workday’s agentic AI transformation.
Key Missions
- Architect Agentic AI: Design and deploy reasoning, planning, and swarm agents that work with enterprise data and enable continuous/lifelong learning.
- Drive Meta-ML & Optimization: Develop algorithms for node-level optimization within agent graphs, selecting the best LLM and prompt configuration for each workflow step.
- Lead the ML Lifecycle (End-to-End MLOps): Own exploration through prompt engineering, scalable production deployment, and reliability-focused evaluation.
- Advance Retrieval & Evaluation: Improve information retrieval, and scale evaluation, observability, and benchmarking.
- Define Strategic Roadmaps: Shape roadmap priorities for agent evaluation and related AI capabilities.
Responsibilities
- Build and evaluate NLP/LLM-powered products and agentic systems.
- Implement scalable systems for ML evaluation and monitoring (observability, reliability).
- Own production-grade ML lifecycle and production deployment practices.
- Collaborate cross-functionally and mentor engineers.
Requirements
- Python (2+ years) with emphasis on modular library design, asynchronous patterns, and scalable system architecture (state management/error handling).
- Production ML (3+ years): research, develop, and deploy ML systems using deep learning, NLP, Information Retrieval, and recommender systems (e.g., PyTorch or TensorFlow).
- Strong optimization/advanced ML skills: DSPy, reinforcement learning, imitation learning, graph neural networks, multi-modal models, and large-scale data processing.
- Experimental rigor: A/B testing; knowledge graphs; Golden Dataset curation for benchmarking.
- Agentic AI & LLM stacks: RAG architectures, agent frameworks such as LangChain/LangGraph, and long-context LLM use cases (e.g., Text-to-SQL).
- MLOps: full ML lifecycle including model fine-tuning (PEFT), evaluation frameworks (e.g., DeepEval/RAGAS), and cloud-native deployment.
- Data pipelines: PySpark and SQL.
- Academic foundation: Master’s or Ph.D. in a quantitative field or strong peer-reviewed research/portfolio.
Nice-to-Haves / Additional Signals
- Experience with Docker/Kubernetes, AWS/GCP.
- Demonstrated ability to lead cross-functional teams and solve ambiguous problems with high autonomy.
About Workday
Workday is a global technology company that builds enterprise software and platforms for managing organizations and work. In this role, you’ll join the AI Platform team to help deliver AI capabilities that support Workday’s AI transformation, including agent evaluation, retrieval, and semantic parsing.
Scraped 5/13/2026