Staff AI Scientist
Fiddler AI
hybridleadpermanentdataother Full remote - Palo Alto, US 70 days ago via WTTJ
See how well this job matches your profile
Sign up to get an AI match score and generate a tailored application in seconds.
Get your match scoreTags
PythonPyTorchHugging FaceLLM EvalsGuardrailingClassifier TrainingDataset DevelopmentAI SafetyAdversarial MLRLHF
About the role
Staff AI Scientist (Applied Research & ML Engineering)
Join Fiddler AI to lead applied research and development for models and datasets powering the company’s Trust Service and guardrail classifiers.
Responsibilities
- Lead applied research and development for models and datasets for Fiddler’s Trust Service and guardrail classifiers.
- Design, train, and ship production classifiers for safety, security, and quality under strict latency and cost constraints.
- Drive the technical direction of generative insights (LLM/agent-powered analysis layer) that helps customers diagnose failures in their AI applications.
- Partner closely with engineering teams on evaluation and experimentation infrastructure.
- Mentor AI Scientists and represent the company externally via publications and talks.
- Work with backend/platform engineers on real-time inference, monitoring, and rollouts.
Requirements
- Strong communication skills; can explain research tradeoffs to engineers, PMs, and customers.
- 7+ years of applied AI experience with a track record of shipping models to production.
- Proficiency in Python and the modern ML stack (PyTorch, Hugging Face, training/serving frameworks).
- Experience with LLM or agentic evals and guardrailing.
- Deep expertise training/fine-tuning classifier models (e.g., BERT-family, ModernBERT) and LLM-as-classifier approaches.
- Hands-on dataset development: sourcing, labeling, synthetic generation, adversarial augmentation, and quality control.
- Experience with LLMs and agentic systems: prompting, fine-tuning, and evaluation.
- Ability to work with enterprise/regulated industries (finance, healthcare, government).
- Must be able to work from the Palo Alto office 2–3 days/week.
Nice to Haves
- Background in AI safety, red-teaming, or adversarial ML.
- Experience with synthetic data generation pipelines at scale.
- Experience with RL/RLHF/RLAIF or preference-based fine-tuning.
- Published research at top ML/NLP venues (e.g., NeurIPS, ICML, ICLR, ACL, EMNLP).
- M.S. or Ph.D. in Computer Science, Machine Learning, Statistics, Physics, or a related quantitative field.
About Fiddler AI
Fiddler AI is an AI observability platform focused on helping teams diagnose and improve AI application performance. The platform supports trust and guardrailing capabilities such as safety, security, and quality detection for production AI systems.
Scraped 5/20/2026