Senior Applied AI Engineer
Pleo
seniorpermanentbackenddata London 98 days ago via Arbeitnow
See how well this job matches your profile
Sign up to get an AI match score and generate a tailored application in seconds.
Get your match scoreTags
Applied AILLMsRAGPythonVector DatabasesHybrid SearchRe-rankingEvaluation FrameworksPrompt DesignProduction Observability
About the role
Role overview
Pleo is hiring a Senior Applied AI Engineer in London to help shape how AI-powered product features are built and taken from prototype to production. You’ll work with software engineers, data engineers, and data scientists in a team that covers the full chain from data to shipped product.
Responsibilities
- Build and ship customer-facing AI-powered product features, owning outcomes end-to-end for a scoped area.
- Design and build end-to-end RAG systems for specific product use cases, including:
- chunking strategies
- embedding model selection
- retrieval optimization
- quality evaluation
- Own the full AI-product lifecycle:
- prompt design
- context and state management
- agentic loops
- output parsing
- edge case handling
- safe production deployment
- Create evaluation datasets and automated eval pipelines to validate AI feature quality before and after changes.
- Add production observability for AI features:
- logging
- drift detection
- quality monitoring
- alerting
- Collaborate with Product and Design from first principles to scope AI features.
- Partner with the GenAI Platform team on infrastructure needs and adoption of platform tooling.
- Provide pragmatic technical leadership through reviews and pairing.
Requirements
- Proven experience shipping customer-facing LLM-based AI features into real production systems.
- Deep practical experience designing RAG systems end-to-end, including embeddings, vector databases, chunking, hybrid search, and re-ranking.
- Experience building and operating evaluation frameworks for LLM systems with a systematic approach to quality measurement.
- Strong Python skills (the posting trails off after “Strong Pyt…”).
Nice-to-haves
- Experience with agentic workflows (agentic loops), output parsing, and safe deployment practices.
About Pleo
Pleo builds spend management solutions that make managing money seamless for both finance teams and employees. The company uses data and AI to help businesses “go beyond,” serving 40,000+ customers and operating with a global team of 850+ people.
Scraped 8/16/2026