Quality Assurance Engineer | Remote

Role Overview

Quality Assurance Engineer (Remote), full-time. The role focuses on designing and executing quality checks for tasks and AI agent runs, ensuring results are correct, robust (including edge cases), and benchmark scores remain trustworthy.

Responsibilities

• Create test cases to confirm tasks work as intended, including edge cases.
• Review tasks and reference solutions to identify ambiguity and gaps early.
• Debug issues in tasks using Python.
• Build simple, repeatable quality checklists and provide actionable feedback.
• Monitor AI agent runs to ensure benchmark scores remain reliable.

Requirements

• MSc or PhD in a STEM field, or equivalent practical experience.
• Strong experience in test engineering, quality assurance, or research/software engineering.
• Ability to design test cases and quality-review processes for complex systems.
• Working proficiency in Python and Git, and comfort navigating unfamiliar codebases.
• Exceptional attention to detail and strong written documentation practices.

Nice to Have

• Experience in AI training, model evaluation, or quality review of AI-generated work.

Application Process

• Apply via the Easy Apply button.
• Qualified candidates will receive an email with next steps.