MLOps Engineer (Remote)

MLOps Engineer (Remote)

Fully remote role for candidates based in the United States (with work modes supporting US/Canada/UK/Australia in the posting).

Role Overview

Design and evaluate autonomous AI agents across multiple LLMs and real-world domains (e.g., health, education, daily life). Provide expert human feedback to train and improve agentic AI systems, including complex multi-step architectural workflows.

Responsibilities

• AI Agent Evaluation
  • Create evaluation rubrics with objective pass/fail criteria
  • Debug agent traces to identify recurring failure patterns
  • Stress test agents for edge cases, including prompt injection and tool misuse
• Technical Assessment
  • Review production-grade, modular software architecture
  • Analyze multi-turn system interactions and behaviors
  • Provide high-density technical feedback for LLM training
• Project Workflow
  • Create an account, submit a resume/ID, and complete an onboarding assessment
  • Start earning via flexible task assignments

Requirements

• Experience in backend engineering, AI automation, or complex systems integration
• Proven ability to build and maintain production-grade modular software (e.g., separate services for data parsing, logic processing, and reporting)
• Strong command of at least two major languages (examples: Python, JavaScript, Go, Java)
• Experience working with SQL databases
• Practical experience building for live, non-mocked environments and handling multi-turn interactions

Nice to Have

• Integrations of agents with live tools/APIs such as Supabase and Gmail
• Familiarity with persistent state and session-tracking patterns
• Experience identifying privacy leaks and authority escalation / indirect prompt injection vulnerabilities

Compensation

• USD $30–$50 per hour, depending on experience and task complexity
• Weekly payments via supported payout platforms (e.g., PayPal or AirTM)