Full-stack/Backend developers LLM focused.

Role Overview

CloudDevs (via Outlier) is looking for skilled software experts to help train generative AI models. This is a fully remote freelance role with flexible hours.

The focus is on autonomous agent behavior—building systems that can coordinate multi-step workflows reliably.

Responsibilities

• Develop objective, verifiable evaluation criteria (rubrics) to assess system performance and ensure outputs meet strict functional requirements.
• Review system logs and “trajectories” to refactor code, improve execution paths, and move toward a “Golden Path” of high reliability.
• Test for vulnerabilities, including:
  • improper data exposure
  • unauthorized access escalation
  • edge-case failures

Requirements

• 2+ years of experience in backend engineering, AI automation, or complex systems integration.
• Proven ability to build and maintain production-grade software using modular separation (e.g., distinct services for parsing, logic processing, and reporting).
• Strong command of at least two major languages (examples given: Python, JavaScript, Go, Java).
• Experience working with SQL databases.
• Practical experience building for live, non-mocked environments and handling multi-turn system interactions.
• High attention to detail and ability to provide clear, high-density technical feedback on complex system behaviors.

Nice to Have

• Expertise building multi-stage coordination tasks (data acquisition → reasoned output).
• Experience integrating agents with live tools/APIs, including Supabase and Gmail.
• Comfort implementing persistent state and session discovery using MEMORY.md.
• Experience identifying subtle failures such as privacy leaks, authority escalation, or indirect prompt injections.