Freelance Software Engineer (Remote)

Role Overview

Freelance Software Engineer (Fully Remote)

You will help design and evaluate autonomous AI agents across multiple LLM-based systems and real-world domains (health, education, daily life). Your work is all coding and includes providing expert human feedback to support LLM/agent training.

Responsibilities

• AI Agent Evaluation
  • Create evaluation rubrics with objective pass/fail criteria
  • Debug agent traces to identify failure patterns
  • Stress test agents against edge cases, prompt injection, and tool misuse
• Technical Assessment
  • Assess production-grade modular software architecture
  • Analyze multi-turn interactions and agent behaviors
  • Provide high-density technical feedback to improve LLM training
• Project Workflow
  • Create an account, upload a resume/ID, and complete onboarding assessment
  • Receive flexible task assignments once onboarded

Requirements

• Experience in backend engineering, AI automation, or complex systems integration
• Proven ability to build and maintain production-grade modular software (e.g., separation into distinct services for data parsing, logic processing, and reporting)
• Strong command of at least two major languages (examples: Python, JavaScript, Go, Java)
• Experience working with SQL databases
• Practical experience building for live, non-mocked environments
• Ability to handle multi-turn system interactions

Preferred (Nice to Have)

• Integrating agents with live tools such as Supabase, Gmail, and other APIs
• Familiarity with persistent state and session-tracking patterns
• Experience identifying privacy leaks, authority escalation, or indirect prompt injection vulnerabilities

Compensation

• USD $30–$50 per hour, depending on experience and task complexity
• Weekly payments via supported payout platforms (e.g., PayPal or AirTM)

Location / Work Mode

• Fully remote (United States). Listed availability includes candidates in US, Canada, UK, and Australia.