Freelance Software Engineer (Remote)

Role Overview

Freelance Software Engineer (Fully Remote) You will help design and evaluate autonomous AI agents across real-world domains such as health, education, and daily life. Work is focused on coding and providing expert human feedback to train and improve agentic AI systems.

Responsibilities

• AI Agent Evaluation
  • Write evaluation rubrics with objective pass/fail criteria
  • Debug agent traces to identify failure patterns
  • Stress test agents against edge cases, prompt injection, and tool misuse
• Technical Assessment
  • Assess production-grade modular software architecture
  • Analyze multi-turn system interactions and behaviors
  • Provide high-density technical feedback for LLM training
• Project Workflow
  • Create an account, upload a resume/ID, complete onboarding assessment
  • Receive flexible task assignments and start earning

Requirements

• Experience in backend engineering, AI automation, or complex systems integration
• Proven ability to build and maintain production-grade software with modular separation (e.g., distinct services for parsing, logic, and reporting)
• Strong command of at least two major languages (e.g., Python, JavaScript, Go, or Java)
• Experience working with SQL databases
• Practical experience building for live, non-mocked environments
• Experience handling multi-turn system interactions

Nice to Have

• Integrating agents with live tools/APIs such as Supabase and Gmail
• Familiarity with persistent state and session-tracking patterns
• Ability to identify privacy leaks, authority escalation, and indirect prompt injection vulnerabilities

Compensation

• Hourly rate: USD $30–$50 depending on experience and task complexity
• Weekly payouts via supported platforms (e.g., PayPal or AirTM)