Freelance Software Engineer (Remote)

Role Overview

Freelance Software Engineer (Fully Remote)

Help design and evaluate autonomous AI agents across multiple LLMs in real-world domains such as health, education, and daily life. You will provide expert human feedback and help train LLMs for complex, multi-step architectural workflows.

Responsibilities

AI Agent Evaluation

• Write evaluation rubrics with objective pass/fail criteria
• Debug agent traces to identify failure patterns
• Stress test agents against edge cases, prompt injection, and tool misuse

Technical Assessment

• Assess production-grade modular software architecture
• Analyze multi-turn system interactions and behaviors
• Deliver high-density technical feedback to support LLM training

Project Workflow

• Create an account and upload a resume/ID
• Complete the onboarding assessment
• Earn via flexible, task-based assignments

Requirements

• Experience in backend engineering, AI automation, or complex systems integration
• Proven ability to build and maintain production-grade software with modular separation (e.g., distinct services for parsing, logic, and reporting)
• Strong command of at least two major languages (examples: Python, JavaScript, Go, Java)
• Experience working with SQL databases
• Practical experience building for live, non-mocked environments and handling multi-turn interactions

Nice to Have

• Integrating agents with live tools such as Supabase, Gmail, and other APIs
• Familiarity with persistent state and session-tracking patterns
• Ability to identify privacy leaks, authority escalation, or indirect prompt injection vulnerabilities

Compensation

• USD $30–$50/hour, depending on experience and task complexity
• Weekly payouts via supported platforms (e.g., PayPal or AirTM)
• Full compensation details are provided prior to task acceptance