Freelance Software Engineer (Remote)

Role overview

Freelance Software Engineer (Fully Remote)

Help design and evaluate autonomous AI agents across multiple LLMs and real-world domains (health, education, daily life). You’ll also provide expert human feedback to improve agentic AI systems and help train LLMs for complex, multi-step architectural workflows.

Responsibilities

• AI Agent Evaluation
  • Write evaluation rubrics with objective pass/fail criteria
  • Debug agent traces to identify failure patterns
  • Stress test agents against edge cases, prompt injection, and tool misuse
• Technical Assessment
  • Assess production-grade modular software architecture
  • Analyze multi-turn system interactions and behaviors
  • Provide high-density technical feedback for LLM training
• Project workflow
  • Create an account, upload resume/ID, complete onboarding assessment
  • Earn via flexible task assignments

Qualifications

• Backend engineering experience in AI automation or complex systems integration
• Proven ability to build and maintain production-grade software with modular separation (e.g., distinct services for data parsing, logic processing, reporting)
• Strong command of at least two major languages (examples: Python, JavaScript, Go, Java)
• Experience working with SQL databases
• Practical experience building for live, non-mocked environments and handling multi-turn interactions

Preferred (Nice to have)

• Integrating agents with live tools/APIs (e.g., Supabase, Gmail)
• Familiarity with persistent state and session-tracking patterns
• Ability to identify privacy leaks, authority escalation, and indirect prompt injection vulnerabilities

Compensation

• USD $30–$50/hour, weekly payments (e.g., PayPal or AirTM)
• Full compensation details provided prior to task acceptance