Python Engineer (Remote)

Role Overview

As a Python Engineer (Remote), you will help design and evaluate autonomous AI agents across multiple LLMs. You’ll provide expert human feedback to improve agentic AI systems, and help train LLMs for complex, multi-step architectural workflows.

Responsibilities

• AI Agent Evaluation
  • Write evaluation rubrics with clear objective pass/fail criteria
  • Debug agent traces to identify recurring failure patterns
  • Stress test agents against edge cases, prompt injection, and tool misuse
• Technical Assessment
  • Assess production-grade modular software architecture
  • Analyse multi-turn system interactions and behaviors
  • Produce high-density technical feedback for LLM training
• Project Workflow
  • Create an account, upload a resume/ID, and complete the onboarding assessment
  • Earn through flexible task assignments

Requirements

• Backend engineering experience related to AI automation or complex systems integration
• Proven ability to build and maintain production-grade software with modular separation (e.g., distinct services for parsing, logic, and reporting)
• Strong command of at least two major languages, including Python (examples given: Python, JavaScript, Go, Java)
• Experience working with SQL databases
• Practical experience building for live (non-mocked) environments
• Ability to handle multi-turn system interactions

Nice to Have

• Experience integrating agents with live tools/APIs (e.g., Supabase, Gmail, other APIs)
• Familiarity with persistent state and session-tracking patterns
• Ability to identify security/privacy issues (e.g., privacy leaks, authority escalation, indirect prompt injection)

Compensation

• Hourly: USD $30–$50 (depends on experience and task complexity)
• Payments issued weekly via supported payout platforms (e.g., PayPal, AirTM)