Copy of AI Code Reviewer & Systems Evaluation Engineer 1

Role Overview

You’ll support AI training for an enterprise client by helping evaluate and improve advanced AI code systems using human feedback. The work focuses on how AI models write, review, and optimize code in real-world scenarios, including reliability, debugging, and code quality.

What You’ll Do

• Develop evaluation rubrics (objective, verifiable criteria) for system performance
• Review system logs and execution paths to improve reliability and code quality
• Refactor and optimize code/system behavior toward ideal outcomes
• Test for vulnerabilities, including data exposure and edge-case failures
• Provide detailed, high-quality feedback on system performance and outputs

Requirements

• 2+ years experience in backend engineering, AI automation, or systems integration
• Strong proficiency in at least two programming languages (examples: Python, JavaScript, Go, Java)
• Experience working with SQL databases
• Proven ability to build and maintain production-grade systems
• Experience working in live (non-mocked) environments with multi-step interactions
• Strong analytical skills and attention to detail

Nice to Haves

• Experience with multi-stage workflows and coordination tasks
• Familiarity with integrating APIs/databases/external platforms
• Understanding of vulnerabilities such as privacy leaks, prompt injection, and access escalation
• Experience with AI systems or agent-based workflows
• Comfort working with persistent state tracking or similar frameworks

Engagement & Logistics

• Fully remote with a flexible schedule
• Project-based engagement with no guaranteed hours (task volume may vary)
• Paid per completed task; must accept project invitations before starting