QA Software Test Engineer Code Review - Remote

Role Overview

QA Software Test Engineer (Code Review) – Remote YO IT Consulting is hiring independent contractors to help build evaluation datasets used by leading AI labs. Freelancers will create realistic code-related prompts and high-quality responses to assess natural-language reasoning, explanation quality, and technical judgment (focused on evaluation of correctness, not necessarily executable code).

Responsibilities

• Craft realistic developer prompts across categories such as:
  • Code review
  • Debugging
  • Error diagnosis
  • Configuration
  • Other coding-related scenarios
• Source and adapt content from real pull requests to create authentic evaluation cases
• Write technically accurate model responses that demonstrate strong reasoning and explanation

Qualifications (Ideal)

• 2+ years of experience in software engineering, technical research, or educational content development
• Bachelor’s minimum in Software Engineering, Computer Science, or related (advanced degree preferred)
• Strong proficiency in one or more of:
  • Python, JavaScript, Java, C++
• Experience with debugging, testing, and validating code
• Comfortable with technical writing and strong attention to detail

Contract & Schedule

• Start date: Immediate
• Duration: 1–2 months (may be extended/shortened based on performance and needs)
• Commitment: Part-time 15–25 hours/week (flexible up to 40 hours/week)
• Engagement: Independent contractor
• Location: Fully remote; work completed on your own schedule

Hiring Process

• Upload resume
• AI interview: short ~15-minute conversational session
• Follow-up communication with next steps and onboarding details