QA Software Test Engineer Code Review - Remote

Role overview

QA / Software Test Engineer Code Review (Remote)

Work with leading AI labs to build evaluation datasets made of code question-and-answer data. The dataset is used to assess natural-language reasoning, explanation quality, and technical judgment for coding-related interactions (not executable correctness).

Key responsibilities

• Craft realistic developer prompts across categories such as:
  • code review
  • debugging
  • error diagnosis
  • configuration
  • other coding-related scenarios
• Source and adapt content from real PRs to produce authentic scenarios
• Write clear, technically accurate model responses that demonstrate strong reasoning and explanation quality

Requirements / Ideal qualifications

• 2+ years of experience in software engineering, technical research, or educational content development
• Bachelor’s minimum in Software Engineering, Computer Science, or related field (advanced degree preferred)
• Strong proficiency in one or more of: Python, JavaScript, Java, C++
• Experience with debugging, testing, and validating code
• Comfortable with technical writing and strong attention to detail

Project logistics

• Start: Immediate
• Duration: 1–2 months (may be extended/shortened)
• Commitment: Part-time 15–25 hours/week, flexible up to 40 hours/week
• Work style: Fully remote

Contracting & hiring process

• Independent contractor engagement
• Application includes a resume and a 15-minute AI interview followed by onboarding steps.