QA Software Test Engineer Code Review - Remote

Role overview

QA Software Test Engineer (Code Review) — Remote YO IT Consulting is hiring experienced software engineers to build evaluation datasets for research collaborations with leading AI labs. The work focuses on creating code review and debugging-related prompt/response data to assess AI reasoning, explanation quality, and technical judgment (not executable correctness).

Responsibilities

• Craft realistic developer prompts across categories such as:
  • Code review
  • Debugging
  • Error diagnosis
  • Configuration and related scenarios
• Source and adapt content from real PRs to create authentic evaluation cases.
• Write clear, technically accurate model responses demonstrating strong reasoning and explanation quality.
• Produce chat-pasteable prompts with all necessary inline context (e.g., code snippets, error messages, logs, requirements).

Requirements

• 2+ years of experience in software engineering, technical research, or educational content development
• Bachelor’s degree minimum in Software Engineering, Computer Science, or a related field (advanced degree preferred)
• Strong proficiency in one or more of: Python, JavaScript, Java, C++
• Experience with debugging, testing, and validating code
• Comfortable with technical writing and high attention to detail

Contract details

• Independent contractor
• Fully remote, on your own schedule
• Start: Immediate
• Duration: 1–2 months (may be extended/shortened based on needs)
• Commitment: Part-time 15–25 hours/week, flexible up to 40 hours/week

Interview process

• Upload resume
• Short 15-minute AI interview (conversational)
• Follow-up communication within a few days