QA Software Test Engineer Code Review - Remote

Role Overview

QA Software Test Engineer (Code Review) – Remote You will support high-impact research collaborations with leading AI labs by building and evaluating code question-and-answer datasets. The dataset assesses natural-language reasoning, explanation quality, and technical judgment in coding-related interactions (not executable correctness).

Responsibilities

• Craft realistic developer prompts across multiple categories, including:
  • Code review
  • Debugging
  • Error diagnosis
  • Configuration and related scenarios
• Source and adapt content from real PRs to create authentic evaluation scenarios.
• Write clear, technically accurate model responses demonstrating strong reasoning and explanation quality.
• Ensure prompts are formatted as chat-pasteable prompts with all necessary context inline (e.g., code snippets, error messages, logs, requirements).

Requirements

• 2+ years of experience in software engineering, technical research, or educational content development.
• Degree in Software Engineering, Computer Science, or related field (Bachelor’s minimum; advanced degree preferred).
• Strong proficiency with programming languages such as Python, JavaScript, Java, or C++.
• Experience with debugging, testing, and validating code.
• Comfortable with technical writing and strong attention to detail.

Nice-to-Haves

• Experience creating educational or technical research content.
• Advanced degree in a related field.

Logistics

• Start date: Immediate
• Duration: 1–2 months (may be extended/shortened based on needs)
• Commitment: Part-time 15–25 hours/week, with flexibility up to 40 hours/week
• Work mode: Fully remote, independent contractor
• Interview: 15-minute conversational AI interview, followed by onboarding steps