QA Software Test Engineer Code Review - Remote

Role Overview

QA Software Test Engineer (Code Review) — Remote. You will contribute as an independent contractor to create evaluation datasets (code Q&A) that assess AI reasoning, explanation quality, and technical judgment in coding-related interactions.

About the Project

• Dataset consists of chat-pasteable prompts that include all required context inline (e.g., code snippets, error messages, logs, requirements).
• Focus is on natural-language reasoning and explanation quality, not executable correctness.

Responsibilities

• Craft realistic developer prompts across categories such as:
  • code review
  • debugging
  • error diagnosis
  • configuration
• Source and adapt content from real PRs to create authentic scenarios.
• Write clear, technically accurate model responses demonstrating strong reasoning and explanation quality.

Qualifications (Ideal)

• 2+ years of experience in software engineering, technical research, or educational content development.
• Bachelor’s degree minimum in Software Engineering, Computer Science, or related field (advanced degree preferred).
• Strong proficiency in one or more of: Python, JavaScript, Java, C++.
• Experience with debugging, testing, and validating code.
• Comfortable with technical writing and high attention to detail.

Contract & Timeline

• Start: Immediate
• Duration: 1–2 months (may extend/shorten/end early based on performance/needs)
• Hours: Part-time 15–25 hours/week, with flexibility up to 40 hours/week
• Interview: 15-minute conversational AI interview

Remote Work

• Fully remote and can be completed on your own schedule.