QA Software Test Engineer Code Review - Remote

Role Overview

QA Software Test Engineer / Code Review (Remote)

You will help build code evaluation datasets to assess AI reasoning, explanation quality, and technical judgment in coding-related chat interactions. The dataset focuses on evaluating reasoning (not executable correctness) using chat-pasteable prompts with all necessary context.

Responsibilities

• Create realistic developer prompts across categories such as:
  • Code review
  • Debugging and error diagnosis
  • Configuration and other coding scenarios
• Source and adapt content from real PRs to produce authentic evaluation cases
• Write clear, technically accurate model responses that demonstrate strong reasoning and explanation quality

Requirements

• 2+ years of experience in software engineering, technical research, or educational content development
• Degree in Software Engineering, Computer Science, or related field (Bachelor’s minimum; advanced degree preferred)
• Strong proficiency in Python and at least one of: JavaScript, Java, C++
• Experience with debugging, testing, and validating code
• Comfortable with technical writing and high attention to detail

Project Details

• Start: Immediate
• Duration: 1–2 months (may be extended/shortened)
• Commitment: Part-time 15–25 hours/week, flexible up to 40 hours/week
• Engagement: Independent contractor
• Schedule: Fully remote; completed on your own schedule

Interview / Onboarding

• Upload resume
• 15-minute AI interview (conversational) followed by next steps and onboarding details