QA Software Test Engineer Code Review - Remote

Role Overview

QA Software Test Engineer (Code Review) — Remote

Independent contractor role supporting the creation of evaluation datasets for AI reasoning and technical judgment. Freelancers will craft realistic coding prompts and produce high-quality responses focused on reasoning, explanation quality, and judgment rather than executable correctness.

Responsibilities

• Create realistic developer prompts across categories such as:
  • Code review
  • Debugging
  • Error diagnosis
  • Configuration
  • Other coding-related scenarios
• Source and adapt content from real pull requests to build authentic evaluation cases.
• Write technically accurate, well-explained model responses demonstrating strong reasoning.
• Ensure prompts are chat-pasteable and include all necessary inline context (code snippets, error messages, logs, requirements).

Ideal Qualifications

• 2+ years of experience in software engineering, technical research, or educational content development
• Bachelor’s minimum (Software Engineering, Computer Science, or related field); advanced degree preferred
• Strong proficiency in one or more: Python, JavaScript, Java, C++
• Experience with debugging, testing, and validating code
• Comfortable with technical writing and strong attention to detail

Contract & Schedule

• Engagement type: Independent contractor
• Fully remote; completed on your own schedule
• Start: Immediate
• Duration: 1–2 months (may extend/shorten based on needs)
• Hours: Part-time 15–25 hours/week, flexible up to 40 hours/week

Hiring Process

• Upload resume
• 15-minute AI interview (conversational)
• Follow-up with next steps and onboarding