QA Software Test Engineer Code Review - Remote

Role Overview

Independent contractor QA Software Test Engineer focused on building evaluation datasets for AI research collaborations. You’ll craft realistic developer prompts and write technically accurate responses to assess AI reasoning, explanation quality, and technical judgment in coding-related interactions (not executable correctness).

Responsibilities

• Create realistic developer prompt scenarios across multiple categories (e.g., code review, debugging, error diagnosis, configuration)
• Source and adapt content from real pull requests to produce authentic evaluation cases
• Write clear, technically accurate model responses emphasizing reasoning and explanation quality
• Ensure prompts are chat-pasteable and include all necessary inline context (code snippets, error messages, logs, requirements)

Requirements

• 2+ years of experience in software engineering, technical research, or educational content development
• Bachelor’s minimum (Software Engineering, Computer Science, or related field); advanced degree preferred
• Strong proficiency in Python, JavaScript, Java, or C++
• Experience with debugging, testing, and validating code
• Comfortable with technical writing and strong attention to detail

Project & Engagement Details

• Start: Immediate
• Duration: 1–2 months (may be extended/shortened based on needs)
• Time commitment: Part-time 15–25 hours/week, flexible up to 40 hours/week
• Work: Fully remote; independent contractor; can be completed on your own schedule

Hiring Process

• Upload resume
• 15-minute AI interview conversational session
• Follow-up communication with next steps and onboarding