QA Software Test Engineer Code Review - Remote

Role overview

Contribute as an independent contractor to create evaluation datasets for AI reasoning and explanation quality in coding-related interactions. Freelancers will craft realistic developer prompts and write technically accurate model responses for structured chat-style scenarios.

Responsibilities

• Craft realistic developer prompts across multiple categories (e.g., code review, debugging, error diagnosis, configuration)
• Source and adapt content from real PRs to create authentic evaluation scenarios
• Write clear, technically accurate responses that demonstrate strong reasoning and explanation quality

Qualifications

• 2+ years of experience in software engineering, technical research, or educational content development
• Bachelor’s degree minimum in Software Engineering, Computer Science, or related field (advanced degree preferred)
• Strong proficiency in one or more of: Python, JavaScript, Java, or C++
• Experience with debugging, testing, and validating code
• Comfort with technical writing and strong attention to detail

Timeline & commitment

• Start date: Immediate
• Duration: 1–2 months (may be extended/shortened based on needs and performance)
• Part-time: 15–25 hours/week (flexible up to 40 hours/week)

Hiring process

• Submit resume
• 15-minute conversational AI interview
• Follow-up communication within a few days