QA Software Test Engineer -Code Review - Remote

Role Overview

Support high-impact research collaborations with leading AI labs by contributing to building evaluation datasets that assess AI reasoning, explanation quality, and technical judgment in coding-related interactions. This freelance opportunity allows you to apply your engineering expertise toward shaping next-generation intelligent systems.

Project Details

The evaluation dataset focuses on code question-and-answer data designed to assess natural-language reasoning, explanation quality, and technical judgment in coding interactions—rather than executable correctness. Tasks are structured as chat-pasteable prompts reflecting realistic developer questions with all necessary context inline (code snippets, error messages, logs, requirements).

Key Responsibilities

• Craft realistic developer prompts across multiple categories (code review, debugging, error diagnosis, configuration, and more)
• Source and adapt content from real PRs to create authentic scenarios
• Write clear, technically accurate model responses that demonstrate strong reasoning and explanation quality

Ideal Qualifications

• 2+ years of experience in software engineering, technical research, or educational content development
• Degree in Software Engineering, Computer Science, or related field (Bachelor's minimum; advanced degree preferred)
• Strong proficiency in languages like Python, JavaScript, Java, or C++
• Experience with debugging, testing, and validating code
• Comfortable with technical writing and attention to detail

Project Timeline

• Start Date: Immediate
• Duration: 1–2 months
• Commitment: Part-time (15–25 hours/week, with flexibility up to 40 hours/week)

Application Process

• Upload your resume
• Participate in a short 15-minute conversational AI interview
• Receive follow-up communication within a few days with onboarding details