QA Software Test Engineer Code Review - Remote
YO IT Consulting
full-remotemidcontractqa New York, United States Today via LinkedIn
See how well this job matches your profile
Sign up to get an AI match score and generate a tailored application in seconds.
Get your match scoreTags
QASoftware TestingCode ReviewDebuggingTechnical WritingPythonJavaScriptJavaC++Evaluation Datasets
About the role
Role Overview
Independent contractor QA/Software Test Engineer focused on high-impact research collaborations with leading AI labs. You will help build evaluation datasets (code Q&A) that assess AI reasoning, explanation quality, and technical judgment in coding-related conversations.
Responsibilities
- Craft realistic developer prompts across categories such as:
- Code review
- Debugging
- Error diagnosis
- Configuration and related scenarios
- Source and adapt content from real PRs to create authentic evaluation cases
- Write clear, technically accurate model responses that demonstrate strong reasoning and explanation quality
Requirements
- 2+ years of experience in software engineering, technical research, or educational content development
- Degree in Software Engineering, Computer Science, or related field (Bachelor’s minimum)
- Strong proficiency in Python, JavaScript, Java, or C++
- Experience with debugging, testing, and validating code
- Comfortable with technical writing and high attention to detail
Project Details
- Start: Immediate
- Duration: 1–2 months (may be extended/shortened)
- Commitment: Part-time 15–25 hrs/week, flexible up to 40 hrs/week
- Engagement: Independent contractor (fully remote; on your own schedule)
Hiring Process
- Submit resume
- AI interview (15-minute conversation)
- Follow-up with next steps and onboarding details
About YO IT Consulting
YO IT Consulting provides consulting services that support engineering and technical research collaborations. The project described involves building evaluation datasets for AI systems, focused on reasoning and coding-related interactions.
Scraped 4/7/2026