xelys jobs xelys jobs

QA Software Test Engineer Code Review - Remote

YO IT Consulting

full-remotemidcontractqa New York, United States Today via LinkedIn

See how well this job matches your profile

Sign up to get an AI match score and generate a tailored application in seconds.

Get your match score

Tags

QASoftware TestingCode ReviewDebuggingTechnical WritingPythonJavaScriptJavaC++Evaluation Datasets

About the role

Role Overview

Independent contractor QA/Software Test Engineer focused on high-impact research collaborations with leading AI labs. You will help build evaluation datasets (code Q&A) that assess AI reasoning, explanation quality, and technical judgment in coding-related conversations.

Responsibilities

  • Craft realistic developer prompts across categories such as:
    • Code review
    • Debugging
    • Error diagnosis
    • Configuration and related scenarios
  • Source and adapt content from real PRs to create authentic evaluation cases
  • Write clear, technically accurate model responses that demonstrate strong reasoning and explanation quality

Requirements

  • 2+ years of experience in software engineering, technical research, or educational content development
  • Degree in Software Engineering, Computer Science, or related field (Bachelor’s minimum)
  • Strong proficiency in Python, JavaScript, Java, or C++
  • Experience with debugging, testing, and validating code
  • Comfortable with technical writing and high attention to detail

Project Details

  • Start: Immediate
  • Duration: 1–2 months (may be extended/shortened)
  • Commitment: Part-time 15–25 hrs/week, flexible up to 40 hrs/week
  • Engagement: Independent contractor (fully remote; on your own schedule)

Hiring Process

  • Submit resume
  • AI interview (15-minute conversation)
  • Follow-up with next steps and onboarding details

About YO IT Consulting

YO IT Consulting provides consulting services that support engineering and technical research collaborations. The project described involves building evaluation datasets for AI systems, focused on reasoning and coding-related interactions.

Scraped 4/7/2026

xelys jobs xelys jobs

Built for remote job seekers. Powered by AI.