Remote JavaScript/React Engineer

Role Overview

You will work as a Software Engineering evaluator creating high-quality datasets for training, benchmarking, and improving large language models. The role involves closely collaborating with researchers to curate code examples and assess AI-generated solutions across the software engineering lifecycle.

Responsibilities

• Curate and produce code examples for datasets used in training and benchmarking.
• Evaluate and refine AI-generated code for efficiency, scalability, and reliability.
• Work across full-stack code: backend and ML workflows plus frontend and API layers.
• Provide precise solutions and corrections across different languages and stacks.
• Build verification mechanisms/agents to validate solutions and identify error patterns.
• Hypothesize and evaluate steps in the engineering cycle, including:
  • prototyping, architecture and API design
  • production implementation and launch
  • experiments, monitoring, and operational maintenance
• Evaluate model capabilities against industry performance benchmarks with cross-functional teams.

Required Skills

• 3+ years of software engineering experience.
• Strong full-stack development ability using:
  • Python (backend and ML workflows)
  • JavaScript (React, Node.js) (frontend and API layers)
• Experience deploying scalable, production-grade software.
• Deep understanding of software architecture, debugging, development, and code quality/review.
• Excellent written and verbal communication for structured evaluation rationales.

Nice to Have / Additional Context

• Experience with additional languages mentioned: C/C++, Java, Rust, Go.
• Comfort evaluating multiple phases of the software engineering process, including testing/verification and monitoring.

Engagement / Logistics

• Contractor role (no medical/paid leave).
• Commitment: 10–40 hours/week.
• Duration: 1 month, with potential extensions.
• US-based (must be located in the United States).
• Location listed: Salt Lake City Metropolitan Area (remote role details otherwise not specified).
• Process includes a 15–30 minute application and an AI video interview.