Remote Senior Software Engineer

Role overview

As a Remote Senior Software Engineer (Software Engineering evaluator), you will create high-quality datasets used for training, benchmarking, and improving large language models, working closely with AI researchers.

Responsibilities

• Curate code examples for model training and evaluation.
• Provide precise solutions and correct AI-generated code.
• Evaluate and refine AI-generated code for efficiency, scalability, and reliability.
• Collaborate with cross-functional teams to improve enterprise AI-driven coding solutions.
• Build/assist with agents that verify systems-level and infrastructure code and identify error patterns.
• Hypothesize and evaluate steps across the software engineering lifecycle (e.g., prototyping, architecture/API design, production implementation, launch, experiments, monitoring, operational maintenance).
• Design verification mechanisms to automatically verify software engineering tasks and solutions.

Required skills

• 3+ years of software engineering experience.
• Strong expertise in systems programming / infrastructure / backend development.
• Hands-on experience with Python, C/C++, Rust, and Go.
• Experience building and deploying scalable, production-grade software.
• Deep understanding of software architecture, design, development, debugging, and code quality/review assessment.
• Excellent written and oral communication for clear evaluation rationales.

Nice to have

• Experience with Java and JavaScript/ReactJS (explicitly mentioned in the role description).
• Familiarity with software engineering benchmarks and performance-critical systems.

Engagement details

• Type: Contractor
• Duration: 1 month (possible extensions)
• Time commitment: minimum 10 hrs/week, up to 40 hrs/week
• Location: Must be based in the United States

Hiring process

• Application takes 15–30 minutes
• AI video interview is required (portal login provided via email after applying).