Remote Senior Software Engineer

Role overview

Remote Senior Software Engineer (Contract) — Software Engineering evaluator for building and refining training and benchmarking datasets for large language models. You will collaborate with AI researchers to curate code examples, provide precise solutions, and correct AI-generated code.

Responsibilities

• Curate code examples and build solutions for training, benchmarking, and LLM advancement
• Evaluate and refine AI-generated code for efficiency, scalability, and reliability
• Develop Python-based agents and automated verification tools to validate code quality and detect error patterns
• Design verification mechanisms to automatically verify solutions to software engineering tasks
• Work across the software engineering lifecycle (e.g., prototyping, architecture/API design, production implementation, launch, experiments, monitoring, maintenance)
• Collaborate with cross-functional teams to improve enterprise-level AI-driven coding solutions against performance benchmarks

Required skills

• 3+ years of software engineering experience
• Strong Python expertise, including production-grade software practices, frameworks, and tooling
• Experience building full-stack applications and deploying scalable software using modern languages and tools
• Deep understanding of software architecture, design, debugging, and code quality/review assessment
• Excellent communication skills for clear, structured evaluation rationales

Nice-to-haves / additional focus

• Ability to work across multiple languages: JavaScript (ReactJS), C/C++, Java, Rust, Go

Engagement details

• Type: Contractor (no medical/paid leave)
• Duration: 1 month (may extend based on performance/fit)
• Time commitment: minimum 10 hrs/week, up to 40 hrs/week
• Location: Must be based in the United States
• Interview process: 15–30 minutes application + AI video interview required