Remote Software Engineer (Go)

Role Overview

You will help build LLM evaluation and training datasets centered on realistic software engineering tasks. The work includes developing verifiable SWE tasks derived from public GitHub repository histories, using a synthetic approach with human-in-the-loop.

Day-to-Day Responsibilities

• Analyze and triage GitHub issues across trending open-source libraries.
• Set up and configure code repositories, including Dockerization and environment setup.
• Evaluate unit test coverage and overall test quality.
• Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
• Collaborate with researchers to design and identify repositories/issues that are challenging for LLMs.
• Lead a team of junior engineers (tech lead level).

Required Skills

• 3+ years of overall experience.
• Strong proficiency in Go.
• Proficiency with Git and Docker, including basic software pipeline setup.
• Ability to understand and navigate complex codebases.
• Comfort running, modifying, and testing real-world projects locally.
• Experience contributing to or evaluating open-source projects is a plus.

Nice to Have

• Experience participating in LLM research or LLM evaluation projects.
• Experience building/testing developer tools or automation agents.

Contract / Commitments

• Contractor assignment (no medical/paid leave).
• Minimum 20 hours/week, at least 4 hours/day, with 4 hours overlap with PST.
• Options: 20 hrs/week, 30 hrs/week, or 40 hrs/week.