Machine Learning Engineer (Assessments)

Role overview

As a Machine Learning Engineer (Assessments) at Speak, you’ll work with the Assessment Design Lead and cross-functional teams to build, deploy, and continuously improve assessment algorithms and ML systems for language learning.

Responsibilities

• Conceive, implement, and deploy assessment algorithms and ML systems.
• Collaborate cross-functionally to translate assessment constructs into measurable scoring systems.
• Monitor performance, run regression testing, and iterate to maintain accuracy targets.
• Own the evaluation and validation of assessment systems to ensure reliability and quality over time.

Requirements

• 4+ years building automatic proficiency assessment systems (or equivalent scoring/evaluation experience).
• Strong experience in designing and running evaluation + validation for assessment/scoring systems tailored to a specific product use case.
• Strong generalist ML/analysis skills, including statistics, Python, and model training.
• Clear ability to operate with non-technical partners and communicate with Content/LD, PM, and leadership.
• Demonstrated ability to ship ML models to production, including reliability, monitoring, and iteration.
• Experience with speech/audio ML.
• Domain expertise in spoken language proficiency assessment (linguistics, applied linguistics, pedagogy, or equivalent).
• Familiarity with psychometrics concepts such as reliability/validity and calibration.

Nice to have

• PhD helpful (not required).