About the role

Role overview

As a DevOps Engineer (AI model training/evaluation), you will help train and improve AI chatbots by creating and evaluating coding challenges and assessing the correctness and performance of model outputs.

Responsibilities

Provide AI chatbots with coding challenges and evaluate their outputs
Assess the quality of AI model responses for correctness and performance
Solve problems and use programming to improve the quality of each model

Requirements

Proficient in Python and/or JavaScript
Able to solve coding problems in at least one of: JavaScript, Python, C#, C++, HTML, SQL, or Swift (e.g., LeetCode/HackerRank style)
For each coding solution, be able to explain how it solves the problem
Fluency in English (native or bilingual)
Detail-oriented with experience in algorithms, data structures, and debugging workflows

Nice-to-haves

Bachelor’s degree (current/in progress/completed) preferred

Contract & work details

Remote; you can choose your schedule
Work is paid hourly with bonuses for high-quality and high-volume work
Payment via PayPal

Location constraint

Only applicants in the United States are considered

About DataAnnotation

DataAnnotation is a US-based AI training and evaluation company that supports the development of AI models, including chatbots. The role focuses on assessing model outputs and improving quality through programming and problem-solving.

Tags