About the role

Role overview

Join DataAnnotation as a DevOps Engineer to help train and evaluate AI models (AI chatbots). You’ll review chatbot outputs, run evaluations, and solve technical problems to improve model quality.

Responsibilities

Provide coding challenges to AI chatbots and evaluate their outputs
Assess AI model outputs for correctness and performance
Debug and solve coding problems to improve the quality of each model

Requirements

Proficient in Python and/or JavaScript
Experience solving coding problems (e.g., LeetCode, HackerRank, etc.) and ability to explain how solutions work
Fluent English (native or bilingual)
Detail-oriented approach
Strong foundation in algorithms, data structures, and debugging workflows

Nice to have

Bachelor’s degree (current/in-progress/completed)

Logistics / compensation

Remote (part-time or full-time)
Independent contract position
Work is paid hourly up to $60 USD/hour, with bonuses for high-quality and high-volume work
Payment via PayPal

Location restriction

Only applicants in the United States are considered

About DataAnnotation

DataAnnotation is a company that hires people to help train and evaluate AI models, including AI chatbots. The work focuses on generating coding challenges and assessing model outputs for quality, correctness, and performance.

Tags