About the role

Role Overview

DevOps Engineer to support the training and evaluation of AI models and AI chatbots. You will measure chatbot/model progress, evaluate logic, and solve problems to improve model quality.

Responsibilities

Create coding challenges for AI chatbots and evaluate their outputs
Assess AI model results for correctness and performance
Debug and solve coding problems (e.g., LeetCode/HackerRank-style)
Explain how your solutions solve each problem

Requirements

Proficient in at least one of: Python and/or JavaScript
Proficiency in at least one programming language to solve coding problems (e.g., JavaScript, Python, C#, C++, HTML, SQL, Swift)
Fluency in English (native or bilingual)
Detail-oriented
Experience with algorithms, data structures, and debugging workflows
Ability to explain solutions clearly for each coding problem

Preferred

Bachelor’s degree (current/in progress/completed)

Work & Compensation

Remote (full-time or part-time)
Independent contract position
Work on your own schedule and choose projects
Paid hourly up to $60 USD/hour (hourly with bonuses for high-quality/high-volume work)
Payment via PayPal

About DataAnnotation

DataAnnotation is a technology company focused on training and evaluating AI models, including AI chatbots. The role centers on improving model quality by designing coding challenges and assessing the correctness and performance of model outputs.

Tags