About the role

Role overview

You’ll join DataAnnotation to train AI models by evaluating AI chatbots’ coding ability and logic. The work involves giving or preparing coding challenges, assessing outputs for correctness and performance, and improving evaluation quality.

Responsibilities

Provide AI chatbots with coding challenges and evaluate their outputs
Assess AI-generated solutions for correctness and performance
Identify and solve problems to improve overall model quality
Explain how your solutions solve the given coding problems

Requirements

Proficiency in either Python and/or JavaScript
Ability to solve coding problems (e.g., LeetCode/HackerRank) in at least one programming language
Strong experience with algorithms, data structures, and debugging workflows
Fluency in English (native or bilingual level)
Detail-oriented approach to evaluation

Nice to haves

A current, in-progress, or completed Bachelor’s degree (preferred, not required)

Work details

Remote position (full-time or part-time)
Choose which projects you want to work on; flexible schedule
Paid hourly up to $60 USD/hour, with bonuses for high-quality and high-volume work
Payment via PayPal

Location constraint

Only applicants in the United States are considered

About DataAnnotation

DataAnnotation provides remote, paid opportunities for people to help train and evaluate AI models, including measuring chatbot performance and reasoning quality. The work supports AI model development through coding challenge creation and structured evaluation of AI outputs.

Web Application Developer

Tags