Generative AI Data Analyst - USA (Remote)

Role Overview

Welo Data is seeking a Generative AI Data Analyst (Remote, USA) to support a high-impact machine learning project. You’ll create high-quality prompts and responses, lead LLM labeling initiatives, and help evaluate model outputs for quality and correctness.

Responsibilities

• Write prompts and responses across diverse topics
• Perform LLM annotation and evaluation tasks, including:
  • ranking, scoring, labeling, and tagging
• Evaluate model outputs for:
  • accuracy, relevance, and instruction-following
• Identify and document issues such as hallucinations and inconsistencies
• Participate in and/or support labeling workflows and collaborate with internal/external partners
• Train teams on best practices for LLM development and dataset/prompt quality

Requirements

• Hands-on experience with data annotation and/or evaluation (labeling, ranking, scoring, or tagging LLM outputs)
• Native or near-native U.S. English with excellent writing skills
• Strong attention to detail and consistent guideline-following
• Self-driven and enthusiastic about state-of-the-art machine learning tools
• 4-year accredited degree or equivalent experience
• Valid U.S. work authorization (no visa sponsorship)

Nice to Have

• Degree/experience in Linguistics, English Literature, Creative Writing, Journalism, plus relevant domain knowledge (e.g., Law/Medical/Math/Coding)
• Experience with annotation platforms or structured labeling environments
• Deep understanding of Large Language Models and RLHF
• Experience labeling/tagging frames/tasks/prompts for downstream QA/testing

Employment Details

• Full-time (W-2), 40 hours/week, 5 days/week
• Remote (USA)
• Start date: April 2026
• Rate: $27.38/hour (California candidates should apply to the California-specific posting)