Data Scientist – AI Training & Evaluation

Role Overview

Data Scientists (US-based) needed to help train, evaluate, and improve next-generation AI systems, with a focus on model output quality and reliability.

What You'll Do

• Evaluate AI model outputs for accuracy, reasoning quality, and statistical soundness
• Design and apply evaluation frameworks using data-driven criteria and scoring rubrics
• Analyze AI responses to identify systematic errors and biases
• Create training data (prompts, solutions, and annotations) in your areas of expertise
• Provide structured, detailed feedback to improve model performance on data science/analytical tasks
• Review AI-generated code, visualizations, and statistical analyses for correctness
• Work independently and asynchronously on your own schedule

Who You Are

• Based in the United States (New York metro area mentioned)
• Degree in Data Science, Statistics, Computer Science, Mathematics, or related quantitative field (MS/PhD preferred)
• Strong foundation in statistics, probability, and machine learning
• Proficiency in Python, R, and/or SQL
• Experience with data wrangling, exploratory data analysis, and model evaluation
• Excellent analytical thinking and attention to detail
• Clear written communication
• Self-motivated and comfortable working independently

Nice to Have

• Deep learning frameworks: PyTorch or TensorFlow
• Familiarity with NLP, LLMs, or AI evaluation workflows
• Published research or applied machine learning industry experience
• Background in A/B testing, causal inference, or experimental design

Contract & Schedule

• Hourly contract: $25–$40/hour
• Remote-first (US-based)
• 10–40 hours/week

Application Process

• Submit resume
• Short screening
• Project matching and onboarding