Freelance Data Scraping Engineer (Python)

Role Overview

Mindrift is looking for a Freelance Python Data Scraping Engineer for the Tendem project. In this “AI Pilot” role, you will collaborate with Tendem Agents that automate repetitive tasks, while you apply critical thinking, domain expertise, and quality control to deliver accurate, actionable scraped datasets.

Responsibilities

• Own end-to-end data extraction workflows across complex websites, ensuring coverage, accuracy, and reliable delivery of structured datasets.
• Use internal tools such as Apify and OpenRouter, plus custom workflows to accelerate scraping, validation, and execution.
• Extract data reliably from dynamic, interactive web sources, including JavaScript-rendered content and changing site behavior.
• Apply data quality controls: validation checks, cross-source consistency, formatting adherence, and systematic verification before delivery.
• Scale scraping via efficient batching/parallelization, monitor failures, and maintain stability against minor site structure changes.

Requirements

• 3+ years of relevant experience in data engineering, web scraping, automation, or software development.
• Strong Python web scraping experience with tools such as BeautifulSoup and Selenium, including dynamic content (JS, AJAX, infinite scroll) and API access (e.g., via proxies).
• Ability to extract data from complex and inconsistent structures (hierarchies, archived pages, messy HTML).
• Experience with data cleaning, normalization, and validation, producing structured outputs like CSV, JSON, or Google Sheets.
• Hands-on experience with LLMs/AI frameworks to improve automation and problem-solving.
• Strong attention to detail and commitment to data accuracy.
• Self-directed troubleshooting and independent problem solving.
• English proficiency: B2 or above.

Nice to Have

• Bachelor’s or Master’s degree in a technical field (Engineering, Applied Math, Computer Science, or related).
• A GitHub link.

Compensation & Work Setup

• Freelance/part-time remote.
• Earnings up to $37/hour equivalent, depending on level and pace; other projects may vary.
• Work fully remote on your own schedule (laptop + stable internet).