Anti-Bot Engineer

About the role

Join Adthena as an Anti-Bot Engineer, where you'll design and operate large-scale web scraping systems with a focus on Google and similar search environments. This role combines data engineering, reverse engineering, and systems reliability, and is crucial for delivering accurate and trustworthy data at scale. You'll work on complex scraping challenges, build scrapers for dynamic pages, and engineer robust extraction pipelines. Enjoy benefits like flexible working, stock options, and comprehensive medical insurance. Key missions: Design, build, and operate large-scale, resilient web scraping systems, with a strong focus on Google and Google-like search environments.. Continuously adapt to changes in page structure, request flows, and anti-automation mechanisms, and engineer robust extraction pipelines.. Monitor scrape health, detect failures early, and rapidly debug production issues, while optimizing performance, cost, and latency across scraping infrastructure. Profile: - The role is ideal for someone who believes in agentic coding and would like to improve their skills - Research shows men apply if they meet ~60% of the criteria, while women and underrepresented groups apply only if they meet all requirements. If you have the skills but don't meet every requirement, reach out – we'd love to explore how you could be a great fit! - Strong knowledge of HTML parsing, DOM traversal, and data extraction techniques - Strong debugging skills and ability to reason about complex failure modes - Experience with headless browser fingerprinting and anti-bot evasion techniques - Strong professional experience with Python (or another main language, i.e. GoLang, Rust, JavaScript) including production-grade scraping systems - Experience handling rate limiting, CAPTCHA, IP rotation, and bot detection systems - Experience with tools such as Playwright, Selenium, Puppeteer, or equivalent browser automation frameworks - Experience running scrapers at scale in cloud environments - Deep hands-on experience scraping Google or similarly protected platforms - Comfortable working with asynchronous and concurrent scraping architectures - Solid understanding of HTTP, TLS, cookies, headers, redirects, and browser networking behaviour - Experience with distributed task systems and job queues - Curiosity about how large platforms evolve their defences and infrastructure - Pragmatic problem-solving in hostile and fast-changing technical environments - Familiarity with containerisation and orchestration, such as Docker and Kubernetes - Experience working with search, advertising, or competitive intelligence data - Background in data quality monitoring and anomaly detection - Ability to explain complex technical behaviour clearly to non-specialists - High ownership of systems that run continuously and at scale - A strong bias toward reliability, correctness, and observability