xelys jobs xelys jobs

Data Engineer

Reality Defender

midpermanentbackenddata New York, NY 122 days ago via LinkedIn

See how well this job matches your profile

Sign up to get an AI match score and generate a tailored application in seconds.

Get your match score

Tags

Data EngineeringPythonSQLKubernetesAWSApache SparkRayAirflowETL/ELTMLOps

About the role

Role Overview

Reality Defender is hiring a Data Engineer to build and scale the infrastructure powering its data platform. You’ll design and operate pipelines that move, process, and prepare large-scale and streaming datasets (including audio/video) for detection models, collaborating closely with ML engineers and researchers.

Responsibilities

  • Design, build, and operate large-scale data processing pipelines for multi-terabyte and streaming datasets, including:
    • audio/video transcoding
    • feature extraction and preprocessing workflows
  • Deploy, scale, and troubleshoot containerized workloads on Kubernetes and AWS in production
  • Build and maintain distributed processing jobs using Spark and Ray
  • Orchestrate workflows (e.g., Airflow) with dependency management, retries, monitoring, and alerting
  • Administer and tune enterprise databases (performance tuning, backup/recovery, access control, scaling)
  • Partner with ML teams on training pipelines, model retraining triggers, feature stores, and other MLOps workflows

Requirements

  • Hands-on experience with Kubernetes and AWS (deploying, scaling, troubleshooting containers in production)
  • Proficiency with distributed/high-performance frameworks such as Spark and Ray
  • Experience with workflow orchestration tools like Airflow (or Dagster, Prefect, Luigi)
  • Strong Python and SQL skills (experience with Golang is a plus)
  • Demonstrated experience building/operating large-scale processing pipelines (multi-terabyte and/or streaming)
  • Strong plus: experience working with audio/video data at scale (transcoding, feature extraction, preprocessing)
  • Familiarity with large-scale ETL/ELT, batch and streaming patterns, and data validation/quality checks
  • Experience building orchestration with operational concerns (dependencies, retries, monitoring, alerting)

Nice to Haves

  • Experience orchestrating machine learning workflows (training pipelines, retraining triggers, feature stores, MLOps tooling)

Benefits (Highlights)

Healthcare (100% premium for employees), dental/vision, disability/life insurance, FSA/HSA, 401k, equity, 20 days PTO, 12 weeks parental leave, and learning/development support.

About Reality Defender

Reality Defender is an award-winning cybersecurity company that helps enterprises and governments detect deepfakes and AI-generated media. Its API-first, multi-model deepfake detection platform supports real-time identification of fraud, disinformation campaigns, and harmful deepfakes across video, audio, imagery, and text.

Scraped 7/24/2026