xelys jobs xelys jobs

Data Engineer

Whatnot

hybridmidpermanentbackenddata San Francisco, CA 49 days ago via LinkedIn

See how well this job matches your profile

Sign up to get an AI match score and generate a tailored application in seconds.

Get your match score

Tags

Data EngineeringKafkaDebeziumdbtSparkFlinkAirflowDagsterSnowflakeSnowflake

About the role

Role Overview

As a Data Engineer at Whatnot, you’ll build and scale data systems that power data-driven decisions across the company. You’ll partner with stakeholders across product, sales, marketing, finance, and trust to design reliable data architectures, ship resilient pipelines, and deliver foundational data products for internal and external growth.

Responsibilities

  • Own data architecture end-to-end: define how data is captured, modeled, and served; implement in production.
  • Make architectural decisions around storage formats, compute patterns, and SLAs balancing cost, scalability, and consistency.
  • Build and operate streaming + batch pipelines for high-volume events (e.g., user activity, transactions, experimentation, marketing performance, and telemetry), with strong guarantees for latency, completeness, and accuracy.
  • Design canonical, domain-oriented data models that act as the source of truth for analytics, ML, and real-time applications.
  • Establish modeling standards, ownership boundaries, and data contracts across teams.
  • Enforce data quality at scale using tests, lineage, monitoring, and reconciliation so anomalies are observable and actionable.
  • Automate operational workflows by reducing manual data handoffs and reconciling data across services, warehouses, and external systems.
  • Enable insights and experimentation by providing high-quality, low-latency data through semantic layers, APIs, and real-time query systems.
  • Work across multiple teams (product, analytics, or data platforms) depending on need and experience.

Requirements

  • 3+ years experience as a data or software engineer building data warehouses, distributed data systems, or event-driven architectures.
  • Ability to design and implement data models using dimensional, Data Vault, or ledger-style techniques for analytical and transactional workloads.
  • Hands-on expertise across:
    • Ingestion: Kafka, Debezium
    • Transformation: dbt, Spark, Flink
    • Orchestration: Dagster, Airflow
    • Observability: Monte Carlo, Great Expectations
  • Experience operating cloud data warehouses such as Snowflake, BigQuery, or Redshift, including schema design, cost optimization, and workload tuning.

About Whatnot

Whatnot is the largest livestream shopping platform in North America and Europe, enabling people to buy, sell, and discover products across hundreds of categories. The company builds live commerce at significant scale and operates as a remote, co-located organization with teams across the US, UK, Ireland, Poland, Germany, and Australia.

Scraped 6/15/2026