xelys jobs xelys jobs

Principal Database Infrastructure Engineer

VideoAmp

full-remoteleadpermanentbackenddata Full remote 107 days ago via WTTJ

See how well this job matches your profile

Sign up to get an AI match score and generate a tailored application in seconds.

Get your match score

Tags

Distributed SystemsDatabase InfrastructureRustAsync (Tokio)KubernetesAWS (S3, EKS)ArrowParquetDataFusionQuery Optimizer

About the role

Role overview

Join VideoAmp as a Principal Database Infrastructure Engineer (full remote, individual contributor). You will architect and drive execution of scalable, production-critical database and data infrastructure systems supporting live customers and internal teams.

Key missions / responsibilities

  • Architect and own foundational database systems to ensure scalability and reliability as the data platform grows.
  • Design and implement physical planning distribution, including:
    • network shuffle
    • coalescing
    • partition isolator insertion
  • Maintain core data exchange paths involving S3 and Flight result exchange.
  • Lead next-generation load balancing, including:
    • a work-stealing protocol
    • a replication-aware hash ring for resiliency to node loss.

Profile / requirements

  • Strong understanding of columnar formats and vectorized execution, including Arrow and Parquet.
  • Experience building or significantly modifying a distributed data system (query engine, stream processor, distributed database, or large-scale data pipeline), including shuffles, partitioning, and network/memory bottlenecks.
  • Solid distributed systems fundamentals: consistent hashing, leader & heartbeat protocols, backpressure, partial failure, and graceful degradation.
  • Performance engineering mindset: profile first, optimize with real benchmark evidence.
  • 8+ years of software engineering experience with deep database infrastructure / distributed systems / data platform engineering.
  • Strong systems programming in Rust, or deep C++/Go with a clear path to Rust (including async runtimes like Tokio and concurrent data structures).
  • Experience with distributed SQL infrastructure such as CockroachDB, Flight SQL, or gRPC (or meaningful contributions to open source data infrastructure).
  • Experience with developer tooling for agentic/programmatic data access (nice to have).
  • Query optimizer experience: join ordering, predicate pushdown, and cardinality/selectivity estimation.
  • Familiarity with Kubernetes and cloud infrastructure, including EKS, S3, and IRSA (especially on ARM/Graviton).
  • Experience with Apache Iceberg or similar open table formats (Delta Lake, Hudi).
  • Direct experience with Apache DataFusion or comparable SQL planning/optimization projects (e.g., Spark Catalyst, Calcite, Trino, ClickHouse, DuckDB).

Nice-to-haves

  • Experience building developer tooling for agentic or programmatic data access contexts.
  • Experience with ARM/Graviton environments and Kubernetes cloud primitives (EKS/IRSA).

About VideoAmp

VideoAmp is a technology company focused on building scalable data infrastructure for serving live customers and enabling internal data teams. The role sits at the intersection of distributed database engineering, query performance, and storage architecture in a reliability-driven engineering culture.

Scraped 8/7/2026