xelys jobs xelys jobs

Staff Backend Engineer

Grafana Labs

full-remoteleadpermanentbackendengineering-management Full remote 194 days ago via WTTJ

See how well this job matches your profile

Sign up to get an AI match score and generate a tailored application in seconds.

Get your match score

Tags

GoDistributed SystemsTempoOpenTelemetryOperational ExcellenceKubernetesAPI DesignOpen SourceSQL/Query EnginesSLOs

About the role

Role Overview

Join Grafana Labs as a Staff Backend Engineer working on Tempo, the open-source distributed tracing backend. This is a full-remote role open to candidates in the US and Canada. You will lead technical initiatives, own core architecture, and mentor engineers while driving operational excellence.

Key Missions

  • Set technical direction on complex roadmap problems and lead multi-quarter initiatives
  • Own the architecture of core Tempo components
  • Design APIs for both humans and agents and shape the next generation of Tempo interfaces
  • Drive operational excellence for production reliability and performance
  • Mentor engineers and raise the engineering bar through code review, design feedback, and pairing on hard problems

Responsibilities

  • Lead end-to-end technical work from design and delivery through operations
  • Produce and drive technical alignment via design docs, reviews, and shipped code
  • Improve maintainability, performance, and robustness of backend systems

Requirements

  • Strong software craftsmanship (clean, robust, performant, maintainable code)
  • Deep systems experience building and operating distributed data systems (e.g., ingestion pipelines, storage engines, query execution)
  • Strong Go experience (or a clear path to it; Tempo is written in Go)
  • Customer-focused, pragmatic iteration: break problems into short feedback loops (analyze → design → MVP → learn → iterate)
  • Leadership through writing and collaboration in a fully remote asynchronous environment
  • Technical leadership track record: led complex, multi-quarter initiatives spanning design, delivery, and operations
  • Operational mindset: owned production services, carried pager, reduced toil, and treated SLOs as a product feature

Nice to Have

  • Experience with tracing / OpenTelemetry / observability systems
  • Experience designing query languages, SQL/TraceQL-like engines, or programmatic APIs
  • Experience with columnar storage (e.g., Parquet) or purpose-built on-disk formats
  • Experience operating multi-tenant, multi-cell SaaS infrastructure at scale on Kubernetes
  • Experience building for AI/LLM consumers (structured APIs, metadata/discovery endpoints, deterministic outputs, evaluation harnesses)
  • Open-source contribution/maintainership and comfort engaging the community
  • Prior experience as an on-call user of Grafana/Prometheus/Loki/Tempo (or via homelab)
  • Experience working in fully remote, globally distributed teams

About Grafana Labs

Grafana Labs is the company behind Grafana and related open-source observability tooling. It builds and maintains products for monitoring, logging, and distributed tracing, with Tempo being an open-source distributed tracing backend.

Scraped 5/12/2026