Staff Backend Engineer
Grafana Labs
full-remoteleadpermanentbackendengineering-management Full remote 194 days ago via WTTJ
See how well this job matches your profile
Sign up to get an AI match score and generate a tailored application in seconds.
Get your match scoreTags
GoDistributed SystemsTempoOpenTelemetryOperational ExcellenceKubernetesAPI DesignOpen SourceSQL/Query EnginesSLOs
About the role
Role Overview
Join Grafana Labs as a Staff Backend Engineer working on Tempo, the open-source distributed tracing backend. This is a full-remote role open to candidates in the US and Canada. You will lead technical initiatives, own core architecture, and mentor engineers while driving operational excellence.
Key Missions
- Set technical direction on complex roadmap problems and lead multi-quarter initiatives
- Own the architecture of core Tempo components
- Design APIs for both humans and agents and shape the next generation of Tempo interfaces
- Drive operational excellence for production reliability and performance
- Mentor engineers and raise the engineering bar through code review, design feedback, and pairing on hard problems
Responsibilities
- Lead end-to-end technical work from design and delivery through operations
- Produce and drive technical alignment via design docs, reviews, and shipped code
- Improve maintainability, performance, and robustness of backend systems
Requirements
- Strong software craftsmanship (clean, robust, performant, maintainable code)
- Deep systems experience building and operating distributed data systems (e.g., ingestion pipelines, storage engines, query execution)
- Strong Go experience (or a clear path to it; Tempo is written in Go)
- Customer-focused, pragmatic iteration: break problems into short feedback loops (analyze → design → MVP → learn → iterate)
- Leadership through writing and collaboration in a fully remote asynchronous environment
- Technical leadership track record: led complex, multi-quarter initiatives spanning design, delivery, and operations
- Operational mindset: owned production services, carried pager, reduced toil, and treated SLOs as a product feature
Nice to Have
- Experience with tracing / OpenTelemetry / observability systems
- Experience designing query languages, SQL/TraceQL-like engines, or programmatic APIs
- Experience with columnar storage (e.g., Parquet) or purpose-built on-disk formats
- Experience operating multi-tenant, multi-cell SaaS infrastructure at scale on Kubernetes
- Experience building for AI/LLM consumers (structured APIs, metadata/discovery endpoints, deterministic outputs, evaluation harnesses)
- Open-source contribution/maintainership and comfort engaging the community
- Prior experience as an on-call user of Grafana/Prometheus/Loki/Tempo (or via homelab)
- Experience working in fully remote, globally distributed teams
About Grafana Labs
Grafana Labs is the company behind Grafana and related open-source observability tooling. It builds and maintains products for monitoring, logging, and distributed tracing, with Tempo being an open-source distributed tracing backend.
Scraped 5/12/2026