Lead Compute Platform Engineer
zetaglobal
hybridleadpermanentbackenddata Berlin 40 days ago via Arbeitnow
See how well this job matches your profile
Sign up to get an AI match score and generate a tailored application in seconds.
Get your match scoreTags
ScalaApache SparkHadoopEC2 Spot InstancesLakehouseData WarehouseType-Safe DevelopmentBatch JobsMentoringCost-Efficient Data Processing
About the role
Role Overview
Lead Compute Platform Engineer on the Data Platform team, responsible for building and running the data infrastructure that powers Zeta’s platform (including the lakehouse platform). The team focuses on reliable, cost-efficient data processing that scales with growth.
What You’ll Do
- Operate and implement new features in the framework and services managed by the team
- Partner with data scientists to improve their experience and productivity using the framework and services
- Develop and deploy next-generation platform technology in close collaboration with teams in San Francisco and Berlin
- Grow the team through mentoring, code reviews, and knowledge sharing
Core Platform / Environment
- Scala-based data warehouse framework for data modeling and type-safe, easily testable batch jobs
- Orchestrated compute environment to simplify Spark job execution for large-scale data processing
- Hadoop clusters running on EC2 spot instances with dynamic scaling for high utilization and stability
Requirements
- Senior-level experience building and operating data/compute infrastructure and frameworks
- Strong software engineering practices (e.g., mentoring, code reviews, collaborative development)
Nice to Have
- Experience with Spark, Hadoop, and cloud-based dynamic compute orchestration (spot instances)
- Familiarity with type-safe Scala data modeling and testable batch job frameworks
About zetaglobal
Zeta Global is an AI-powered marketing cloud company (NYSE: ZETA) that helps marketers acquire, grow, and retain customers more efficiently. Through the Zeta Marketing Platform, it unifies identity, intelligence, and omnichannel activation using AI and large proprietary data assets to personalize experiences across channels.
Scraped 8/14/2026