Sr. Principal Data Engineer / Data Architect

Role Overview

As Sr. Principal Data Engineer / Data Architect, you will be the primary architect of a next-generation data platform for high-scale AdTech telemetry. You will design the blueprint for how data is handled end-to-end, bridging business priorities and technical execution.

Responsibilities

• Architectural leadership: Design and oversee migration/optimization of a data lakehouse on Databricks.
• Production excellence: Act as the escalation point for mission-critical pipelines, ensuring 24/7 reliability.
• Strategic capacity planning: Translate product roadmaps into technical requirements in partnership with the SVP of Tech.
• Infrastructure as code: Drive standardization of deployments using Databricks Asset Bundles (DABs) across dev/staging/production.
• Mentorship & governance: Provide guidance to engineering squads (India and US) on schemas and governance models for BigQuery and Databricks.

Requirements (Mandatory)

• Databricks expertise: 4+ years hands-on experience in the Databricks ecosystem, including:
  • Delta Lake
  • Unity Catalog
  • Photon
• Core stack: Deep proficiency in Spark (PySpark/Scala), Python, and SQL.
• Scale: Experience managing petabyte-scale datasets and high-concurrency pipelines (AdTech preferred).
• Execution: Self-starter who can take concepts from the SVP and drive them to completion with minimal supervision.
• Experience level: 10+ years in data engineering, including 3+ years in a Principal/Architect capacity.

Preferred Qualifications

• Proven ability to diagnose and resolve complex production bottlenecks and data outages.
• Strong ability to context switch between long-term architectural R&D and urgent partner/product needs.
• FinOps & stakeholder communication: Ability to optimize Databricks/BigQuery costs and clearly explain trade-offs to non-technical stakeholders.

Additional Notes

• Remote (United States). HQ is Austin, TX.
• No visa sponsorship (including H-1B and related programs).