Senior Data Platform Engineer

Role overview

Join Upstart’s Data Curation team as a Senior Data Platform Engineer. You will design and build scalable data platform infrastructure, create self-serve tooling for data transformation workflows, and improve data reliability and observability. Your work will help teams across Upstart discover, trust, and use data for better decision-making.

Key missions

• Design and build scalable data platform infrastructure, including distributed systems for:
  • data discovery
  • metadata management
  • data access
• Develop and maintain self-serve tooling enabling teams to perform:
  • data transformations
  • testing
  • deployment workflows within the Lakehouse
• Improve data reliability and observability by building:
  • monitoring and alerting
  • data quality validation

Requirements

• Experience designing, deploying, and maintaining production-grade data systems, including monitoring and reliability practices
• Proficiency in at least one programming language such as Python, Java, Scala, JavaScript, or Kotlin
• Experience building and operating distributed data systems/data platform infrastructure in a cloud environment (e.g., AWS)
• 4+ years of experience plus a Bachelor’s degree in CS/Engineering/Math (or equivalent practical experience)
• Experience with data processing frameworks/infrastructure such as Spark, Kafka, Airflow (or similar)
• Ability to collaborate with cross-functional stakeholders and translate data concepts into practical solutions

Nice to have / additional interests

• Interest in applying AI/ML to improve data accessibility, discovery, or user experience
• Experience building/supporting data platforms, developer tooling, or internal infrastructure products
• Knowledge of metadata management, data cataloging, or data governance systems
• Experience with Lakehouse architectures and Databricks (or similar modern data platforms)