xelys jobs xelys jobs

Tech Lead Databricks Data Engineer

Mitre Media

remoteleadcdidata USA, Canada, USA timezones 15 days ago via Remotive
150,000 - 185,000 CAD/annual

See how well this job matches your profile

Sign up to get an AI match score and generate a tailored application in seconds.

Get your match score

Tech Stack

PythonScalaJavaDatabricksApache SparkDelta LakeDBTSQLAWSGCPS3GCSEMRDataprocGlueDataflowApache AirflowLuigiDagsterLookerTableauVector Databases

About the role

Role Overview

As Tech Lead Data Engineer, you'll architect and maintain the data backbone powering features across Mitre Media's product suite. Reporting to the CTO, you'll design Databricks-based ETL pipelines, model complex investment data, and surface low-latency, high-quality datasets for user-facing features and internal AI/analytics workloads.

Key Responsibilities

  • Design, implement, and optimize large-scale ETL workflows in Databricks (Apache Spark, Delta Lake, DBT)
  • Develop algorithms that transform raw market data into actionable insights
  • Own data quality and lineage, instituting tests, monitoring, and alerting for mission-critical pipelines
  • Evolve the cloud data platform (AWS & GCP) for scale, performance, and cost efficiency
  • Mentor engineers and champion best practices in code reviews, documentation, and DevOps for data
  • Collaborate in a remote-first hybrid culture using Shape Up for project planning

Required Technical Skills

  • Data Engineering & Programming: Expert in Python plus working knowledge of Scala or Java
  • Databricks & Spark: Hands-on cluster tuning, job orchestration, and Delta Tables
  • SQL & DBT: Strong analytical SQL, modular data-model design, and CI/CD for transformations
  • Cloud Platforms: Production experience with AWS or GCP data services (S3/GCS, EMR/Dataproc, Glue/Dataflow)
  • ETL & Orchestration: EL(T) patterns, workflow scheduling, and incremental processing
  • Data Modeling: Dimensional and schema-on-read designs for analytics and AI
  • AI & Analytics Enablement: Building feature stores or inference-ready tables for ML/LLM workflows; familiarity with vector databases or embedding pipelines

Nice-to-Have Skills

  • Apache Airflow, Luigi, or Dagster for DAG orchestration
  • Looker, Tableau, or Stripe's Vizier-style visualization stacks
  • Financial-markets domain knowledge (equities, ETFs, mutual funds)
  • Machine-learning engineering or statistical-analysis background

Required Soft Skills

  • Entrepreneurial mindset with passion for AI and FinTech
  • Self-starter who diagnoses problems and delivers pragmatic solutions
  • Clear communicator thriving in distributed, cross-functional teams
  • Mentorship attitude; uplifts peers through knowledge-sharing
  • Detail-oriented with discipline around data accuracy and documentation

About Mitre Media

Mitre Media is a FinTech company redefining investment insights through AI-driven tools. They operate premium financial platforms like Dividend.com and MutualFunds.com, serving millions of individual investors, financial advisors, and major asset managers like BlackRock and Vanguard with data, tools, and advertising solutions.

Scraped 3/28/2026

xelys jobs xelys jobs

Built for remote job seekers. Powered by AI.