Data Engineer - Remote

Role Overview

Data Engineer (Fully Remote) supporting a modern data platform on Databricks. You will build scalable data pipelines, implement a metadata-driven ingestion framework, and ensure data quality and governance are built into the platform.

Responsibilities

• Develop and maintain data pipelines using PySpark and Databricks
• Use a metadata-driven ingestion framework to onboard new datasets
• Implement data quality checks and validation rules within pipelines
• Support ingestion from file-based sources and tools such as Fivetran
• Handle schema changes, incremental loads, and file processing patterns
• Contribute to data governance (tagging, metadata, lineage)
• Troubleshoot pipeline failures and performance issues
• Collaborate with architects and stakeholders on data onboarding and requirements
• Follow coding standards using reusable components and best practices

Requirements

• 3+ years relevant experience with a bachelor’s degree, or 5+ years without a bachelor’s degree
• Hands-on experience with PySpark and Databricks
• Strong SQL skills
• Experience building ETL/ELT data pipelines
• Understanding of Delta Lake concepts (merge, schema evolution, partitions)
• Familiarity with cloud platforms (Azure preferred)
• Basic Git / version control experience
• Exposure to data catalog/governance tools (e.g., DataHub)
• Experience with Fivetran or similar ingestion tools
• Understanding of data quality and validation concepts
• Experience with metadata-driven frameworks
• Strong problem-solving and debugging skills
• Ability to work in a structured, framework-driven environment (focus on data quality)

Nice to Haves

• Experience with data governance tooling such as DataHub
• Strong familiarity with ingestion tooling like Fivetran

Compensation & Benefits

• Base pay: $80,204.80 – $133,681.60/year
• Additional compensation may include incentives/bonuses and shift differentials (as applicable)
• Comprehensive benefits including medical/dental/vision, PTO, parental/family caregiver leave, disability/critical illness, 401(k)/403(b) match, tuition assistance, and professional development support

Remote Policy

Fully remote; remote opportunities available in the following states: AL, DE, FL, GA, ID, IN, KS, LA, ME, MD, MN, NE, NV, NH, NC, ND, OH, OK, PA, SC, SD, TN, TX, UT, VA, WA (state), WV, WI, WY.