Senior Data Engineer
CareScout
full-remoteseniorpermanentbackenddata Richmond, VA 158 days ago via LinkedIn
See how well this job matches your profile
Sign up to get an AI match score and generate a tailored application in seconds.
Get your match scoreTags
Data EngineeringDatabricksSparkPythonSQLDelta LakeETL/ELTData ModelingData QualityMachine Learning Feature Pipelines
About the role
Role Overview
Join CareScout as a Senior Data Engineer in the Data & Machine Learning organization. You’ll design and deliver reliable, scalable data pipelines, models, and infrastructure that power analytics, ML/AI, and operational data needs on the Databricks Lakehouse.
Responsibilities
- Data pipeline engineering:
- Design, build, and maintain scalable ETL/ELT pipelines using Spark, Python, SQL, and Databricks
- Implement ingestion frameworks for batch and streaming sources
- Ensure pipelines meet SLAs, data quality standards, and production reliability
- Lakehouse modeling & architecture:
- Develop data models across raw, curated, and semantic layers using Delta Lake
- Create dimensional models, star schemas, and domain-layer datasets for analytics and ML
- Define standards for schema design, metadata, and lineage
- Data quality & observability:
- Add data validation, anomaly detection, SLAs, and documentation
- Build automated tests and monitoring/alerting for freshness, completeness, and accuracy
- Partner with platform teams to improve observability and operational tooling
- Collaboration & cross-functional support:
- Work with analysts on business KPIs and curated datasets
- Partner with ML engineers/data scientists on reusable feature pipelines
- Collaborate with platform engineers on compute, governance, and orchestration
Requirements
- Strong engineering fundamentals and deep knowledge of modern data architectures
- Experience transforming complex datasets into high-quality, well-modeled information
- Ability to own end-to-end pipelines, improve data quality/reliability, and raise engineering standards
- Comfortable collaborating across teams and mentoring others
Nice-to-haves (implied by responsibilities)
- Experience with lakehouse best practices (Delta Lake raw/curated/semantic layers)
- Strong observability/testing practices for production data systems
- Experience supporting both analytics and ML use cases
About CareScout
CareScout is building a unified experience for care seekers and families navigating long-term care, combining care options, non-healthcare resources, education, and human support. It is a wholly owned subsidiary of Genworth Financial, Inc., a Fortune 500 provider of products and solutions addressing the financial challenges of aging.
Scraped 6/22/2026