Senior Data Engineer

Role Overview

Senior Data Engineer (Mode: Contract - long term, remote; available for EST business hours). You’ll help ensure data used for reporting and operational workflows is accurate, complete, timely, and trustworthy, with a focus on data quality engineering, monitoring, investigation, and remediation.

Responsibilities

Data Quality Engineering & Monitoring (45%)

• Design and implement automated data quality checks (completeness, accuracy, consistency, freshness, schema integrity).
• Build monitoring, alerting, observability for anomalies, pipeline failures, data drift, and unexpected changes.
• Develop and maintain reconciliation processes across sources, transformed datasets, reports, and operational outputs.
• Partner with engineers/analysts to define quality rules and acceptance criteria.
• Create reusable frameworks, scripts, and tooling for data profiling, testing, and validation.

Investigation, Analysis & Remediation (35%)

• Trace data across systems and transformations to identify root causes.
• Use SQL, Python, and cloud data tools to analyze large datasets and validate business logic.
• Support incident response and resolution for production data issues.
• Work with cross-functional teams to remediate defects and reduce recurrence.
• Communicate findings and quality trends to technical and non-technical stakeholders.

Governance, Documentation & Team Success

• (Section referenced in posting; details not provided beyond the heading.)

Requirements

• Strong experience writing super complex SQL queries for reporting.
• Experience working with large datasets.
• Hands-on data engineering for data quality checks, monitoring/alerting, and remediation.

Preferred / Tooling & Interview Protocol

• Uses/experiences indicated in interview levels:
  • Python (Level 5)
  • Redshift (Level 3)
  • AWS (general) including S3 (Level 4), Glue (Level 3), Athena (Level 3), Lambda (Level 2), SNS/SQS (Level 1)
  • Apache Spark for big data processing
  • Tableau (Desktop/Creator Level 1) and QuickSight (Level 2)
  • At least one AI tool: Amazon Q / Google Cloud AI / Google Cloud Smart Analytics / Tableau AI