Senior Data Engineer

Role Overview

Senior Data Engineer leading the design and implementation of robust data solutions across multiple domains. You will drive technical excellence in scalable batch and real-time pipelines, mentor other engineers, and influence data architecture and best practices.

Responsibilities

• Design, build, and scale high-performing batch and real-time data pipelines.
• Drive architectural decisions for transformation logic, storage formats, and schema design.
• Lead complex data ingestion efforts and mentor peers on performance optimization and scalability.
• Design and optimize data models and storage architecture balancing performance, scalability, and usability.
• Translate business requirements into robust data structures in partnership with stakeholders.
• Plan and execute delivery work; manage dependencies and escalate delivery risks.
• Establish and standardize data validation frameworks, testing strategies, and quality best practices.
• Perform root cause analysis for data quality issues and collaborate on SLAs and quality metrics.
• Automate, monitor, and scale production deployments for data pipelines.
• Build resilient workflows with retry logic, failure handling, and resource optimization.
• Proactively address reliability/performance issues; contribute to runbooks and on-call documentation.
• Maintain technical documentation for pipelines, data models, and system integrations; enforce development/documentation standards.
• Partner with product, analytics, and data science teams; communicate complex trade-offs and surface risks/blockers.
• Mentor junior engineers and support Agile ways of working and effective collaboration.

Required Qualifications

• 5–9 years of data engineering, data modeling, and pipeline development.
• Expert in SQL and Python for scalable pipeline development and debugging.
• Deep hands-on experience with Azure and Databricks, including Delta Live Tables and Unity Catalog.
• Experience with data integration/orchestration tools: SnapLogic, Azure Data Factory, Jenkins.
• Strong infrastructure-as-code experience with Terraform.
• Ability to design and optimize API integrations within pipelines.
• Familiarity with data quality observability tools such as Soda (or similar).
• Proficiency with GitHub and CI/CD workflows.
• Advanced understanding of dimensional modeling and data warehousing.
• Comfortable leading in Agile environments with strong ownership and collaboration.

Contract / Engagement & Pay

• Pay rate: $65.00–$70.00 per hour.

Benefits (if hired via ECLARO)

• 401(k) retirement savings plan administered by Merrill Lynch
• Commuter check / pre-tax commuter benefits
• Medical, dental, and vision insurance options through ECLARO