Data Warehouse Engineer

Role Overview

The Data Warehouse Engineer is a hands-on role responsible for the end-to-end design, build, and operation of Maverick Payments’ Azure data platform. Reporting to the Data Team Director, you will collaborate with external implementation resources initially and then own daily operations, reliability, and continuous improvement.

Responsibilities

• Ensure operational excellence: pipeline uptime, SLAs, observability, and monitoring via Azure Monitor/Log Analytics, Synapse, and Data Factory dashboards.
• Respond to critical incidents within 2 hours; triage and resolve data integration failures.
• Perform root-cause analysis (RCA), drive corrective actions, and run post-mortems.
• Support data users with:
  • Ad-hoc SQL and Power BI connectivity
  • Refresh scheduling
  • Semantic model best practices
• Own pipeline performance and data freshness:
  • Optimize query runtimes, memory, and SLA compliance
• Design and build Azure Data Factory pipelines for batch and incremental ingestion using reusable templates.
• Write and optimize T-SQL in Synapse SQL pools for reliability/maintainability.
• Implement incremental loads, CDC (Change Data Capture), idempotent retries, and robust error handling.
• Onboard new sponsor banks/data sources and standardize ingestion patterns for:
  • File-based (CSV/JSON/Parquet/Delta)
  • API-based integrations
• Improve data quality and observability with validation checks, reconciliations, and anomaly detection.
• Optimize Synapse cost and performance (distribution strategies, partitioning, indexing/statistics, workload management, autoscale/pause-resume, retention/archival).
• Work with vendors during Phase 1; participate in code reviews and document architecture decisions (ADRs).
• Integrate Microsoft Purview for data lineage/catalog where appropriate.
• Create runbooks and troubleshooting guides; maintain architecture documentation (lineage, schemas, transformation logic).
• Maintain a data dictionary/metadata (PII tags, sensitivity labels, refresh cadence).
• Assist with PCI-DSS and SOC 2 reviews focusing on encryption, RBAC/ACLs, Key Vault, Private Link, Managed Identity, and least privilege.
• Stay current on Azure/Synapse best practices and security/cost updates; pursue training/certifications (DP-203, DP-300 preferred).

Requirements

• Hands-on experience designing, building, and operating Azure-based data warehousing/data platforms.
• Strong T-SQL skills and experience with Synapse SQL pools.
• Experience with Azure Data Factory ETL/ELT for batch and incremental ingestion.
• Ability to troubleshoot production pipeline incidents quickly and perform RCA/post-mortems.
• Experience with data quality/observability approaches (validation, reconciliation, anomaly detection).
• Familiarity with data governance/lineage via Microsoft Purview.
• Knowledge of security/compliance practices relevant to PCI-DSS and SOC 2.

Nice to Have

• Certifications DP-203 and/or DP-300 (preferred).
• Experience integrating and standardizing ingestion for sponsor-banking style file/API feeds and CRM/ITSM connectors.
• Strong familiarity with cost/performance optimization in Azure Synapse (distribution, partitioning, indexing, workload management, retention).