Senior Data DevOps Engineer

Role overview

Senior Data DevOps Engineer to architect scalable data infrastructure, lead technical initiatives, and mentor engineering teams within the Data DevOps function. You’ll collaborate closely with Data Science, Machine Learning, Reporting, and other data teams to deploy and support production-grade data applications.

Responsibilities

• Architect and lead enterprise data pipeline design using Airflow, dbt, and Databricks
• Optimize pipeline performance for real-time and batch processing at scale
• Design and optimize AWS-based data infrastructure, including S3, Lambda, and Snowflake architecture
• Establish best practices for cost-efficient, secure, and scalable data processing
• Design and optimize AWS SageMaker environments for ML teams (performance and resource utilization)
• Partner cross-functionally with ML, Data Science, and Reporting to align on data strategy and ensure data accessibility
• Implement monitoring, alerting, and logging to detect failures and performance bottlenecks
• Architect automation for data quality, lineage tracking, and schema evolution
• Lead incident response, performing troubleshooting and root cause analysis for critical data issues
• Evolve Data DevOps best practices, driving automation, reproducibility, and scalability
• Mentor junior/mid engineers, conduct code reviews, and provide technical guidance
• Define technical standards and document infrastructure patterns, workflows, and operational procedures
• Evaluate and recommend new tools/technologies to improve data infrastructure

Requirements

• 6+ years in DevOps/DataOps (or similar), with 2+ years in a senior/lead capacity
• Proven experience designing robust data pipelines and automation frameworks with emphasis on data integrity, security, and performance
• Deep expertise with Airflow, Snowflake, SageMaker, dbt, and Databricks
• Strong AWS architecture experience and cloud-native design patterns
• Track record of leading technical projects and mentoring engineers
• Bachelor’s degree in CS/IT or related field (or equivalent experience); Master’s preferred
• AWS/Snowflake (or related) certifications strongly preferred