Data Platform Engineer (26-27)

Role Overview

Data Platform Engineer (individual contributor) responsible for building and operating IDEA’s production data platform on Snowflake. You will design automated ELT ingestion pipelines, manage platform performance and cost, and support the transition from legacy ETL to a modern lakehouse architecture.

Responsibilities

• Design and build automated ELT pipelines to ingest data from diverse source systems into Snowflake
• Use cloud-native ingestion tools and Python-based pipelines when needed
• Build and maintain Bronze-layer tables with schema evolution, audit metadata, and lineage
• Implement ingestion validation, monitoring, and alerting to detect issues early
• Administer Snowflake components: databases, schemas, warehouses, access controls, and security settings
• Optimize performance and cost (warehouse sizing, clustering, query analysis, resource monitoring)
• Manage Snowflake infrastructure using Infrastructure-as-Code
  • Own Terraform-based definitions for Snowflake and related components
  • Create CI/CD pipelines for infrastructure changes with safe deployments and testing
• Implement security best practices including RBAC, encryption, auditing, and network policies
• Automate recurring operational tasks (provisioning, access grants, environment setup)
• Maintain documentation and runbooks (source configs, refresh schedules, troubleshooting)
• Collaborate with Analytics Engineering, DataOps, and Data Governance; participate in design discussions and code reviews
• Perform root-cause troubleshooting for pipeline/platform failures and continuously improve platform operations

Requirements / Knowledge & Skills

• Hands-on experience with Snowflake administration and production ingestion
• Strong ability to deliver reliable, scalable ingestion and platform operations
• Systematic root-cause analysis, observability, and production troubleshooting

Nice-to-haves

• Experience transitioning from legacy ETL to lakehouse architecture
• Mentoring peers and leading technical initiatives (for senior engineers)

Logistics

• Full-time remote position based in Texas
• Minimal travel (5–10%) annually
• Preference for candidates in: Austin, El Paso, Houston, Permian Basin (Midland/Odessa), Rio Grande Valley, San Antonio, Tarrant County (Fort Worth) (or willingness to relocate)