Lead Data Engineer
AND Digital
full-remoteleadpermanentbackenddata Full remote 194 days ago via WTTJ
See how well this job matches your profile
Sign up to get an AI match score and generate a tailored application in seconds.
Get your match scoreTags
AWSPostgreSQLPythonETLRedshiftRDSAirflowPrefectGitData Engineering
About the role
Role overview
You will lead the Luna data team and take ownership of a high-priority migration from Amazon Redshift to a new AWS RDS (PostgreSQL) architecture. You’ll provide technical leadership, mentor engineers, and translate stakeholder/business needs into a scalable data engineering roadmap.
Key missions
- Lead the technical practice for the Luna data team and oversee the Redshift → AWS RDS (Postgres) migration.
- Build and optimize Python-based ETL pipelines for data movement.
- Optimize PostgreSQL OLTP and OLAP environments.
- Mentor and coach team members through code reviews and workshops to improve skills in Python, Git, and engineering workflows.
Requirements
- DataOps / Tools: 3+ years of expertise with Git (branching/workflows) and database schema management tools (e.g., Liquibase, Flyway, or Drizzle).
- Data Engineering: 7–10 years building and supporting end-to-end data pipelines (from source to reporting).
- PostgreSQL: 5+ years expert-level SQL and database architecture for both OLTP and OLAP (e.g., partitioning and indexing).
- AWS: 5+ years deep AWS experience, ideally including administration/optimization of RDS/Aurora (Postgres) and Redshift.
- Python: 5+ years expert-level Python experience building ETL pipelines, including Pandas and orchestration tools such as Airflow or Prefect.
Nice-to-haves
- Specific experience migrating complex analytical workloads from Redshift to PostgreSQL while maintaining/optimizing both OLTP and OLAP patterns.
About AND Digital
AND Digital is a technology company focused on building and scaling data platforms and engineering capabilities. The role highlights their work in data engineering and platform modernization on AWS, including migration from Redshift to a PostgreSQL (RDS/Aurora) architecture.
Scraped 5/13/2026