Data Engineer
Lime
See how well this job matches your profile
Sign up to get an AI match score and generate a tailored application in seconds.
Get your match scoreTags
About the role
Role Overview
You will join Lime as a Data Engineer to design, build, and maintain high-throughput ETL/ELT pipelines for data ingestion, processing, and storage. The role includes building performance-tuned transformations, improving data reliability and observability, and partnering with the ML Platform team to deliver clean, feature-rich datasets.
Responsibilities
- Design, build, and maintain high-throughput ETL/ELT pipelines for ingestion, processing, and storage
- Create complex, performance-tuned data transformations using Python and high-performance SQL
- Develop and contribute to scaling strategy for future business needs
- Implement data ops best practices, including:
- CI/CD for data pipelines
- Version-controlled schemas (e.g., dbt)
- Automated testing
- Drive data reliability and observability strategy
- Work with distributed processing systems such as Spark, Flink, or Kafka
- Partner with the ML Platform team to prepare clean, feature-rich datasets for training and inference
- Ensure data stewardship via documentation, discoverability, and robust data privacy and access controls
Requirements
- 2+ years of data engineering experience and distributed systems experience
- Expertise in developing and debugging complex transformations with Python and high-performance SQL
- Familiarity with distributed processing tools: Spark, Flink, or Kafka
- Familiarity with data governance practices (cataloging, lineage, PII masking)
- Airflow experience for workflow orchestration
- ETL pipelines / data modeling experience, including transformation tooling such as dbt
- Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related field
Nice-to-haves
- Experience with data privacy/access controls and data governance tooling
- Experience with Iceberg or Debezium
- Infrastructure-as-Code (e.g., Terraform) for data infrastructure management
- Hands-on experience scaling data stacks on cloud providers (notably AWS)
- Experience with Snowflake
About Lime
Lime is a technology company operating in the data engineering space, focused on building scalable data pipelines and supporting downstream machine learning use cases. The team works on high-throughput ETL/ELT systems, data reliability/observability, and governance practices to enable analytics and model training.
Scraped 6/11/2026