xelys jobs xelys jobs

Data Engineer

Lime

full-remotemidpermanentbackenddata Full remote 168 days ago via WTTJ

See how well this job matches your profile

Sign up to get an AI match score and generate a tailored application in seconds.

Get your match score

Tags

ETL/ELTPythonSQLdbtAirflowApache SparkKafkaFlinkData GovernanceAWS

About the role

Role Overview

You will join Lime as a Data Engineer to design, build, and maintain high-throughput ETL/ELT pipelines for data ingestion, processing, and storage. The role includes building performance-tuned transformations, improving data reliability and observability, and partnering with the ML Platform team to deliver clean, feature-rich datasets.

Responsibilities

  • Design, build, and maintain high-throughput ETL/ELT pipelines for ingestion, processing, and storage
  • Create complex, performance-tuned data transformations using Python and high-performance SQL
  • Develop and contribute to scaling strategy for future business needs
  • Implement data ops best practices, including:
    • CI/CD for data pipelines
    • Version-controlled schemas (e.g., dbt)
    • Automated testing
  • Drive data reliability and observability strategy
  • Work with distributed processing systems such as Spark, Flink, or Kafka
  • Partner with the ML Platform team to prepare clean, feature-rich datasets for training and inference
  • Ensure data stewardship via documentation, discoverability, and robust data privacy and access controls

Requirements

  • 2+ years of data engineering experience and distributed systems experience
  • Expertise in developing and debugging complex transformations with Python and high-performance SQL
  • Familiarity with distributed processing tools: Spark, Flink, or Kafka
  • Familiarity with data governance practices (cataloging, lineage, PII masking)
  • Airflow experience for workflow orchestration
  • ETL pipelines / data modeling experience, including transformation tooling such as dbt
  • Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related field

Nice-to-haves

  • Experience with data privacy/access controls and data governance tooling
  • Experience with Iceberg or Debezium
  • Infrastructure-as-Code (e.g., Terraform) for data infrastructure management
  • Hands-on experience scaling data stacks on cloud providers (notably AWS)
  • Experience with Snowflake

About Lime

Lime is a technology company operating in the data engineering space, focused on building scalable data pipelines and supporting downstream machine learning use cases. The team works on high-throughput ETL/ELT systems, data reliability/observability, and governance practices to enable analytics and model training.

Scraped 6/11/2026