xelys jobs xelys jobs

Senior Data Engineer [Remote-US]

Quanata

full-remoteseniorpermanentbackenddata San Francisco, CA 149 days ago via LinkedIn

See how well this job matches your profile

Sign up to get an AI match score and generate a tailored application in seconds.

Get your match score

Tags

PythonSQLAWS GlueS3AthenaKafkaSnowflakeTerraformData ModelingCI/CD

About the role

Role Overview

As a Senior Data Engineer at Quanata, you will design and build data pipelines and data services that support risk evaluation, real-time processing, and data science workflows. The role focuses on streaming infrastructure, reliable data platforms, and enabling internal teams and external partners to access curated datasets.

Responsibilities

  • Design and build robust data pipelines integrating data from multiple/diverse sources for risk evaluation and business intelligence.
  • Build streaming data pipelines using Kafka and AWS services for real-time data processing and decision-making.
  • Create and operate data services that provide curated datasets via APIs and scheduled deliveries.
  • Support data science workflows by enabling model training, feature engineering, and production inference infrastructure.
  • Implement data quality frameworks (validation, monitoring, alerting).
  • Contribute to CI/CD pipelines and infrastructure-as-code practices for dependable deployments.
  • Deliver reliable production services; participate in an on-call rotation.
  • Build the data warehouse by creating well-modeled datasets in Snowflake.
  • Collaborate with data scientists, analysts, and business stakeholders to deliver value.

Requirements

  • 6–8 years of industry experience in data engineering or software engineering with focus on data systems.
  • Strong proficiency in Python and SQL for pipeline development and analysis.
  • Experience with AWS data platforms: Glue, S3, Athena, Lambda, Step Functions.
  • Familiarity with Snowflake (or similar cloud data platforms).
  • Familiarity with streaming technologies such as Kafka or Kinesis.
  • Experience with workflow orchestration tools (e.g., Airflow or Step Functions).
  • Proficiency with infrastructure-as-code, especially Terraform.
  • Understanding of data modeling principles.
  • Excellent written and verbal communication and a collaborative mindset.

Nice to Have

  • Prior experience in insurance or other highly regulated environments (regulatory, security, and data governance).
  • Familiarity with ML infrastructure supporting end-to-end model workflows.

About Quanata

Quanata develops context-based insurance solutions, combining customer-centered technology with data and digital products. The company is backed by State Farm and builds tools and platforms that help evaluate insured risk and enable data science and business access to curated datasets.

Scraped 6/28/2026