Data Engineer

Role Overview

Rad AI is seeking a Senior Data Engineer to design and build scalable data infrastructure and data products. You will collaborate with researchers and stakeholders, take ownership of key projects, and continuously improve performance while ensuring data quality, security, and compliance.

Key Missions & Responsibilities

• Design and implement data architecture that is scalable, flexible, and efficient.
• Build and maintain data pipelines and workflow orchestration, leveraging tools such as Metaflow.
• Collaborate with researchers and stakeholders to understand data needs for:
  • model training
  • production monitoring systems
• Own end-to-end data engineering projects, working independently to deliver and maintain high-quality solutions.
• Ensure data quality and security across systems.
• Evaluate data technologies and continuously improve data infrastructure performance.

Requirements

• 5+ years of relevant data engineering experience.
• Strong hands-on experience designing, productionizing, maintaining, and documenting reliable and scalable data infrastructure.
• Expertise orchestrating workflows using Metaflow.
• Experience designing/distributed data pipelines using big data technologies (e.g., Spark) on large-scale datasets.
• Solid big data processing and analytics experience on AWS, including Amazon EMR and AWS Batch.
• Hands-on containerization experience with Docker and Kubernetes.
• Experience with database technologies, including SQL and NoSQL (examples mentioned: AWS DynamoDB, Elasticsearch, PostgreSQL).
• Experience working in an early-stage startup environment.
• Prior software engineering experience is a plus.

Nice to Have

• Experience working on machine learning and/or healthcare projects.
• Experience operating in a HIPAA-compliant environment.