xelys jobs xelys jobs

Senior Data Engineer (Customer Data Products)

NBME

hybridseniorpermanentbackenddata Philadelphia, PA 122 days ago via LinkedIn

See how well this job matches your profile

Sign up to get an AI match score and generate a tailored application in seconds.

Get your match score

Tags

AWSPythonSQLSparkKafkaHadoopStreaming DataMLOpsCI/CDDataOps

About the role

Role Overview

Senior Data Engineer (Customer Data Products) at NBME. You will modernize and scale NBME’s data platform on AWS by building data lakes, data integration pipelines, and solutions that support analytics, AI/ML, and business decision-making.

Responsibilities

  • Build, test, deploy, orchestrate, monitor, document, and troubleshoot cloud-based data engineering processes and scalable data solutions.
  • Partner with data scientists, AI researchers, data/enterprise architects, and business stakeholders to extract, clean, and format structured and unstructured data for AI/ML training, fine-tuning, and feature extraction.
  • Lead evaluation, research, and experimentation for batch + streaming data, LLM data preparation frameworks, and MLOps tooling.
  • Act as a technical lead to demonstrate emerging AI/data capabilities and drive adoption across the organization.
  • Define/refine data engineering processes and procedures; contribute to best practices.
  • Educate and develop ETL developers and support transition into data engineering practices.
  • Ensure data integrity, accuracy, and security; maintain high data quality for data services, analytics, and master data management.
  • Own designs, development, testing, and delivery of data solutions; coordinate technical solutions.
  • Build automated, scalable, test-driven data pipelines.
  • Apply software engineering practices including Git, CI/CD, and AWS release management to improve AWS CI/CD pipelines.
  • Collaborate with DataOps/DevOps engineers and architects to improve DataOps tools and frameworks.

Requirements

  • Bachelor’s degree.
  • 7+ years of experience in application development.
  • 4+ years in big data technologies.
  • 4+ years in AWS cloud computing.
  • 4+ years of application development using Python, SQL, Scala, or Java.
  • 4+ years with distributed data/computing tools (e.g., MapReduce, Hadoop, Hive, EMR, Kafka, Spark, MySQL).
  • 4+ years working on real-time data/streaming applications.
  • 4+ years experience with NoSQL (the posting text is truncated after this point).

Nice-to-haves

  • Experience with feature stores and vector databases.
  • Familiarity with LLM data preparation frameworks and MLOps tooling.
  • Experience leading experimentation and technical enablement across an organization.

About NBME

NBME is a healthcare and education assessment organization that builds data products and platforms to support medical doctors and the healthcare community. The role involves joining a team of data engineers and BI developers to enhance an AWS-based data product used for analytics and AI/ML enablement.

Scraped 7/24/2026