About the role

Role Overview

Data Engineer (Remote, United States)

You’ll work hands-on at the intersection of data engineering and data science, building reliable data pipelines and integrations that power advanced analytics, machine learning models, and data-driven experimentation.

Responsibilities

Develop and maintain metadata-driven ingestion, transformation, and delivery pipelines
Build and support ETL/ELT processes for legacy and modern data sources
Transform legacy formats (e.g., SFTP, flat files) into modern formats (XML/JSON/APIs)
Build API integrations and data services for real-time and near real-time data exchange
Implement data quality checks, validation rules, and monitoring
Collaborate with a Data Architect on data models, schemas, and integration patterns
Optimize pipelines and queries for performance, scalability, and reliability
Document data flows, interfaces, and pipeline configurations
Support DevSecOps practices, including CI/CD, automated testing, and deployment
Work cross-functionally with data scientists, data engineers, and business stakeholders

Required Qualifications

4+ years of experience as a Data Engineer (or similar)
Experience developing and maintaining ETL pipelines and data integration workflows
Strong proficiency in SQL and Python
Experience with cloud platforms: AWS, Azure, GCP, GovCloud
Hands-on experience with cloud data warehouses and object storage (S3, Redshift, Snowflake)
API integration and data exchange experience
Knowledge of database design, data modeling, schema development, and data-centric documentation
Experience integrating data from multiple data source types
Strong code performance and query optimization skills
Excellent verbal and written communication skills
Bachelor’s degree in Computer Science, Mathematics, or comparable field
Must hold an active Secret Clearance
Candidates must pass a drug test and background screen

Preferred Qualifications

Knowledge of Air Force logistics systems
Experience with logistics, supply chain, or maintenance data
Experience with Databricks
Familiarity with data privacy, security, and compliance considerations
CompTIA Security+ certification (or ability to obtain)

About Illumination Works

Illumination Works (ILW) is a technology partner specializing in data and user-centered digital transformation. The company delivers services spanning data engineering, data science, software engineering, and cloud design, leveraging an innovation-focused approach since 2006.