About the role

Role Overview

Senior Data Engineer for the Federal Services team at Data Surge. This is a remote role supporting scalable, secure data solutions in cloud environments.

Citizenship requirement: Due to the role, candidates must be U.S. citizens.

Day-to-Day Impact

Design, develop, and optimize robust Databricks data pipelines to process and transform large-scale datasets
Collaborate with data scientists, engineers, and cloud architects to build reliable and secure data systems
Automate infrastructure provisioning using Terraform and manage cloud resources on Azure (or AWS/GCP)
Monitor, troubleshoot, and support production-grade pipelines and data jobs
Build CI/CD workflows for deployment and version control of data processing code
Ensure security, performance, and reliability across the full data workflow
Use Docker containers when deploying data services
Participate in Agile ceremonies and help shape iterative data delivery plans
Improve data architecture, automation, and governance practices

Required Experience

5+ years in data engineering or backend data infrastructure roles
2+ years hands-on with Databricks and Spark/distributed data processing in production
Deep proficiency in PySpark and Python for data engineering
Experience with data modeling
Solid experience with Airflow and/or dbt (or similar orchestration/transformation tools)
Proven skills in data governance, lineage, or security best practices
Experience with Azure (preferred), AWS, or GCP
Strong CI/CD and version control workflow knowledge
Comfortable with relational (e.g., PostgreSQL, MySQL) and NoSQL databases
Proven ability to monitor, debug, and scale cloud-based data systems
Strong communication and ability to work independently in a remote team

Nice to Haves

Kubernetes and Helm (not required)
Terraform or other Infrastructure as Code tools
Docker / containerization experience
Experience with data lakehouse architectures and Delta Lake
Federal/government project experience
Existing security clearance (preferred, not required)
Databricks certification

Benefits (Highlights)

Remote-first environment; PTO including holidays and birthday
401(k) with 4% match (immediately vested)
Growth and development opportunities
Bonuses and additional benefits

About Data Surge

Data Surge is a technology services company focused on modern data platforms and software modernization for the big data and machine learning space. It supports clients through consulting and delivery of scalable data engineering solutions, including in government/federal services.

Tags