Data Engineer - AI (Spark, Databricks and Healthcare)

Role Overview

Data Engineer - AI at Cotiviti, supporting data management, integrations, production, validation, quality, and security. You will build and optimize data pipelines and work closely with engineering and infrastructure teams to resolve issues that impact data processing.

Responsibilities

• Develop, maintain, and execute intermediate to advanced Spark scripts for:
  • data management
  • data validation
  • data integration
• Create and maintain SQL scripts (basic to intermediate) for data management and validation.
• Optimize queries to improve efficiency of daily tasks.
• Perform data analysis to identify issues and validate results.
• Build and maintain data pipelines.
• Collaborate with teams such as Engineering, DBAs, and Cloud Ops to troubleshoot environmental/network issues.
• Provide support after-hours or weekends as needed.
• Ensure compliance with industry and organizational regulations to maintain data integrity.
• Execute tasks using a ticketing system and meet deadlines.

Requirements

• Bachelor’s degree in Computer Science/IT or equivalent experience.
• 3+ years with big data technologies: Spark, S3, Kafka, Ray, Hadoop (etc.).
• 2+ years with big data/cloud technologies: Databricks, AWS, Azure, Hadoop, Spark, Snowflake (etc.).
• 3+ years with cloud: AWS, Azure, GCP, OCI (etc.).
• 3+ years with RDBMS and SQL/ETL tooling:
  • e.g., Oracle, MS SQL, Vertica
  • experience with SQL/PLSQL or other ETL/data integration tools.
• Familiarity with data pipeline orchestration tools (e.g., Airflow, Databricks Workflows).
• 3+ years of data analysis experience.
• Healthcare domain preference: enrollment, medical claims, and/or pharmacy claims.
• Experience with JIRA (project management).
• Strong analytical and communication skills; ability to prioritize and multitask.

Nice to Haves

• Databricks/AWS certifications.
• Familiarity with Databricks and/or Snowflake environments.

Compensation & Benefits

• Base compensation range: $101,000–$132,000 per year (specific offer depends on factors such as experience, education, skills, certifications).
• Benefits include medical/dental/vision, disability/life insurance, 401(k), paid family leave, paid holidays, and PTO.