Data Engineer - AI

Role overview

Data Engineer – AI at Cotiviti. You will be responsible for building and maintaining data implementations, integrations, pipelines, and validation processes to ensure data operations run reliably and securely.

Responsibilities

• Build, maintain, and execute intermediate to advanced Spark scripts for:
  • data management
  • data validation
  • data integration
• Build, maintain, and execute basic to intermediate SQL scripts for data management and data validation.
• Optimize queries to improve the efficiency of daily tasks.
• Perform data analysis and identify issues.
• Collaborate with teams such as Engineering, DBA, and Cloud Ops to troubleshoot environmental/network issues affecting your work.
• Support after-hours or weekends as needed.
• Create and maintain data pipelines.
• Validate results to ensure all requirements are met.
• Follow compliance rules to maintain data integrity.
• Manage work using a department ticketing system and meet deadlines.
• Support special projects and other assigned duties.

Requirements

• Bachelor’s degree in Computer Science/IT or equivalent experience.
• 3+ years with big data technologies (e.g., Spark, S3, Kafka, Ray, Hadoop).
• 2+ years with big data/cloud technologies (e.g., Databricks, AWS, Azure, Hadoop, Spark, Snowflake).
• 3+ years with cloud platforms (AWS, Azure, GCP, OCI etc.).
• 3+ years with RDBMS (e.g., Oracle, MS SQL, Vertica) and experience with SQL/PLSQL and ETL/data integration tools.
• Airflow/Databricks Workflows familiarity for pipeline orchestration.
• 3+ years of data analysis.
• Preferably experience in Healthcare (enrollment, medical claims, pharmacy claims).
• Familiarity with Jira.
• Strong analytical and communication skills; ability to prioritize and multitask.

Nice to have

• Databricks/AWS certifications.
• Databricks and/or Snowflake environment familiarity.

Compensation (stated)

• $101,000 – $132,000 per year base compensation (exact offer depends on experience, education, skills, certifications, and business needs).