Responsibilities
- Develop and manage data workflows that collect, process, and distribute healthcare data including claims, eligibility, payer files, and attribution through multiple pipeline stages.
- Create and sustain dbt models adhering to standardized design patterns, ensuring code is tested, documented, and efficient.
- Establish and oversee data validation checks, track pipeline performance, detect data inconsistencies, and safeguard reporting integrity.
- Write advanced, high-performance SQL queries for transforming, analyzing, and debugging data; SQL is the core language used in this role.
- Develop and support Python-based scripts for handling file operations, API integrations, custom ETL processes, and workflow automation; Python proficiency is mandatory.
- Take full ownership of live data pipelines, including monitoring execution, diagnosing errors, coordinating with external partners on data delivery problems, and maintaining operational documentation.
- Collaborate with analytics, clinical, and operations teams to convert business needs into technical data solutions, providing clear updates on progress, obstacles, and decisions.
- Execute tasks within an Agile/Scrum environment using Jira and GitLab, participating in planning, peer reviews, testing, and deployment cycles.
- Proactively find ways to enhance pipeline speed, minimize manual work, expand test coverage, and reduce accumulated technical inefficiencies.
- Perform additional responsibilities as needed.
Requirements
- Proven experience building and maintaining production-grade data pipelines.
- Advanced SQL skills with the ability to write complex and optimized queries.
- Solid background using Python for ETL workflows, file handling, and automation tasks.
- Direct experience working with Snowflake and dbt in a data engineering context.
- Capable of creating and managing data quality tests and monitoring systems.
- Prior work with healthcare datasets such as claims, eligibility records, payer attribution, and quality metrics.
- Familiarity with Agile/Scrum practices and tools including Jira and GitLab.
- Ability to manage data pipelines from end to end and guarantee correctness in downstream analytics.
- Excellent communication abilities for interacting with technical and non-technical team members.
