Sentara Health is hiring a Senior Data Scientist Machine Learning Operations Gen AI - Remote

Responsibilities

• Responsible for design and development of production-grade Machine Learning ops and Gen AI solutions
• Lead hands-on delivery of scalable GenAI solutions from problem framing → prototyping → evaluation → production → monitoring.
• Build internal copilots/assistants (knowledge search, code/content generation) and client-facing products (conversational analytics, summarization, recommendations, workflow automation).
• Design RAG pipelines, embedding strategies, vector search, and model orchestration; evaluate fine-tuning vs. prompt engineering.
• Implement guardrails, safety filters, prompt/version management, latency/throughput optimizations, and cost controls.
• ML platform and ML Ops: Identify areas that require improvements or additional functionalities and use your expertise in machine learning and software engineering to architect and develop solutions that fill gaps in our ML platform and development ecosystem. Analyze system performance, scalability, and reliability to pinpoint opportunities for enhancement. Develop tools and solutions that help the team build, deploy, and monitor AI/ML solutions efficiently.
• System scalability and reliability: Optimize the scalability, performance, and reliability and AI Team solutions by implementing best practices and leveraging industry-standard technologies. Collaborate with infrastructure teams to ensure smooth integration and deployment of ML solutions. Design scalable and efficient systems that leverage the power of machine learning for enhanced performance and capabilities.
• Data processing and workflow pipelines: Streamline data ingestion, preprocessing, feature engineering, and model training workflows to improve efficiency and reduce latency. Work with data engineering and data platform teams to design and implement robust data pipelines that support the AI team’s needs.
• Model deployment and monitoring: Evaluate and optimize model prototypes for real-world performance. Work with infrastructure and development teams to integrate ML models into production systems. Work closely with partner teams to communicate and understand technical requirements and challenges.
• As part of Sentara’s Data Science team you will be responsible for implementation and operationalization of AI/ML models. You will work with other machine learning engineers, data scientists, software engineers and platform engineers to ensure success of the AI/ML implementations. Specific responsibilities will include:
• Apply software engineering rigor and best practices to machine learning, including AI/MLOPs, CI/CD, automation, etc.
• Take offline models data scientists build and turn them into a real machine learning production system.

Requirements

• 5+ years building production software/ML systems, including 1+ years of experience with LLMs/GenAI.
• Proficient in Python and one major DL/LLM stack (e.g., PyTorch/Transformers); experience with LangChain/LlamaIndex, vector DBs, and cloud (AWS/Azure/GCP).
• Demonstrated delivery of RAG, prompt engineering, evaluation frameworks, and guardrails in production.
• Strength in APIs, distributed systems, and ML Ops (K8s, CI/CD, monitoring).
• Experience with SQL and big data platforms such as Postgres, Redshift and Snowflake
• Experience with Agile/Scrum methodology and best practices
• Experience with ML platforms and ML Ops: Demonstrated experience in assessing and improving ML platforms, identifying gaps, and architecting solutions to address them. Strong familiarity with ML platform components such as data ingestion, preprocessing, feature stores, model training, deployment, and monitoring.
• Bachelor's Degree
• Required to have 5+ years of experience as a Data Scientist with a strong focus on Azure and Microsoft Data Science, AI, and machine learning toolsets.
• Required to have strong problem-solving skills and the ability to tackle complex healthcare challenges using data-driven approaches.
• Can help the Data Science infrastructure building up, working with ML Ops team for model implementation, mentoring and developing junior staff.
• Required to have strong proficiency in data analysis, data manipulation, and data visualization using Python.
• Required to have familiarity with healthcare-related datasets, medical terminologies, and electronic health records (EHR) data.
• Required to have knowledge of statistical techniques, hypothesis testing, and experimental design for healthcare research.
• Required to have strong machine learning expertise: Proficient in machine learning algorithms, statistical modeling, and data analysis. Hands-on experience with standard ML frameworks (e.g., TensorFlow, PyTorch) and libraries (e.g., scikit-learn, XGBoost, TensorFlow, or Keras).
• Required to have solid understanding of data engineering principles, data structures, and algorithms.
• Proficient in Python and/or other programming languages commonly used in ML development.
• Required to have experience in technologies, frameworks and architecture like Java or Python, Angular, React, JSON, Application Servers, CI/CD is preferred.
• Required to have experience with one or more AI automations platforms like Kubeflow pipeline, MLFlow, Azure Pipeline, AWS Sage Maker Pipeline, Airflow, Jenkins, Spark, Hadoop, Kafka, Jira and GIT.

Nice to Have

• Previous work experience with Generative AI and ML Ops in healthcare EPIC environment
• Understanding of use and implementation of Vector Databases
• Kubernetes container orchestration experience
• Experience with EPIC health platform is highly preferred

Benefits

• Medical, Dental, Vision plans
• Adoption, Fertility and Surrogacy Reimbursement up to $10,000
• Paid Time Off and Sick Leave
• Paid Parental & Family Caregiver Leave
• Emergency Backup Care
• Long-Term, Short-Term Disability, and Critical Illness plans
• Life Insurance
• 401k/403B with Employer Match
• Tuition Assistance – $5,250/year and discounted educational opportunities through Guild Education
• Student Debt Pay Down – $10,000
• Reimbursement for certifications and free access to complete CEUs and professional development
• Pet Insurance
• Legal Resources Plan
• Colleagues have the opportunity to earn an annual discretionary bonus if established system and employee eligibility criteria is met.

Additional Information

• Work Shift First (Days)
• Sentara Health is an equal opportunity employer and prides itself on the diversity and inclusiveness of its close to an almost 30,000-member workforce. Diversity, inclusion, and belonging is a guiding principle of the organization to ensure its workforce reflects the communities it serves. In support of our mission “to improve health every day,” this is a tobacco-free environment. For positions that are available as remote work, Sentara Health employs associates in the following states: Alabama, Delaware, Florida, Georgia, Idaho, Indiana, Kansas, Louisiana, Maine, Maryland, Minnesota, Nebraska, Nevada, New Hampshire, North Carolina, North Dakota, Ohio, Oklahoma, Pennsylvania, South Carolina, South Dakota, Tennessee, Texas, Utah, Virginia, Washington, West Virginia, Wisconsin, and Wyoming.