McKesson is hiring an AI Full Stack Software Engineer to create applications that improve patient care and streamline clinical workflows. In this role, you will develop and deploy AI-driven solutions, integrating advanced tools into enterprise systems.
What You'll Do
- Develop and deliver AI-driven enterprise quality software applications.
- Build scalable applications integrating Large Language Models and other AI tools into new and legacy codebases.
- Design and optimize data pipelines and datasets for AI system development and testing.
- Communicate modern AI concepts to non-technical audiences.
- Iteratively craft effective prompts to maximize LLM performance and implement prompt caching strategies.
- Maintain prompt libraries and benchmark performance.
- Fine-tune and serve GPT-family and Llama models.
- Develop AI agents using Semantic Kernel.
- Prototype co-pilot experiences and autonomous workflows.
- Fully document all work at both the code level and application level.
- Collaborate with other staff and outside stakeholders on large projects.
What We're Looking For
- B.S. degree in Computer Science or related engineering discipline, or equivalent experience.
- Minimum 4+ years of experience in software development.
- Minimum 2+ years of experience developing AI-enhanced applications using LLMs, voice, image, or speech models.
- Must have 2+ years developing AI applications in the healthcare or life sciences domain, including translating clinical or business needs into AI solutions.
- Proficient in sensitivity metrics (precision, recall, F1-score, AUC-ROC) and MLOps for scalable, cost-efficient AI deployment.
- Skilled in building RAG systems from scratch or with LangChain or LlamaIndex, using vector databases for context-aware LLM applications.
- Expert in managing LLM costs via prompt caching, batching, and quantization.
- Deep understanding of LLM advancements for informed model selection and tuning.
- Exceptional analytical skills to extract actionable insights from data.
- Experience using AI coding tools (e.g., GitHub Copilot, Cursor, Codeium/Windsurf).
- Proficiency in Python and AI-related libraries such as OpenAI, TensorFlow, PyTorch.
- Proficiency in creating Node.js web apps (e.g., Express.js).
- Experience with cloud platforms (AWS, GCP, Azure).
- Effective communication skills to collaborate with technical, DevOps, and product management teams.
- Experience with Git, Docker, and Kubernetes.
- Must be authorized to work in the United States on a permanent basis without the need for current or future sponsorship.
Nice to Have
- Preferred candidate will reside in Columbus, OH.
- May also consider qualified candidates based in Atlanta, GA.
Technical Stack
- Python, OpenAI, TensorFlow, PyTorch
- Node.js, Express.js
- AWS, GCP, Azure
- Git, Docker, Kubernetes
- LangChain, LlamaIndex, Semantic Kernel
Benefits & Compensation
- Salary: $106,900 - $178,100
- Impact-driven culture
- Focus on health, happiness, and well-being
- A culture where you can grow, make an impact, and are empowered to bring new ideas
Work Mode
This is a hybrid position open to candidates in Columbus, OH or Atlanta, GA.
McKesson provides equal employment opportunities to applicants and employees and is committed to a diverse and inclusive environment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, disability, age or genetic information.


