Plum Inc is looking for a Senior Data Scientist to lead the development of scalable Generative AI pipelines that process raw data and generate context-aware results. As a central figure shaping our GenAI platform, you will work across the full ML lifecycle from data ingestion to deployment in a boutique firm where each person's contributions are critical to growth.

What You'll Do

Design and architect end-to-end Generative AI pipelines using LLMs to process and generate context-aware results.
Integrate open-source and proprietary LLMs via APIs and custom orchestration.
Build and optimize workflows using frameworks such as LangChain.
Design and implement RAG (Retrieval-Augmented Generation) architecture to inject relevant, contextual data into generation prompts.
Develop robust methods to evaluate and compare LLM outputs based on relevance, personalization, and factual accuracy.
Build automated and scalable LLM evaluation pipelines using embedding-based similarity, scoring metrics, and human-in-the-loop feedback.
Implement monitoring, observability, and logging for GenAI workflows to ensure reliability in production.
Collaborate with cross-functional teams to integrate generative outputs into client-facing applications.

What We're Looking For

Proven experience designing and deploying production-grade Generative AI or LLM pipelines.
Strong hands-on expertise with LLMs and orchestration frameworks like LangChain.
Deep understanding of RAG architectures and techniques for improving LLM contextual relevance.
Experience building and scaling automated evaluation frameworks for generative models.
Ability to implement monitoring and observability for machine learning systems.
Excellent collaboration skills to work with teams across sales, marketing, and financial services.

Technical Stack

LLMs (e.g., GPT, LLaMA)
LangChain

Team & Environment

You'll join a high-performing, cross-functional team embedded in a flat corporate structure. We collaborate closely with sales, marketers, and financial services experts, connected through Slack, video calls, and regular meetings as a team that knows how to work hard, have fun, and make a meaningful impact.