ZenBusiness Inc. is looking for a Conversational AI & Prompt Engineer to craft the voice, reasoning, and effectiveness of our AI agent, Velo. Your mission is to ensure every interaction is clear, trustworthy, and results-driven by evolving prompts, dialogue flows, and decision logic through rapid experimentation.
What You'll Do
- Analyze conversation transcripts and user feedback to identify areas of confusion, failure, and prompt leakage.
- Work with the Customer Impact Team Product Lead to define and track conversational KPIs like resolution rate, containment rate, and user satisfaction.
- Optimize prompts and model selection for cost efficiency, response latency, and scalability in production.
- Collaborate with engineers to improve conversation-specific evaluation criteria, such as NLU accuracy and intent recognition.
- Design and maintain evaluation frameworks to measure prompt performance using golden datasets and automated scoring.
- Implement guardrails to reduce hallucinations, prevent prompt injection, and ensure compliant, safe responses.
- Collaborate on the design, mapping, and implementation of complex conversation flows, including error recovery and contextual handoffs.
- Own the continuous optimization of system prompts and instructions for LLMs like Gemini and OpenAI to ensure Velo's responses are accurate, tone-consistent, and on-brand.
- Design and optimize structured outputs, function calling, and tool-routing logic for accurate data capture and downstream system integrations.
What We're Looking For
- 5+ years of total professional experience.
- 2+ years in Conversational AI, Applied LLM Engineering, Prompt Engineering, or NLP systems in production environments.
- Deep experience designing and optimizing prompts for GPT, Gemini, or similar models, including structured outputs and function calling.
- Practical experience designing and tuning RAG pipelines (chunking, embeddings, retrieval evaluation).
- Experience building evaluation datasets and running prompt experiments, including A/B testing and automated scoring.
- Proficiency in Python or TypeScript.
- Experience integrating LLM APIs in production systems.
- Ability to analyze conversational performance using data and logs to drive measurable improvements.
- Strong systems thinking, empathy for users, and ability to translate business logic into scalable AI behavior.
Nice to Have
- Experience with agentic systems, similar to Decagon, Agentforce, or Fin.
Technical Stack
- Languages: Python, TypeScript
- Models & APIs: GPT, Gemini, LLM APIs
- Systems: RAG Pipelines
Team & Environment
You will report to the Senior Director of Growth & AI.
Benefits & Compensation
- Medical, vision, dental, disability, and life insurance.
- Parental and military leave.
- Employee assistance program.
- 401k + match.
- Annual bonus.
- Pet insurance.
- RSUs.
- Paid parking (for in-office employees).
- 10 paid holidays.
Work Mode
This is a remote position open to candidates across the United States.
ZenBusiness is an equal opportunity employer dedicated to diversity, equity, and inclusion.




