Cresta is looking for a QA Lead, AI Agent to act as the ultimate guardian of the customer experience for our AI Agent products. You will own the end-to-end quality strategy, from designing complex test plans for non-deterministic LLMs to building automated, scalable testing environments. Your work will architect the framework that allows Cresta to deploy world-class AI agents for the world's largest enterprises with confidence.

What You'll Do

Architect and scale the end-to-end framework for testing AI agent systems at scale using LLM-driven methodologies.
Partner with Forward Deployed Engineers and PMs to triage issues, identify bottlenecks, and create new test cases for real-world deployment challenges.
Conduct manual UAT and voice-call testing to represent the end-customer experience and articulate nuances to engineering and clients.
Lead and scale a pod of QA analysts and partners, defining best practices and processes.

What We're Looking For

5+ years of experience in Quality Engineering, Deployments, or Technical QA, ideally within an AI or high-growth SaaS environment.
Systems thinking and comfort navigating technical concepts like LLM, RAG, prompt logic, and multi-turn conversational flows.
Proven ability to lead large E2E technical projects through partners and build processes between QA, Engineering, and Product.
An uncanny ability to find edge cases and a bias toward action to anticipate and solve bottlenecks.
High empathy and a consultative mindset to represent the 'human element' of customer support interactions.
Startup agility, thriving in fast-paced environments and turning ambiguity into execution.

Nice to Have

Experience with CCaaS (Contact Center as a Service), telephony, or STT/TTS (Speech-to-Text) technologies.
Background in Conversation Design or SDET roles.
Experience leading teams with direct reports.