ServiceNow is hiring a Staff AI Engineer: Foundational AI Services to architect and scale the core AI intelligence layer. This role builds the foundational AI services that empower every product team to deploy production-grade GenAI. You will own the end-to-end lifecycle of internal AI infrastructure, creating high-performance, resilient, and autonomous systems.
What You'll Do
- Lead domain-specific model optimization using PEFT (LoRA/QLoRA) and knowledge distillation to balance cost, latency, and reasoning capability.
- Build next-gen Retrieval-Augmented Generation pipelines using hybrid search, cross-encoders, and self-correcting retrieval loops.
- Design and deploy multi-agent systems using frameworks like LangGraph or CrewAI, enabling autonomous task planning and tool-use (Function Calling).
- Build 'LLM-as-a-judge' frameworks and robust evaluation pipelines to measure hallucination rates, groundedness, and safety.
- Implement high-throughput, low-latency serving strategies including quantization, speculative decoding, and prompt caching.
What We're Looking For
- Typically requires 8+ years of overall software engineering experience.
- Expert-level mastery of Transformers, attention mechanisms, and the latest frontier models (GPT-4o, Claude 3.5, Llama 3).
- Deep experience with vector databases (Pinecone, Weaviate, Milvus), orchestration layers (LangChain, LlamaIndex), and MLOps tools.
- Staff-level coder in Python/Rust who understands distributed systems, concurrency, and API design.
- Proficiency with Chain-of-Thought (CoT), DSPy, GraphRAG, and Semantic Caching.
Technical Stack
- Languages: Python, Rust
- Core AI: Transformers, GPT-4o, Claude 3.5, Llama 3
- Vector Databases: Pinecone, Weaviate, Milvus
- Orchestration & Frameworks: LangChain, LlamaIndex, PEFT (LoRA/QLoRA), LangGraph, CrewAI, DSPy, GraphRAG
Team & Environment
Technical lead for a mission-critical team.
ServiceNow is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, creed, religion, sex, sexual orientation, national origin or nationality, ancestry, age, disability, gender identity or expression, marital status, veteran status, or any other category protected by law.
