Sarvam AI is hiring a Staff Engineer, API Platform

Responsibilities

• Own the full lifecycle of platform architecture, from initial request ingress to final response delivery.
• Lead the transition from Python to Go, defining architectural standards and ensuring system stability throughout the rewrite.
• Engineer audio processing workflows, including text-to-speech segmentation, audio format conversion, and voice activity detection for speech recognition.
• Build and manage vision processing pipelines involving OCR, document layout analysis, and vision-language models for data extraction.
• Develop scalable streaming systems using WebSockets, batch processing via queues, backpressure handling, and low-latency model calls.
• Design and implement commercial controls such as usage metering, billing systems, prepaid balance management, and API rate limiting with production-grade reliability.
• Ensure high performance and resilience for a shared platform operating under strict sub-second latency requirements.
• Establish comprehensive observability through logging, metrics collection, and distributed tracing to enable rapid incident diagnosis.
• Build robust integration testing frameworks that allow fast iteration without compromising external API stability.
• Collaborate closely with Inference and MLOps teams, providing guidance on production engineering best practices for model serving.
• Promote a culture of intentional design and clear documentation, requiring RFCs and recorded decisions to eliminate undocumented practices.