This position is posted on behalf of a leading technology partner in the United States. We are seeking a Senior Technical Product Manager – Token Factory Inference who will spearhead the development and delivery of advanced machine learning inference capabilities at scale. The role demands leading the product roadmap for inference platforms, balancing performance, reliability, and customer-centric requirements. By working closely with cross-functional teams, you'll translate complex technical workflows into strategic product features, ensuring robust, high-throughput ML inference solutions. The position is remote within the U.S. and perfect for professionals passionate about AI/ML infrastructure innovation. Accountabilities: · Strategically drive the product roadmap for distributed, high-throughput ML inference systems. · Collaborate with engineering and research teams to architect scalable real-time and batch inference infrastructure. · Serve as the technical liaison in customer interactions, converting ML workflows into actionable product requirements. · Facilitate customer proof-of-concepts involving model deployment, inference orchestration, and optimization. · Create intuitive tools and resilient infrastructure enhancing latency, throughput, orchestration, and deployment efficiency. · Champion product adoption by ensuring solutions effectively address real-world inference challenges. Requirements: · 3–5 years of product management experience in cloud infrastructure, ML platforms, or developer tools. · Robust technical background (Computer Science or Engineering degree) with expertise in ML model architectures and serving systems. · Proficiency with modern ML inference frameworks like Triton Inference Server, vLLM, SGLang, TensorRT-LLM, Dynamo, KServe, or Ray Serve. · Demonstrated success in delivering technically sophisticated products supporting distributed, high-throughput ML pipelines. · Exceptional communication skills and cross-team collaboration expertise. · Capability to transform complex technical challenges into clear product requirements and drive execution. Preferred/Bonus: · Comprehensive understanding of contemporary ML architectures, including transformer-based models and inference dynamics. · Experience delivering or supporting production-grade ML solutions. · Expertise in MLOps/AIOps cycles, including observability, performance optimization, and continuous ML system delivery. Benefits: · Competitive salary: $204k–$255k OTE plus equity based on experience. · Health insurance: 100% company-paid medical, dental, and vision coverage for employees and families. · 401(k) plan with up to 4% company match and immediate vesting. · Parental leave: 20 weeks paid for primary caregivers, 12 weeks for secondary caregivers. · Remote work reimbursement: up to $85/month for mobile and internet. · Company-paid short-term, long-term, and life insurance coverage. · Flexible working arrangements and professional growth opportunities. · Dynamic, collaborative environment that encourages innovation and initiative. A talent matching platform partners with companies worldwide to connect top talent efficiently through AI-driven job matching. When applying, your profile undergoes an AI-powered screening process designed to identify top talent. The AI evaluates your CV and LinkedIn profile, analyzing skills, experience, and achievements. It compares your profile to job requirements and past success factors to determine a match score. The top 3 candidates are automatically shortlisted, with potential manual review to ensure comprehensive candidate assessment. The process remains transparent, skills-based, and unbiased, focusing solely on role fit. The final hiring decision rests with the internal team. #LI-CL1
United States Remote (Country) Employment
EX Squared is hiring a Senior Technical Product Manager Token Factory - Inference (Remote - US)
Got hired remotely?
Get paid like a professional
Remote clients expect company invoices, not personal PayPal requests. Glopay forms an EU partnership that makes you look legitimate while you stay independent.
Professional invoices with EU company details
Compliance handled automatically
Withdraw to any bank account
Income reports for easy tax filing
Free signup • 5 min setup




