Palantir Technologies is hiring a Software Engineer - Hosted Model Infrastructure

Responsibilities

• Construct high-performance model serving infrastructure that integrates with security models, hardware constraints, and various inference engines.
• Design intelligent request handling covering authentication, rate limiting, concurrency control, and audit logging for multi-tenant model access.
• Develop and maintain packaging and deployment pipelines to enable fast, secure, and reliable model rollouts in on-premises and air-gapped environments.
• Create observability for production AI systems to facilitate easy service monitoring and rapid incident triage and resolution.
• Debug complex issues and performance problems across the stack, including open source inference engines, container runtimes, and GPU drivers, in environments that may not be directly accessible.
• Design and operate testing and benchmarking infrastructure to validate model deployments on varying GPU hardware before production release.
• Collaborate with product teams and customers to gather requirements, debug production issues, and deliver needed models and capabilities.
• Integrate hosted model infrastructure with Palantir's deployment, configuration, and identity systems.

Benefits

• Employees and eligible dependents can enroll in medical, dental, and vision insurance, as well as voluntary life insurance.
• Employees are automatically covered by Palantir's basic life, AD&D, and disability insurance.
• Commuter benefits are available.
• Relocation assistance is provided.
• Paid time off is based on a take-what-you-need policy, not accrual.
• Two weeks of paid time off are scheduled at the end of each year, subject to team and business needs.
• Ten paid holidays are offered throughout the calendar year.
• A supportive leave of absence program includes time off for military service and medical events.
• Paid leave is available for new parents, along with subsidized back-up care for all parents.
• Fertility and family building benefits include adoption, surrogacy, and preservation.
• A stipend helps cover expenses associated with a new child.
• Employees can enroll in Palantir's 401k plan.

Work Arrangement

Hybrid

Other

• Active US Security clearance, or eligibility and willingness to obtain a US Security clearance is beneficial, but not necessary.
• Relocation assistance available.
• Take what you need paid time off, not accrual based.
• 2 weeks paid time off built into the end of each year (subject to team and business needs).
• 10 paid holidays throughout the calendar year.
• Supportive leave of absence program including time off for military service and medical events.
• Paid leave for new parents and subsidized back-up care for all parents.
• Fertility and family building benefits including but not limited to adoption, surrogacy, and preservation.
• Stipend to help with expenses that come with a new child.
• Employees can enroll in Palantir’s 401k plan.