San Francisco, California, United States On-site Full-time

Cohere is hiring an Engineering Manager, GPU Infrastructure

Responsibilities

  • Guide and develop engineers working on GPU-based systems, promoting high technical standards and ongoing growth
  • Oversee team performance, professional growth, and recruitment activities
  • Hold regular one-on-one discussions and team gatherings to maintain alignment and resolve issues
  • Offer expert technical support for challenging infrastructure issues
  • Shape and implement the long-term technical vision for deploying, tuning, and expanding GPU clusters
  • Supervise the development of systems for workload scheduling, failure detection, and performance tuning
  • Work with cloud providers and machine learning engineers to align the training and inference stack with the latest GPU technologies
  • Ensure GPU infrastructure is reliable, scalable, and secure across environments
  • Collaborate with AI researchers to identify future infrastructure demands and design resilient solutions
  • Support research teams in adapting training software for new GPU hardware
  • Coordinate with capacity planning and finance teams to manage expanding compute resources
  • Engage with legal and security departments to meet compliance obligations
  • Align with other infrastructure groups on shared objectives and interdependencies
  • Build monitoring and observability systems for GPU usage, speed, and system health
  • Lead automation efforts for provisioning and operating GPU clusters
  • Advance cost-efficiency measures without compromising system performance
  • Manage relationships with hardware and cloud service vendors, including contract discussions

Benefits

  • Weekly lunch allowance of $75 or equivalent in local currency
  • Comprehensive medical and dental coverage with dedicated mental health funding
  • Retirement contribution matching through RRSP, 401K, or pension plans
  • Full parental leave pay top-up for up to six months per parent
  • Annual allowance for personal growth in categories like arts, wellness, leisure, and workspace upgrades
  • Funding for educational pursuits including conferences, courses, and coaching
  • Six weeks of paid time off annually (30 working days)
  • Financial support for visiting other offices and attending yearly company gatherings
  • Daily meals, snacks, and social events for office-based employees
  • Co-working space stipend for remote employees not located near an office
  • One-time $500 home office setup allowance

Work Arrangement

Remote-friendly

Other

  • The company supports remote work and has a distributed team model
  • Applicant screening may involve AI-powered tools to evaluate qualifications
About company
Cohere
Cohere trains and deploys frontier AI models for developers and enterprises building systems for content generation, semantic search, RAG, and agents.
All jobs at Cohere Visit website
Job Details
Department Infrastructure
Posted 9 days ago