Cohere•19 days ago
Senior Technical Program Manager, Machine Learning Infrastructure
Recruiter Fit Breakdown & Candid Summary
1
Ideal candidates possess 5+ years of technical program management experience focused specifically on ML infrastructure, inference, and model serving.
2
This is a senior-level operational role requiring a strong balance of tactical execution and strategic alignment in a fast-paced environment.
3
Candidates should thrive in low-structure, high-growth settings and have deep technical familiarity with ML systems.
4
Those who prefer rigid structures, heavily defined processes, or lack direct ML infrastructure background should not apply.
Role Responsibilities
- 1Manage the program portfolio covering inference, efficiency, serving, and endpoints to scale infrastructure for internal and external users.
- 2Lead end-to-end coordination and execution across programs through cross-functional collaboration with Modeling and customer-facing teams.
- 3Identify pain points and establish processes to support development velocity, user needs, and engineering best practices.
- 4Build a strong culture around continuous improvement by managing incident responses and ensuring timely root-cause fixes.
- 5Manage overlapping projects and programs by ruthlessly prioritizing asks to align with company goals.
- 6Collaborate with stakeholders to set, track, and manage timelines, deliverables, budgets, and scope while delivering clear progress updates.
Skills Matrix
Must-Have Skills
Technical Program Management(TPM)
Machine Learning Infrastructure(ML Infra)
Model Inference(inference)
Model Serving(serving)
Endpoints Design
Nice-to-Have Skills
No optional skills specified for this role.
Free Instant Match Check
Will an ATS filter reject your resume for this role?
Check your keyword match score, missing must-have skills, and formatting flags — before you apply.
Checking saved resume…
No signups. Free check in 3 seconds.
Ready to submit your application?
Apply directly on Cohere's official job portal.