Senior Product Manager - Inference Platform.

Accountabilities:

As a Senior Product Manager – Inference Platform, you will lead the strategy, development, and adoption of critical inference platform capabilities while aligning technical execution with customer needs and business priorities. Your responsibilities will include:

• Own the product strategy, roadmap, and measurable outcomes for a core stream of the AI inference platform.

• Coordinate and align multiple cross-functional engineering teams working on public APIs, request routing, performance optimization, reliability, and enterprise enablement.

• Partner with engineering and research teams to improve inference scalability, reliability, and cost efficiency.

• Translate complex technical improvements into dependable platform capabilities that deliver tangible value to developers and enterprise customers.

• Conduct customer research, interviews, and hands-on proofs of concept, with particular attention to managed enterprise customers.

• Analyze emerging open-source models, inference economics, hardware developments, and real-world AI adoption patterns to identify product opportunities.

• Turn market insights and customer feedback into prioritized product initiatives and strategic investment decisions.

• Communicate product direction, requirements, trade-offs, and expectations effectively across engineering, research, sales, support, and leadership.

• Develop clear product requirements documents (PRDs), request for comments (RFCs), release notes, and other documentation to support alignment and delivery.

• Adapt product priorities and execution plans as customer requirements, technologies, and market conditions evolve.

Requirements:

The ideal candidate combines strong product leadership with hands-on technical understanding of AI inference and production infrastructure. You should be comfortable navigating ambiguity, influencing engineering teams, and translating complex technical concepts into clear product decisions. Required qualifications include:

• Demonstrated experience launching and managing technical platform products from strategy through delivery and adoption.

• Senior-level product management experience with the ability to lead initiatives spanning multiple engineering teams.

• Strong technical understanding of AI inference, including model serving, distributed systems, and production infrastructure.

• Ability to independently analyze technical problems, evaluate trade-offs, and develop informed product decisions in close collaboration with engineers.

• Experience working with B2B or enterprise customers, particularly technical buyers.

• Excellent communication and stakeholder management skills across engineering, research, sales, support, and leadership.

• Strong written communication skills, including experience preparing clear PRDs, RFCs, release notes, and technical product documentation.

• Ability to manage expectations, prioritize competing needs, and maintain alignment across cross-functional teams.

• Comfort working in a fast-moving environment where product scope, technology, and customer requirements can change quickly.

• Strong analytical thinking and a customer-focused approach to product development.

Additional experience that would be an advantage:

• Experience with model post-training, including training draft models.

• Experience establishing and managing third-party technical partnerships.

Benefits:

• Competitive base salary: Annual compensation ranging from $228,000 to $285,000, depending on experience, skills, qualifications, hiring level, and geographic location.

• Comprehensive health coverage: Medical, dental, and vision insurance fully paid by the employer for employees and their families.

• Retirement savings: 401(k) plan with an employer match of up to 4%, with immediate vesting.

• Paid parental leave: 20 weeks for primary caregivers and 12 weeks for secondary caregivers.

• Remote work support: Monthly reimbursement of up to $85 for mobile and internet expenses.

• Insurance protection: Employer-paid short-term disability, long-term disability, and life insurance coverage.

• Career development: Opportunities for professional growth, continuous learning, and skill development.

• Flexibility and ownership: A remote working arrangement that encourages autonomy and accountability.

• Collaborative culture: Work alongside talented international teams in an innovative, fast-moving environment.

• Meaningful impact: Contribute to advanced AI infrastructure and help shape the future of large-scale AI applications.