Sagecare Product Manager for Agent Intelligence at Sage Care to own systems measuring and improving agent performance. Define evaluation rubrics, build evaluation systems, and translate conversational data into actionable insights.
Responsibilities
We’re hiring a Product Manager for Agent Intelligence to own the systems that measure, understand, and improve agent performance.
This is a high-ownership role at the intersection of product, data, evaluation, and AI quality. You will define the roadmap for the intelligence layer that turns agent interactions into structured insights, reliable evaluations, and product improvements.
You’ll partner closely with engineering, design, operations, customer teams, and other product leads to define quality standards, identify failure patterns, and close the loop between real-world conversations and better agent behavior.
This role is ideal for a product manager who is excited to build 0-to-1 systems, work with large-scale conversational data, and create the foundation for agents that become more accurate, reliable, and effective over time.
Define Agent Quality
Create evaluation rubrics for agent calls and conversations, including correctness, completeness, workflow adherence, customer experience, and outcome quality.
Establish scoring standards that work across workflows, customers, and use cases.
Define what “good” looks like for both individual interactions and overall agent performance.
Build Evaluation Systems
Own the systems and processes used to measure agent performance.
Develop human-in-the-loop review workflows, automated evaluation pipelines, and scenario-based testing.
Help Sage Care and its customers understand where agents are performing well, where they are failing, and why.
Qualification
Experience as a Product ManagerAbility to define quality standardsAbility to turn messyExperience with AI productsExperience with evaluation frameworksFamiliarity with retrievalExperience in healthcare
Required
Experience as a Product Manager, ideally working on technical, data-intensive, AI, automation, or platform products.
Strong analytical skills and comfort working with data, metrics, and ambiguous problem spaces.
Ability to define quality standards, measurement frameworks, evaluation processes, or operational workflows.
Experience working closely with engineering and cross-functional teams.
Strong written and verbal communication skills.
Ability to turn messy, unstructured information into clear product direction.
High ownership mindset and ability to drive both strategy and execution.
Experience with AI products, conversational interfaces, LLMs, machine learning workflows, or agent systems.
Experience with evaluation frameworks, experimentation, quality operations, or human-in-the-loop systems.
Familiarity with retrieval, ranking, personalization, feedback loops, or data labeling workflows.
Experience working with large-scale conversational, support, call, or customer interaction data.
Experience in healthcare, senior care, care operations, or regulated environments.
