Skip to Main Content
Shape the future of IBM watsonx Orchestrate

Start by searching and reviewing ideas others have posted, and add a comment (private if needed), vote, or subscribe to updates on them if they matter to you.

If you can't find what you are looking for, create a new idea:

  1. stick to one feature enhancement per idea

  2. add as much detail as possible, including use-case, examples & screenshots (put anything confidential in Hidden details field or a private comment)

  3. Explain business impact and timeline of project being affected

[For IBMers] Add customer/project name, details & timeline in Hidden details field or a private comment (only visible to you and the IBM product team).

This all helps to scope and prioritize your idea among many other good ones. Thank you for your feedback!

Specific links you will want to bookmark for future use
Learn more about IBM watsonx Orchestrate - Use this site to find out additional information and details about the product.
Welcome to the IBM Ideas Portal (https://www.ibm.com/ideas) - Use this site to find out additional information and details about the IBM Ideas process and statuses.
IBM Unified Ideas Portal (https://ideas.ibm.com) - Use this site to view all of your ideas, create new ideas for any IBM product, or search for ideas across all of IBM.
ideasibm@us.ibm.com - Use this email to suggest enhancements to the Ideas process or request help from IBM for submitting your Ideas.

Status Submitted
Created by Guest
Created on Sep 19, 2026

Training-free deferral router for uncertain agent outputs

Problem: Today's "learning to defer" systems must be retrained every time the human reviewer pool changes, so in practice teams either never retrain (and the router goes stale) or they defer everything to one overloaded expert. Uncertainty that can't be routed cheaply gets ignored.

Idea: Add a watsonx Orchestrate agent skill that uses conformal prediction sets to spot label-level uncertainty in an agent's output and routes each uncertain case to whichever available human reviewer best discriminates the remaining plausible options — with no retraining when reviewers join or leave. Grounded in Bary, Macq & Petit (2025), who showed this training-free approach beating both the standalone model and the best single expert while cutting expert workload up to 11x.

Value: Enterprises get a deferral router that stays accurate as teams change, fewer wrong agent actions reaching customers, and far less wasted senior-reviewer time.

Idea priority Low