Patent attributes
Mechanisms are provided to implement a bias identification engine that identifies bias in the operation of a trained cognitive computing system. A bias risk annotator is configured to identify a plurality of bias triggers in inputs and outputs of the trained cognitive computing system based on a bias risk trigger data structure that specifies terms or phrases that are associated with a bias. An annotated input and an annotated output of the trained cognitive computing system is received and processed by the bias risk annotator to determine if they comprise a portion of content that contains a bias trigger. In response to at least one of the annotated input or annotated output comprising a portion of content containing a bias trigger a notification is transmitted, to an administrator computing device, that specifies the presence of bias in the operation of the trained cognitive computing system.
