Loading...

Explainability

The ability to describe why a model produced a particular output in understandable terms. Explainability is often requested in regulated decisions. Due to limited understanding of exactly which factors lead to a particular output, explainability may be low. “Thinking” traces from reasoning models may be helpful for understanding why a model could generate a particular output, but they do not accurately represent what actually went into any particular decision.

See: Explainable AI; Interpretability; Right to explanation