Beyond the softmax probability

In classification, data scientists often use the softmax probability score as a notion of confidence about whether or not a predicted class (as indicated by ) is correct:

The softmax probability is easily accessible, which is why it has widespread adoption. However, there are some caveats data scientists should be aware of, such as deterministic overconfidence and reliability degeneration in out-of-domain contexts.