Journal article icon

Journal article

Visualizing histopathologic deep learning classification and anomaly detection using nonlinear feature space dimensionality reduction

Abstract:
Commonly used AI networks are very self-confident in their predictions, even when the evidence for a certain decision is dubious. The investigation of a deep learning model output is pivotal for understanding its decision processes and assessing its capabilities and limitations. By analyzing the distributions of raw network output vectors, it can be observed that each class has its own decision boundary and, thus, the same raw output value has different support for different classes. Inspired by this fact, we have developed a new method for out-of-distribution detection. The method offers an explanatory step beyond simple thresholding of the softmax output towards understanding and interpretation of the model learning process and its output. Instead of assigning the class label of the highest logit to each new sample presented to the network, it takes the distributions over all classes into consideration. A probability score interpreter (PSI) is created based on the joint logit values in relation to their respective correct vs wrong class distributions. The PSI suggests whether the sample is likely to belong to a specific class, whether the network is unsure, or whether the sample is likely an outlier or unknown type for the network. The simple PSI has the benefit of being applicable on already trained networks. The distributions for correct vs wrong class for each output node are established by simply running the training examples through the trained network. We demonstrate our OOD detection method on a challenging transmission electron microscopy virus image dataset. We simulate a real-world application in which images of virus types unknown to a trained virus classifier, yet acquired with the same procedures and instruments, constitute the OOD samples
Publication status:
Published
Peer review status:
Peer reviewed

Actions

Access Document

Publisher copy:
10.1186/s12859-018-2184-4

Authors

More by this author
Role:
Author
ORCID:
0000-0002-8006-5044
More by this author
Institution:
University of Oxford
Role:
Author
ORCID:
0009-0008-6372-343X
More by this author
Role:
Author
ORCID:
0000-0002-9840-7233


Publisher:
BioMed Central
Journal:
BMC Bioinformatics More from this journal
Volume:
19
Issue:
1
Pages:
173-173
Publication date:
2018-05-16
DOI:
EISSN:
1471-2105
ISSN:
1471-2105


Language:
English
Keywords:
Pubs id:
2432849
Local pid:
pubs:2432849
Source identifiers:
W2803405718
Deposit date:
2026-06-12
ARK identifier:
This ORA record was generated from metadata provided by an external service. It has not been edited by the ORA Team.

Terms of use


Views and Downloads






If you are the owner of this record, you can report an update to it here: Report update to this record

TO TOP