The lucent yet opaque challenge of regulating artificial intelligence in radiology

Journal article

Clinical machine learning (ML) tools hold promise to improve patient care, though their effective implementation requires that several barriers be overcome. This thesis includes three projects designed to further understand these barriers and explore potential solutions. The first study investigated the presence and causes of sociodemographic bias in clinical ML algorithms. It found that algorithmic bias evaluations are infrequently performed, that algorithmic bias is often present, and that addressing algorithmic bias requires an approach tailored to the specific ML model and population. The second study evaluated for algorithmic bias across the development and implementation of a clinical ML tool that has been deployed into practice. This study is among the first such evaluations and identified an absence of algorithmic bias in model performance, clinical processes of care and patient outcomes for the CHARTwatch ML early warning system. This study also identified an opportunity for ML tools to be used to address pre-existing healthcare inequities, as well as outlining a roadmap for future ML implementation bias assessments. The third study evaluated how the clinical use of an ML algorithm can affect its performance over time through contamination bias. This study identified how key model parameters influence the magnitude of model performance change and explored methods to prevent model deterioration. These studies together provide strategies to identify and overcome key challenges in implementing clinical ML tools.Ph.D

Authors: Hillis, JM; Visser, JJ; Cliff, ERS; van der Geest – Aspers, K; Bizzo, BC

• Publication status: Published
• Peer review status: Peer reviewed
• Publisher: Nature Research
• Journal: npj Digital Medicine
• Volume: 7
• Issue: 1
• Pages: 69-69
• Article number: 69
• Publication date: 2024-03-15
• DOI: 10.1038/s41746-024-01071-2
• EISSN: 2398-6352
• ISSN: 2398-6352
• Language: English
• Keywords: Radiology; Optics; Medical physics; Medicine; Artificial intelligence; Opacity; Physics; Computer science