Journal article icon

Journal article

Holistic Human-Serving Digitization of Health Care Needs Integrated Automated System-Level Assessment Tools

Abstract:
Digital health tools, platforms, and artificial intelligence– or machine learning–based clinical decision support systems are increasingly part of health delivery approaches, with an ever-greater degree of system interaction. Critical to the successful deployment of these tools is their functional integration into existing clinical routines and workflows. This depends on system interoperability and on intuitive and safe user interface design. The importance of minimizing emergent workflow stress through human factors research and purposeful design for integration cannot be overstated. Usability of tools in practice is as important as algorithm quality. Regulatory and health technology assessment frameworks recognize the importance of these factors to a certain extent, but their focus remains mainly on the individual product rather than on emergent system and workflow effects. The measurement of performance and user experience has so far been performed in ad hoc, nonstandardized ways by individual actors using their own evaluation approaches. We propose that a standard framework for system-level and holistic evaluation could be built into interacting digital systems to enable systematic and standardized system-wide, multiproduct, postmarket surveillance and technology assessment. Such a system could be made available to developers through regulatory or assessment bodies as an application programming interface and could be a requirement for digital tool certification, just as interoperability is. This would enable health systems and tool developers to collect system-level data directly from real device use cases, enabling the controlled and safe delivery of systematic quality assessment or improvement studies suitable for the complexity and interconnectedness of clinical workflows using developing digital health technologies
Publication status:
Published
Peer review status:
Peer reviewed

Actions

Access Document

Publisher copy:
10.2196/50158

Authors

More by this author
Role:
Author
ORCID:
0000-0002-5710-1975
More by this author
Role:
Author
ORCID:
0000-0002-2898-422X
More by this author
Role:
Author
ORCID:
0000-0002-4498-107X
More by this author
Institution:
University of Oxford
Role:
Author
ORCID:
0000-0002-0017-8891
More by this author
Institution:
University of Oxford
Role:
Author
ORCID:
0000-0002-3210-8273


Publisher:
JMIR Publications
Journal:
Journal of Medical Internet Research More from this journal
Volume:
25
Pages:
e50158-e50158
Publication date:
2023-12-20
DOI:
EISSN:
1438-8871
ISSN:
1438-8871


Language:
English
Keywords:
Pubs id:
1586312
Local pid:
pubs:1586312
Source identifiers:
W4389992604
Deposit date:
2026-06-04
ARK identifier:
This ORA record was generated from metadata provided by an external service. It has not been edited by the ORA Team.

Terms of use


Views and Downloads






If you are the owner of this record, you can report an update to it here: Report update to this record

TO TOP