Journal article
Examining agreement between clinicians when assessing sick children
- Abstract:
- Background: Case management guidelines use a limited set of clinical features to guide assessment and treatment for common childhood diseases in poor countries. Using video records of clinical signs we assessed agreement among experts and assessed whether Kenyan health workers could identify signs defined by expert consensus. Methodology: 104 videos representing 11 clinical sign categories were presented to experts using a web questionnaire. Proportionate agreement and agreement beyond chance were calculated using kappa and the AC1 statistic. 31 videos were selected and presented to local health workers, 20 for which experts had demonstrated clear agreement and 11 for which experts could not demonstrate agreement. Principal findings: Experts reached very high level of chance adjusted for some videos while for a few videos no agreement beyond chance was found. Where experts agreed Kenyan hospital staff of all cadres recognised signs with high mean sensitivity and specificity (sensitivity: 0.897 - 0.975, specificity: 0.813-0.894); years of experience, gender and hospital had no influence on mean sensitivity or specificity. Local health workers did not agree on videos where experts had low or no agreement. Results of different agreement statistics for multiple observers, the AC1 and Fleiss' kappa, differ across the range of proportionate agreement. Conclusion: Videos provide a useful means to test agreement amongst geographically diverse groups of health workers. Kenyan health workers are in agreement with experts where clinical signs are clear-cut supporting the potential value of assessment and management guidelines. However, clinical signs are not always clear-cut. Video recordings offer one means to help standardise interpretation of clinical signs.
- Publication status:
- Published
- Peer review status:
- Peer reviewed
Actions
Access Document
- Files:
-
-
(Version of record, bin, 142.5KB, Terms of use)
-
- Publisher copy:
- 10.1371/journal.pone.0004626
Authors
Contributors
+ Scherer, R
- Institution:
- "John Hopkins Bloomberg School of Public Health, USA"
- Role:
- Editor
- Publisher:
- Public Library of Science
- Journal:
- PLoS ONE More from this journal
- Volume:
- 4
- Issue:
- 2
- Article number:
- e4626
- Publication date:
- 2009-02-01
- Edition:
- Publisher's version
- DOI:
- EISSN:
-
1932-6203
- Language:
-
English
- Keywords:
- Subjects:
- UUID:
-
uuid:2766e218-de86-4d98-a238-0501fe5e091f
- Local pid:
-
ora:2764
- Deposit date:
-
2009-04-30
- ARK identifier:
Terms of use
- Copyright holder:
- J Wagai et al
- Copyright date:
- 2009
- Notes:
- Citation: Wagai, J. et al. (2009). 'Examining agreement between clinicians when assessing sick children', PLoS ONE 4(2), e4626. [Available at http://www.plosone.org]. © 2009 Wagai et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
- Licence:
- CC Attribution (CC BY)
If you are the owner of this record, you can report an update to it here: Report update to this record