Prediction model protocols indicate better adherence to recommended guidelines for study conduct and reporting

Journal article

Background and Objective: Protocols are invaluable documents for any research study, especially for prediction model studies. However, the mere existence of a protocol is insufficient if key details are omitted. We reviewed the reporting content and details of the proposed design and methods reported in published protocols for prediction model research.

Methods: We searched MEDLINE, Embase, and the Web of Science Core Collection for protocols for studies developing or validating a diagnostic or prognostic model using any modeling approach in any clinical area. We screened protocols published between Jan 1, 2022 and June 30, 2022. We used the abstract, introduction, methods, and discussion sections of The Transparent Reporting of a multivariable prediction model of Individual Prognosis Or Diagnosis (TRIPOD) statement to inform data extraction.

Results: We identified 30 protocols, of which 28 were describing plans for model development and six for model validation. All protocols were open access, including a preprint. 15 protocols reported prospectively collecting data. 21 protocols planned to use clustered data, of which one-third planned methods to account for it. A planned sample size was reported for 93% development and 67% validation analyses. 16 protocols reported details of study registration, but all protocols reported a statement on ethics approval. Plans for data sharing were reported in 13 protocols.

Conclusion: Protocols for prediction model studies are uncommon, and few are made publicly available. Those that are available were reasonably well-reported and often described their methods following current prediction model research recommendations, likely leading to better reporting and methods in the actual study.

Authors: Dhiman, P; Ma, J; Kirtley, S; Mouka, E; Waldron, CM

• Publication status: Published
• Peer review status: Peer reviewed
• Publisher: Elsevier
• Journal: Journal of Clinical Epidemiology
• Volume: 169
• Article number: 111287
• Publication date: 2024-02-20
• Acceptance date: 2024-02-15
• DOI: 10.1016/j.jclinepi.2024.111287
• EISSN: 1878-5921
• ISSN: 0895-4356
• Pmid: 38387617
• Language: English
• Keywords: prediction model; protocol; reporting; TRIPOD; systematic review; methodology