Crowdsourcing citation-screening in a mixed-studies systematic review: a feasibility study

Journal article

Introduction: Improvements in the delivery of intensive care have led to a growing number of children with chronic medical conditions at significant risk of recurrent and prolonged critical illness. These patients are increasingly described as having pediatric chronic critical illness (CCI). To date, pediatric CCI is without an accepted consensus case definition. Objective: To evaluate how pediatric CCI has been defined in the current literature, including the concept of prolonged PICU admission, and describe the methodologies used to develop any existing definitions. Secondary aims included describing patient characteristics and outcomes evaluated in included studies. Methods: We searched four electronic databases for studies evaluating children identified with “CCI.” We also searched for studies describing prolonged PICU admission, as this concept is related to pediatric CCI. We developed a hybrid crowdsourcing and machine-learning (ML) methodology to complete citation screening. Screening and data abstraction were performed by two reviewers, independently and in duplicate. We completed data abstraction including details of population definitions, demographic and clinical characteristics of children with CCI, and outcomes evaluated. Results: Twenty-eight reviewers from 11 countries performed citation screening, with a mean sensitivity of 92%. Of 24,729 unique citations assessed for eligibility, 453 full-texts were reviewed and 67 studies were included. Of these, 12 studies (18%) defined CCI, most commonly by a prolonged PICU length of stay (LOS), either in isolation or in addition related to medical complexity patient characteristics and/or readmissions rate. The concept of prolonged PICU admission was defined in an additional 55 (82%) studies by a median of 14 days (range, 1 day-6 weeks). Conclusion: To our knowledge, this scoping review provides the most comprehensive epidemiologic evidence addressing pediatric CCI. Our results suggest a uniform consensus definition is needed in order to advance this emerging and important area of pediatric critical care research.ThesisMaster of Science (MSc

Authors: Noel-Storr, AH; Redmond, P; Lamé, G; Liberati, E; Kelly, S

• Publication status: Published
• Peer review status: Peer reviewed
• Publisher: BioMed Central
• Journal: BMC Medical Research Methodology
• Volume: 21
• Issue: 1
• Pages: 88-88
• Article number: 88
• Publication date: 2021-04-26
• DOI: 10.1186/s12874-021-01271-4
• EISSN: 1471-2288
• ISSN: 1471-2288
• Language: English
• Keywords: World Wide Web; Crowdsourcing; Medical education; Citation; Data science; Social psychology; Medicine; Psychology; Systematic review; Task (project management); MEDLINE; Health care; Inclusion (mineral); Applied psychology; Computer science