A Comparison of Machine Learning Methods to Find Clinical Trials for Inclusion in New Systematic Reviews from Their PROSPERO Registrations Prior to Searching and Screening
Saved in:
| Title: | A Comparison of Machine Learning Methods to Find Clinical Trials for Inclusion in New Systematic Reviews from Their PROSPERO Registrations Prior to Searching and Screening |
|---|---|
| Language: | English |
| Authors: | Shifeng Liu, Florence T. Bourgeois, Claire Narang, Adam G. Dunn (ORCID |
| Source: | Research Synthesis Methods. 2024 15(1):73-85. |
| Availability: | Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us |
| Peer Reviewed: | Y |
| Page Count: | 13 |
| Publication Date: | 2024 |
| Sponsoring Agency: | National Library of Medicine (DHHS/NIH) |
| Contract Number: | R01LM012976 |
| Document Type: | Journal Articles Reports - Research |
| Descriptors: | Artificial Intelligence, Medical Research, Experimental Groups, Control Groups, Documentation, Computer Software Evaluation, Data Collection, Data Analysis, Journal Articles, Performance Factors |
| DOI: | 10.1002/jrsm.1672 |
| ISSN: | 1759-2879 1759-2887 |
| Abstract: | Searching for trials is a key task in systematic reviews and a focus of automation. Previous approaches required knowing examples of relevant trials in advance, and most methods are focused on published trial articles. To complement existing tools, we compared methods for finding relevant trial registrations given a International Prospective Register of Systematic Reviews (PROSPERO) entry and where no relevant trials have been screened for inclusion in advance. We compared SciBERT-based (extension of Bidirectional Encoder Representations from Transformers) PICO extraction, MetaMap, and term-based representations using an imperfect dataset mined from 3632 PROSPERO entries connected to a subset of 65,662 trial registrations and 65,834 trial articles known to be included in systematic reviews. Performance was measured by the median rank and recall by rank of trials that were eventually included in the published systematic reviews. When ranking trial registrations relative to PROSPERO entries, 296 trial registrations needed to be screened to identify half of the relevant trials, and the best performing approach used a basic term-based representation. When ranking trial articles relative to PROSPERO entries, 162 trial articles needed to be screened to identify half of the relevant trials, and the best-performing approach used a term-based representation. The results show that MetaMap and term-based representations outperformed approaches that included PICO extraction for this use case. The results suggest that when starting with a PROSPERO entry and where no trials have been screened for inclusion, automated methods can reduce workload, but additional processes are still needed to efficiently identify trial registrations or trial articles that meet the inclusion criteria of a systematic review. |
| Abstractor: | As Provided |
| Entry Date: | 2024 |
| Accession Number: | EJ1405499 |
| Database: | ERIC |
|
Full text is not displayed to guests.
Login for full access.
|
|
Be the first to leave a comment!
