Development of a Search Filter to Retrieve Reports of Interrupted Time Series Studies from MEDLINE and PubMed

Saved in:
Bibliographic Details
Title: Development of a Search Filter to Retrieve Reports of Interrupted Time Series Studies from MEDLINE and PubMed
Language: English
Authors: Phi-Yen Nguyen (ORCID 0000-0002-0476-3385), Joanne E. McKenzie (ORCID 0000-0003-3534-1641), Simon L. Turner (ORCID 0000-0001-9163-4524), Matthew J. Page (ORCID 0000-0002-4242-7526), Steve McDonald (ORCID 0000-0003-2832-5205)
Source: Research Synthesis Methods. 2024 15(4):627-640.
Availability: Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us
Peer Reviewed: Y
Page Count: 14
Publication Date: 2024
Document Type: Journal Articles
Reports - Research
Descriptors: Search Strategies, Online Searching, Research, Information Retrieval, Reports
DOI: 10.1002/jrsm.1716
ISSN: 1759-2879
1759-2887
Abstract: Background: Interrupted time series (ITS) studies contribute importantly to systematic reviews of population-level interventions. We aimed to develop and validate search filters to retrieve ITS studies in MEDLINE and PubMed. Methods: A total of 1017 known ITS studies (published 2013-2017) were analysed using text mining to generate candidate terms. A control set of 1398 time-series studies were used to select differentiating terms. Various combinations of candidate terms were iteratively tested to generate three search filters. An independent set of 700 ITS studies was used to validate the filters' sensitivities. The filters were test-run in Ovid MEDLINE and the records randomly screened for ITS studies to determine their precision. Finally, all MEDLINE filters were translated to PubMed format and their sensitivities in PubMed were estimated. Results: Three search filters were created in MEDLINE: a "precision-maximising" filter with high precision (78%; 95% CI 74%-82%) but moderate sensitivity (63%; 59%-66%), most appropriate when there are limited resources to screen studies; a sensitivity-and-precision-maximising filter with higher sensitivity (81%; 77%-83%) but lower precision (32%; 28%-36%), providing a balance between expediency and comprehensiveness; and a "sensitivity-maximising" filter with high sensitivity (88%; 85%-90%) but likely very low precision, useful when combined with specific content terms. Similar sensitivity estimates were found for PubMed versions. Conclusion: Our filters strike different balances between comprehensiveness and screening workload and suit different research needs. Retrieval of ITS studies would be improved if authors identified the ITS design in the titles.
Abstractor: As Provided
Notes: https://osf.io/gd9x8
Entry Date: 2024
Accession Number: EJ1430259
Database: ERIC
Full text is not displayed to guests.
Description
Abstract:Background: Interrupted time series (ITS) studies contribute importantly to systematic reviews of population-level interventions. We aimed to develop and validate search filters to retrieve ITS studies in MEDLINE and PubMed. Methods: A total of 1017 known ITS studies (published 2013-2017) were analysed using text mining to generate candidate terms. A control set of 1398 time-series studies were used to select differentiating terms. Various combinations of candidate terms were iteratively tested to generate three search filters. An independent set of 700 ITS studies was used to validate the filters' sensitivities. The filters were test-run in Ovid MEDLINE and the records randomly screened for ITS studies to determine their precision. Finally, all MEDLINE filters were translated to PubMed format and their sensitivities in PubMed were estimated. Results: Three search filters were created in MEDLINE: a "precision-maximising" filter with high precision (78%; 95% CI 74%-82%) but moderate sensitivity (63%; 59%-66%), most appropriate when there are limited resources to screen studies; a sensitivity-and-precision-maximising filter with higher sensitivity (81%; 77%-83%) but lower precision (32%; 28%-36%), providing a balance between expediency and comprehensiveness; and a "sensitivity-maximising" filter with high sensitivity (88%; 85%-90%) but likely very low precision, useful when combined with specific content terms. Similar sensitivity estimates were found for PubMed versions. Conclusion: Our filters strike different balances between comprehensiveness and screening workload and suit different research needs. Retrieval of ITS studies would be improved if authors identified the ITS design in the titles.
ISSN:1759-2879
1759-2887
DOI:10.1002/jrsm.1716