Searchsmart.org: Guiding Researchers to the Best Databases and Search Systems for Systematic Reviews and Beyond
Saved in:
| Title: | Searchsmart.org: Guiding Researchers to the Best Databases and Search Systems for Systematic Reviews and Beyond |
|---|---|
| Language: | English |
| Authors: | Michael Gusenbauer (ORCID |
| Source: | Research Synthesis Methods. 2024 15(6):1200-1213. |
| Availability: | Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us |
| Peer Reviewed: | Y |
| Page Count: | 14 |
| Publication Date: | 2024 |
| Intended Audience: | Researchers |
| Document Type: | Journal Articles Reports - Descriptive |
| Descriptors: | Researchers, Research Methodology, Research Skills, Research Tools, Databases, Information Retrieval, Search Strategies, Open Educational Resources, Open Source Technology, Search Engines, Computer Software Reviews |
| DOI: | 10.1002/jrsm.1746 |
| ISSN: | 1759-2879 1759-2887 |
| Abstract: | When searching for scholarly documents, researchers often stick with the same familiar handful of databases. Yet, just beyond these limited horizons lie dozens of alternatives with which they could search more effectively, whether for quick lookups or thorough searches in systematic reviews or meta-analyses. Searchsmart.org is a free website that guides researchers to particularly suitable search options for their particular disciplines, offering a wide array of resources, including search engines, aggregators, journal platforms, repositories, clinical trials databases, bibliographic databases, and digital libraries. Search Smart currently evaluates the coverage and functionality of more than a hundred leading scholarly databases, including most major multidisciplinary databases and many that are discipline-specific. Search Smart's primary use cases involve database-selection decisions as part of systematic reviews, meta-analyses, or bibliometric analyses. Researchers can use up to 583 criteria to filter and sort recommendations of databases and the interfaces through which they can be accessed for user-friendliness, search rigor, or relevance. With specific pre-defined filter settings, researchers can quickly identify particularly suitable databases for Boolean keyword searching and forward or backward citation searching. Overall, Search Smart's recommendations help researchers to discover knowledge more effectively and efficiently by selecting the more suitable databases for their tasks. |
| Abstractor: | As Provided |
| Entry Date: | 2024 |
| Accession Number: | EJ1447363 |
| Database: | ERIC |
|
Full text is not displayed to guests.
Login for full access.
|
|
| FullText | Links: – Type: pdflink Url: https://content.ebscohost.com/cds/retrieve?content=AQICAHj0k_4E0hTGH8RJwT4gCJyBsGNe_WN95AvKlDbXJGqwxwHNV1d4LRl81OyXeO6ULOW1AAAA4zCB4AYJKoZIhvcNAQcGoIHSMIHPAgEAMIHJBgkqhkiG9w0BBwEwHgYJYIZIAWUDBAEuMBEEDHHbKyUf3b9y-VqzvwIBEICBm13dEkjXbcRVCDdGs2GiMDwHBZVhbx6IIRe2CkynJqrAvZH6pEZTtZBIAz3LShBl1lFTdn20ToqU9A9dQzxgRGhpQ4ebujB-9gxyVKx0fqHQfznACXv84E7oS6qDXaqP-K8XSQNbJ62YJjIdzX8DgIbHL6RoKZwB8KP2SCzQJstvSlXuj1pDg0z6hsNKi3DO8Vgpbx1bGSGXdSht Text: Availability: 1 Value: <anid>AN0180736605;[bdct]01nov.24;2024Nov11.04:50;v2.2.500</anid> <title id="AN0180736605-1">Searchsmart.org: Guiding researchers to the best databases and search systems for systematic reviews and beyond </title> <p>When searching for scholarly documents, researchers often stick with the same familiar handful of databases. Yet, just beyond these limited horizons lie dozens of alternatives with which they could search more effectively, whether for quick lookups or thorough searches in systematic reviews or meta‐analyses. Searchsmart.org is a free website that guides researchers to particularly suitable search options for their particular disciplines, offering a wide array of resources, including search engines, aggregators, journal platforms, repositories, clinical trials databases, bibliographic databases, and digital libraries. Search Smart currently evaluates the coverage and functionality of more than a hundred leading scholarly databases, including most major multidisciplinary databases and many that are discipline‐specific. Search Smart's primary use cases involve database‐selection decisions as part of systematic reviews, meta‐analyses, or bibliometric analyses. Researchers can use up to 583 criteria to filter and sort recommendations of databases and the interfaces through which they can be accessed for user‐friendliness, search rigor, or relevance. With specific pre‐defined filter settings, researchers can quickly identify particularly suitable databases for Boolean keyword searching and forward or backward citation searching. Overall, Search Smart's recommendations help researchers to discover knowledge more effectively and efficiently by selecting the more suitable databases for their tasks.</p> <p>Keywords: bibliometric analyses; comparison of bibliographic databases; database selection; metamorphic testing; systematic reviews and meta‐analyses; systematic searching</p> <hd id="AN0180736605-2">Highlights</hd> <p></p> <hd id="AN0180736605-3">What is already known</hd> <p></p> <ulist> <item> Database selection influences the quality of knowledge discovery, particularly in systematic reviews, meta‐analyses and bibliometric analyses.</item> <p></p> <item> Selecting a few highly suitable literature databases is likely to be enough to fulfill high standards in sample selection.</item> </ulist> <hd id="AN0180736605-4">What is new</hd> <p></p> <ulist> <item> Search Smart is a free website that guides researchers to the literature databases that are likely most productive to search with.</item> <p></p> <item> Based on the original data Search Smart collects, databases' capabilities and limitations become comparable in unprecedented detail.</item> </ulist> <hd id="AN0180736605-5">Potential impact for Research Synthesis Methods readers</hd> <p></p> <ulist> <item> With Search Smart, researchers can quickly learn which databases they should use to find relevant documents most effectively and efficiently.</item> </ulist> <hd id="AN0180736605-6">INTRODUCTION</hd> <p>In just 14 years, the number of documents available to researchers has doubled.[<reflink idref="bib1" id="ref1">1</reflink>] Thus, over time, it is becoming increasingly important to know how best to identify relevant scholarly documents such as journal articles, conference publications, and clinical trials. Academic databases accessible through search engines, aggregators, journal platforms, digital libraries, and other search systems are essential sources for researchers to find these documents. To use their research time to best effect, researchers must focus their search on the most suitable databases. This means selecting databases that likely cover the most relevant documents and allow the type of searches that researchers aim to conduct.</p> <p>However, choosing the most suitable databases can be challenging. There are hundreds of options available, all offering different coverage, functionality, and interfaces. Currently, there is only limited information on which database to select for searching—whether as part of day‐to‐day work or for more thorough reviews. Database analyses are focused on one or a few databases (e.g., Boeker et al.[<reflink idref="bib1" id="ref2">1</reflink>]) or a narrow range of characteristics, such as subject coverage (e.g., Martín‐Martín et al.[<reflink idref="bib2" id="ref3">2</reflink>]). Most analyses neglect the functionality of search interfaces entirely. This lack of detailed information and rankings means that researchers tend to stay with the databases they already know, or those used by studies they cite, with no clear sense of whether or not these databases are the most relevant or appropriate.</p> <p>Search Smart (<ulink href="http://www.searchsmart.org">www.searchsmart.org</ulink>)[<reflink idref="bib3" id="ref4">3</reflink>] is a web‐based tool to guide researchers to particularly suitable databases to search for academic literature. Search Smart distinguishes between databases that host scholarly documents and the search systems that make the databases accessible via a search interface. Search Smart compares a wide variety of databases and search systems—aggregators such as Web of Science, search engines such as Google Scholar, publisher databases such as SpringerLink, bibliographic databases such as PubMed, digital libraries such as ACM, repositories such as arXiv, or clinical trials databases such as ClinicalTrials.gov. The common denominator is that they all host scholarly bibliographic information of all types.</p> <p>Currently, Search Smart allows researchers to compare 106 important bibliographic and clinical trials databases (see Table 1), which are searchable via 68 interfaces. This selection is continuously expanding. The databases are selected for analysis when they primarily host scholarly content, cover at least one of the 26 All Science Journal Classification (ASJC) subjects,[<reflink idref="bib4" id="ref5">4</reflink>] primarily in English, and vary in size but with a preference for larger databases with over a million records. Additionally, databases must provide a search interface and query hit count information. The selection aims to encompass a diverse mix of open and paywalled, new and established databases, and is ready to include new systems based on these standards.</p> <p>1 TABLE List of the 106 databases and search systems covered as of July 15th, 2024.</p> <p> <ephtml> &lt;table&gt;&lt;tbody valign="top"&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;ABI/Inform Global (via ProQuest)&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Academia.edu&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Academic Search Elite (via EBSCOhost)&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Academic Search Premier (via EBSCOhost)&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;ACM Guide to Computing Literature&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;ACS Publications&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;AIS eLibrary&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;APA PsycInfo (via EBSCOhost)&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;APA PsycInfo (via Ovid)&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;APA PsycNet&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Arts &amp; Humanities Citation Index (via Web of Science)&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;arXiv&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Bielefeld Academic Search Engine&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Biological Science Database (via ProQuest)&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;BIOSIS Citation Index (via Web of Science)&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Business Source Premier (via EBSCOhost)&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;CAB Abstracts (via Ovid)&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;CAS SciFinder&amp;#8208;n&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;CINAHL (via EBSCOhost)&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;CINAHL Plus (via EBSCOhost)&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;ClinicalTrials.gov&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;CNKI Overseas&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Cochrane Database of Systematic Reviews&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Cochrane Library&amp;#8212;CENTRAL&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Conference Proceedings Citation Index&amp;#8212;Science (via Web of Science)&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Conference Proceedings Citation Index&amp;#8212;Social Science &amp; Humanities (via Web of Science)&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;CORE&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Crossref&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;dblp&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Dimensions&amp;#8212;Clinical Trials&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Dimensions&amp;#8212;Publications&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Dimensions&amp;#8212;Publications (free)&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Dissertations &amp; Theses Global (via ProQuest)&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;DOAJ&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Earth, Atmospheric &amp; Aquatic Science Database (via ProQuest)&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;EconBiz&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;EconLit (via EBSCOhost)&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;EconStor&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Embase (via Ovid)&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Emerald Insight&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Emerging Sources Citation Index (via Web of Science)&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Environmental Science Database (via ProQuest)&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Epistemonikos&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;ERIC&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;ERIC (via EBSCOhost)&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;EU Clinical Trials Register&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Europe PMC&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Food Science and Technology Abstracts (via EBSCOhost)&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;GeoRef (via ProQuest)&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Google Scholar&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;GreenFILE (via EBSCOhost)&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;HAL&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;IEEE Xplore&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Ingenta Connect&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;International Bibliography of the Social Sciences (via ProQuest)&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Internet Archive Scholar&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;JSTOR&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Lens&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Medline (via EBSCOhost)&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Medline (via Ovid)&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Medline (via Web of Science)&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Mendeley&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Naver Academic&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Nursing &amp; Allied Health Database (via ProQuest)&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Open Access Theses and Dissertations&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;OpenAIRE&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;OpenAlex&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Overton&amp;#8212;Scholarly Articles&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Overton&amp;#8212;Policy Documents&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Paperity&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Pascal and Francis Bibliographic Databases&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Policy Commons&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Psychology &amp; Behavioral Sciences Collection (via EBSCOhost)&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Public Health Database (via ProQuest)&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Public Library of Science (PLOS)&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;PubMed&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;RePEc (via EconPapers)&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;RePEc (via IDEAS)&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;ResearchGate&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;SAGE Journals Online&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;ScanMedicine&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Science Citation Index Expanded (via Web of Science)&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;ScienceDirect&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;ScienceOpen&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Scilit&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Scinapse&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Scite&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;SciTech Premium Collection (via ProQuest)&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Scopus&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Semantic Scholar&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Social Sciences Citation Index (via Web of Science)&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Social Sciences Premium Collection (via ProQuest)&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;SocINDEX (via EBSCOhost)&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Sociological Abstracts (via ProQuest)&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;SPORTDiscus (via EBSCOhost)&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;SpringerLink&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;SSRN&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Taylor and Francis Online&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Virtual Health Library&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Web of Science Core Collection&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;WHO International Clinical Trials Registry Platform&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;Wiley Online Library&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;World Transit Research&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;WorldCat&amp;#8212;Article/chapter only&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;WorldCat&amp;#8212;Thesis/dissertation&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;list list-type="Bullet"&gt;&lt;list-item&gt;&lt;p&gt;zbMATH Open&lt;/p&gt;&lt;/list-item&gt;&lt;/list&gt;&lt;/td&gt;&lt;/tr&gt;&lt;/tbody&gt;&lt;/table&gt; </ephtml> </p> <p>Search Smart allows independent comparisons at an unprecedented level of detail because it collects original data on databases and their search interfaces unavailable elsewhere. Through detailed comparisons, Search Smart aims to enable users to select suitable databases with just a few clicks—whether that be the most popular choices, options hidden behind paywalls, or unjustly neglected alternatives.</p> <hd id="AN0180736605-7">SEARCH SMART'S MAIN USER GROUPS</hd> <p>While Search Smart is designed to assist all academic information seekers, it is particularly valuable for those whose research outcomes are closely tied to the suitability of the databases on which they rely. Within that broad category, Search Smart mainly caters to three user groups.</p> <p>First, systematic reviewers and meta‐analysts (from now on, simply "systematic reviewers") need a search process that is comprehensive, reproducible, and transparent.[<reflink idref="bib5" id="ref6">5</reflink>] Many disciplines rely on the medical Cochrane Handbook for Systematic Reviews of Interventions[<reflink idref="bib6" id="ref7">6</reflink>] and its Methodological Expectations of Cochrane Intervention Reviews (MECIR).[<reflink idref="bib7" id="ref8">7</reflink>] These serve as methodological benchmarks[<reflink idref="bib8" id="ref9">8</reflink>] across disciplines and inform guidelines such as those from the Campbell Collaboration[<reflink idref="bib9" id="ref10">9</reflink>] or the Collaboration for Environmental Evidence.[<reflink idref="bib10" id="ref11">10</reflink>] Cochrane mandates <emph>systematic keyword searching</emph> and <emph>backward citation searching</emph>, along with recommended <emph>forward citation searches</emph>. Search Smart allows users to identify particularly suitable options for all three of these search types with pre‐defined filter settings. Further, Search Smart provides recommendations for researchers seeking <emph>specific record types</emph>, particularly for medical researchers searching for <emph>clinical trials</emph>.</p> <p>Second, bibliometric analysts investigate the connections between research documents as tracked by databases' citation indices, whose quality Search Smart compares. The popular VOSviewer[<reflink idref="bib11" id="ref12">11</reflink>] software, for example, relies on <emph>backward citation searches</emph> to draw citation links, co‐citation links, or bibliographic coupling between documents. Thus, the coverage of the chosen database's backward citation information will determine the quality and shape of the resulting network analyses.[<reflink idref="bib12" id="ref13">12</reflink>]</p> <p>Third, librarians and other information specialists can carry out <emph>detailed comparisons of the databases</emph> they use and curate, obtaining insights into the pros and cons of different databases based on Search Smart's unique data. Search Smart not only gives an overview of search options but also independently verifies search providers' claims.</p> <hd id="AN0180736605-8">HOW SEARCH SMART WORKS</hd> <p>Search Smart generates ranked lists of databases that meet specific requirements and that cover more records of a particular type or related to a specific discipline. Search Smart offers 583 criteria with which users can filter and sort databases (see Figure 1, detail A). As these myriad options for filtering and sorting can be overwhelming at first, Search Smart offers three pre‐defined filter settings—so‐called "presets"—that activate a combination of multiple filters at once (see Figure 1, detail B). Search Smart uses presets to evaluate databases as <emph>extensive</emph>, <emph>sufficient</emph>, or <emph>limited</emph> based on their ability to meet users' requirements—categories that have been developed in previous research.[<reflink idref="bib5" id="ref14">5</reflink>] Databases that meet all minimum requirements are deemed <emph>sufficient</emph>, while those that also provide bulk select and export options—capabilities to enable search efficiency and organization of large result sets—are rated <emph>extensive</emph>. Databases that fail one or more of the minimum requirements are labeled <emph>limited</emph> and are recommended to be used with caution or not at all (for details, see https://<ulink href="http://www.searchsmart.org/faq#what-are-presets;">www.searchsmart.org/faq#what-are-presets;</ulink> button see Figure 1, detail B).</p> <p> <img src="https://imageserver.ebscohost.com/img/embimages/rdk/BDCT/01nov24/jrsm1746-fig-0001.jpg?ephost1=dGJyMMvl7ESepq84yOvsOLCmsE6epq5Srqa4SK6WxWXS" alt="jrsm1746-fig-0001.jpg" title="1 Search Smart &quot;Find!&quot; view ranking 45 out of 100 scholarly records databases: Users may filter and sort databases based on their coverages and functions. (A = Coverage and functions filters; B = Pre‐defined filters (&quot;presets&quot;), including the &quot;Bulk select &amp; export options&quot; button; C = Sorting options for databases; D = Detailed comparison of up to six pinned databases)." /> </p> <p></p> <p>Search Smart's six primary use cases and their relevance for each user group are outlined in Table 2 and further elaborated below. A case study in Section 4 provides an illustration.</p> <p>2 TABLE Search Smart's main user groups and their use cases.</p> <p> <ephtml> &lt;table&gt;&lt;thead valign="bottom"&gt;&lt;tr&gt;&lt;th align="left"&gt;Search Smart use case&lt;/th&gt;&lt;th align="left"&gt;Systematic reviewers, meta&amp;#8208;analysists&lt;/th&gt;&lt;th align="left"&gt;Bibliometric analysts&lt;/th&gt;&lt;th align="left"&gt;Librarians, information specialists&lt;/th&gt;&lt;/tr&gt;&lt;/thead&gt;&lt;tbody valign="top"&gt;&lt;tr&gt;&lt;td align="left"&gt;(1) Systematic keyword searching&lt;/td&gt;&lt;td align="left"&gt;&amp;#8226;&lt;/td&gt;&lt;td align="left" /&gt;&lt;td align="left"&gt;&amp;#8226;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;(2) Backward citation searching&lt;/td&gt;&lt;td align="left"&gt;&amp;#8226;&lt;/td&gt;&lt;td align="left"&gt;&amp;#8226;&lt;/td&gt;&lt;td align="left"&gt;&amp;#8226;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;(3) Forward citation searching&lt;/td&gt;&lt;td align="left"&gt;&amp;#8226;&lt;/td&gt;&lt;td align="left" /&gt;&lt;td align="left"&gt;&amp;#8226;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;(4) Searching for specific record types&lt;/td&gt;&lt;td align="left"&gt;&amp;#8226;&lt;/td&gt;&lt;td align="left" /&gt;&lt;td align="left"&gt;&amp;#8226;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;(5) Clinical trials searching&lt;/td&gt;&lt;td align="left"&gt;&amp;#8226; (mostly health sciences)&lt;/td&gt;&lt;td align="left" /&gt;&lt;td align="left"&gt;&amp;#8226; (mostly health sciences)&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;(6) Detailed database comparisons&lt;/td&gt;&lt;td align="left" /&gt;&lt;td align="left" /&gt;&lt;td align="left"&gt;&amp;#8226;&lt;/td&gt;&lt;/tr&gt;&lt;/tbody&gt;&lt;/table&gt; </ephtml> </p> <hd id="AN0180736605-10">Use case 1: Systematic keyword searching</hd> <p>Selecting the <bold>"Systematic keyword searching" preset</bold> activates nine filters that limit the selection of databases to those that support: accurate Boolean OR/AND operators; reproducible search results; verbatim queries and nested searching; searches with 25 or more keywords; abstract searches; and at least 1000 accessible search results. These are the minimum standards that databases and their search systems must fulfill if systematic reviewers are to rely on them as principal databases.[<reflink idref="bib5" id="ref15">5</reflink>]</p> <p>Additionally selecting the <bold>"Bulk select &amp; export options" button</bold> will activate two more filters that further limit the selection by requiring databases to support bulk selection of records and exports of 50 or more records at a time. Further, systematic reviewers may select additional filters to list only databases that support functions such as truncation, the Boolean NOT operator, a search history, a query builder, proximity operators, or exceptionally long queries. Experimenting with activating/deactivating filter and preset settings is straightforward, allowing users to learn which databases support which functions.</p> <p>Systematic reviewers are recommended to search the potentially more fruitful databases first,[<reflink idref="bib13" id="ref16">13</reflink>] likely a combination of a few, yet highly suitable multidisciplinary and specialized databases.[<reflink idref="bib14" id="ref17">14</reflink>] Thus, users will be interested in databases that cover most of the records they seek. In addition to filtering databases based on their systems' functions ("Systematic keyword searching" preset), Search Smart allows databases to be sorted based on their coverage (see Figure 1, detail C).</p> <p>To rank databases <emph>with the most records</emph> from a particular discipline at the top, users may select one or more subjects and sort according to absolute coverage via <bold>"Subject coverage (absolute/descending)."</bold> To identify the most specialized databases, users may sort via <bold>"Subject coverage (relative/descending)"</bold> which will rank databases <emph>with the highest share</emph> from a particular discipline at the top. High <emph>absolute</emph> coverage supports sensitive searches (finding more relevant records), while high <emph>relative</emph> coverage supports precise searches (finding fewer irrelevant records). Similarly, databases may be also sorted according to their record‐type coverage, although this information is not available for all databases. If authors seek specific record types (e.g., journal articles, conference proceedings), they can combine Search Smart's subject and record‐type coverage filters to show the databases covering the most records of particular types on specific subjects.</p> <hd id="AN0180736605-11">Use case 2: Backward citation searching</hd> <p>Backward citation searching is the search for references cited in a specific seed document. Since some databases do not support this function, researchers must select the <bold>"Backward citation searching" preset</bold>, which activates two filters: backward citation information available and 1000 or more accessible records. Together, these two criteria ensure that the database's interface shows backward citation information and that sufficient records will be displayed. Many users will want to efficiently export backward citations for subsequent deduplication and organization in reference management software. For this purpose, selecting the <bold>"Bulk select &amp; export options" button</bold> will add two more filters: bulk select multiple records' backward citations and bulk export 500 or more backward citations at a time. If users have further requirements, they may add additional filters to identify databases that meet them.</p> <p>Users will probably choose to sort the filtered databases by "<bold>Backward citation score (descending)"</bold>: an indicator of the comprehensiveness and accuracy of a database's backward citation index. Citation scores vary between 0% (no backward citation information) and 100% (all records have fully accurate backward citation information). This sorting option is only available when the "backward citation information" filter is active. Further, since ranking solely on citation score will place databases highly irrespective of their subject focus, users can use a combined filter—<bold>"Backward citation coverage × Subject coverage (descending)"</bold>—to identify those databases that offer greater absolute coverage of one or more selected subjects combined with a higher backward citation score.</p> <p>Ranking according to backward citation score helps to identify databases that likely provide more comprehensive and accurate data upon which bibliographic analysts can base their analysis. As the popular VOSviewer,[<reflink idref="bib11" id="ref18">11</reflink>] Bibliometrix,[<reflink idref="bib12" id="ref19">12</reflink>] CiteSpace[<reflink idref="bib15" id="ref20">15</reflink>] software programs can only compute data from a single citation index, selecting the most appropriate dataset is imperative. Selecting the <bold>"Supported by bibliometric tools" button</bold> allows filtering for databases that are supported by VOSviewer, Bibliometrix, or CiteSpace. Applying the <bold>"Backward citation coverage × Subject coverage (descending)" sorting</bold> to various subject selections shows that, among the aforementioned databases, Lens and Web of Science (various databases) often rank highest. However, individual user requirements may make other databases more suitable. Overall, selecting a database with higher backward citation searching quality will yield more relevant documents.</p> <hd id="AN0180736605-12">Use case 3: Forward citation searching</hd> <p>Forward citation searching is the search for documents that cite a specific document. The <bold>"Forward citation searching" preset</bold> and the <bold>"Bulk select &amp; export options" button</bold> activate filters similar to those for backward citation searching.</p> <p>If databases are sorted according to their "<bold>Forward citation score (descending),"</bold> Search Smart will list databases with more comprehensive forward citation indices at the top. This option will only be available when the "forward citation information" filter is active. With the <bold>"Forward citation coverage × Subject coverage (descending)"</bold> setting activated, databases with higher absolute coverage of the selected subject(s) combined with a higher citation score will rank toward the top.</p> <hd id="AN0180736605-13">Use case 4: Searching for specific record types</hd> <p>Often, users seek specific record types such as journal articles, reviews, preprints, or gray literature. Here, databases vary widely in their coverage: some focus exclusively on specific record types, such as preprint or thesis repositories, while others offer a greater variety.</p> <p>At Search Smart, users may filter for databases covering specific record types by selecting one or more types in the <bold>"Record type coverage"</bold> filter. Further, using the <bold>"Record type coverage (absolute or relative/descending)" sorting</bold> will rank the databases with the most absolute or relative coverage of the selected record type(s) at the top. If users are looking for records on specific subjects, they can sort according to the combination of subject and record type coverage: <bold>"Subject × Record type coverage (absolute/relative − descending)."</bold> The resulting list will show databases likely containing the most records of a particular type(s) on a specific subject. Here, it is important to bear in mind that some databases, like Google Scholar, are ranked at the very bottom because although they may cover a given type of record, the <emph>extent</emph> to which they cover it is unknown.</p> <hd id="AN0180736605-14">Use case 5: Clinical trials databases</hd> <p>For systematic reviewers in the medical field, it is mandatory to search for clinical trials according to Cochrane's MECIR guidance.[<reflink idref="bib7" id="ref21">7</reflink>] For this use case, the <bold>clinical trials view</bold> of Search Smart solely lists databases that cover clinical trials. Some of these databases will cover clinical trials exclusively (e.g., ClinicalTrials.gov), while others have only a minor share. In the clinical trials view, users may refine clinical trials databases with the same filters as scholarly records databases—particularly via the systematic keyword searching and forward/backward citation searching presets.</p> <hd id="AN0180736605-15">Use case 6: Detailed database comparisons</hd> <p>Librarians and other information specialists who regularly work with databases may find Search Smart's <bold>detailed database comparisons</bold> useful. In the "Find!" view, users can select ("pin") two to six databases they want to compare in more detail (see Figure 1, detail D). Librarians may use the original data collected at Search Smart to inform procurement decisions by comparing details of proprietary databases against free alternatives, databases offered by different search providers, or different database versions. Librarians may be surprised to learn how almost identical databases differ in subject coverage, retrospective coverage, or search interface functionality (see Figures 2 and 3). Search Smart's original data illustrates performance differences[<reflink idref="bib5" id="ref22">5</reflink>] or previously undocumented gaps in some databases' retrospective coverage.</p> <p> <img src="https://imageserver.ebscohost.com/img/embimages/rdk/BDCT/01nov24/jrsm1746-fig-0002.jpg?ephost1=dGJyMMvl7ESepq84yOvsOLCmsE6epq5Srqa4SK6WxWXS" alt="jrsm1746-fig-0002.jpg" title="2 Search Smart &quot;Compare&quot; view: A detailed comparison of two to six databases and their search systems. Compares retrospective coverage, subject coverage (absolute/relative), record type coverage (absolute/relative), and many functionality criteria in great detail. This example compares medical databases." /> </p> <p></p> <p> <img src="https://imageserver.ebscohost.com/img/embimages/rdk/BDCT/01nov24/jrsm1746-fig-0003.jpg?ephost1=dGJyMMvl7ESepq84yOvsOLCmsE6epq5Srqa4SK6WxWXS" alt="jrsm1746-fig-0003.jpg" title="3 Search Smart &quot;Compare&quot; view. A comparison of the retrospective coverage of PubMed and Europe PMC shows the years where each database has unique coverage." /> </p> <p></p> <hd id="AN0180736605-18">Additional use cases</hd> <p>An overview of all six aforementioned use cases and others, along with step‐by‐step instructions on how to navigate Search Smart, can be found at Searchsmart.org/tutorials. Additional use cases covered include identifying databases with the most coverage of a keyword, for example, "Covid‐19"; finding free‐to‐access databases or those with substantial open access coverage; finding databases with certain retrospective coverage or that support the identification of "hot" papers; databases that support full‐text searching, controlled vocabularies, certain field codes, or search operators; and many other search options.</p> <hd id="AN0180736605-19">Saving Search Smart's recommendations</hd> <p>A specific advantage of Search Smart is that all selected and sorted databases, including the particular settings used by researchers, may be saved through a PDF export (see the example in Figure 4). The PDF export also tracks which databases were excluded and the filters used to exclude them. Detailed data on individual databases can also be downloaded via Excel exports. Such downloads are recommended to save a snapshot of the databases' functionalities when they were last reviewed. Both PDF and Excel exports contain links so that the recommendations may be updated in the future. Additionally, a share function allows users to save and share specific selections, database details, comparisons, and tutorials with colleagues.</p> <p> <img src="https://imageserver.ebscohost.com/img/embimages/rdk/BDCT/01nov24/jrsm1746-fig-0004.jpg?ephost1=dGJyMMvl7ESepq84yOvsOLCmsE6epq5Srqa4SK6WxWXS" alt="jrsm1746-fig-0004.jpg" title="4 PDF export to save Search Smart's database comparison. In this example, databases listed toward the top host the most medical records and meet systematic keyword searching criteria." /> </p> <p></p> <hd id="AN0180736605-21">CASE STUDY: USING SEARCH SMART IN A MEDICAL SYSTEMATIC REVIEW</hd> <p>The following illustrates multiple Search Smart use cases in the case of a medical systematic literature review. The medical field was selected because most systematic reviews are conducted in the discipline,[<reflink idref="bib16" id="ref23">16</reflink>] making it particularly crucial to identify capable medical databases and search systems. However, this specific illustration also shows how scholars in other areas can identify suitable databases and search systems, as the logics of database selection will be broadly similar.</p> <hd id="AN0180736605-22">Systematic keyword searching</hd> <p>Medical guidance stipulates systematic keyword searching as the <emph>main</emph> way to identify literature in systematic reviews[<reflink idref="bib6" id="ref24">6</reflink>]—a recommendation that is common among disciplines.[[<reflink idref="bib9" id="ref25">9</reflink>]] Methodical papers show that searching multiple highly suitable <emph>principal</emph> databases yields best results[[<reflink idref="bib17" id="ref26">17</reflink>]]—ideally a combination of a few large, multidisciplinary databases with smaller ones with subject‐specific specialization.[[<reflink idref="bib19" id="ref27">19</reflink>], [<reflink idref="bib21" id="ref28">21</reflink>]]</p> <p>To identify principal databases that particularly suitable for systematic keyword searching, we select Search Smart's <bold>"Systematic keyword searching" preset</bold> and obtain a filtered list. To further refine this list and identify the largest databases with the widest medical coverage, we select "Medicine" as a subject, sort the list via <bold>"Subject coverage (absolute/descending)"</bold> and get: (<reflink idref="bib1" id="ref29">1</reflink>) Lens, (<reflink idref="bib2" id="ref30">2</reflink>) Dimensions, (<reflink idref="bib3" id="ref31">3</reflink>) SciTech Premium Collection (via ProQuest), (<reflink idref="bib4" id="ref32">4</reflink>) Scopus, (<reflink idref="bib5" id="ref33">5</reflink>) EuropePMC, (<reflink idref="bib6" id="ref34">6</reflink>) Embase (via Ovid), and (<reflink idref="bib7" id="ref35">7</reflink>) Web of Science Core Collection. To identify the databases that are most specialized in medicine, we sort via <bold>"Subject coverage (relative/descending)"</bold> and get: (<reflink idref="bib1" id="ref36">1</reflink>) Epistemonikos, (<reflink idref="bib2" id="ref37">2</reflink>) Cochrane Database of Systematic Reviews, (<reflink idref="bib3" id="ref38">3</reflink>) CINAHL Plus (via EBSCOhost), (<reflink idref="bib4" id="ref39">4</reflink>) Embase (via Ovid), (<reflink idref="bib5" id="ref40">5</reflink>) Virtual Health Library, and (<reflink idref="bib6" id="ref41">6</reflink>) Nursing &amp; Allied Health Database (via ProQuest).</p> <p>Based on insights such as these, systematic reviewers can reflect on which database combination makes the most sense for them. We select the two multidisciplinary databases with the highest <emph>absolute</emph> subject coverage (<bold>Lens and Dimensions</bold>) and one or two databases with the highest <emph>relative</emph> coverage for each subject the review covers (<bold>Epistemonikos and Cochrane Database of Systematic Reviews</bold>). Since the two most medically specialized databases in our ranking are relatively small, we consider the next two to be our principal databases: <bold>CINAHL Plus (via EBSCOhost) and Embase (via Ovid)</bold>.</p> <p>Medical researchers may have specific additional requirements, and thus may further refine the list with additional filters before firming up on their selections. For example, if they only want databases with extensive export options, they may select the <bold>"Bulk select &amp; export options" button</bold>, or if they want to filter for databases with a hierarchical controlled vocabulary, Search Smart has a filter to suit: <bold>"Query &gt; Controlled vocabulary − hierarchical."</bold> Researchers from resource‐constrained environments[<reflink idref="bib22" id="ref42">22</reflink>] who cannot access proprietary databases may identify suitable options by additionally activating the <bold>"Non‐paywalled databases"</bold> filter.</p> <hd id="AN0180736605-23">Backward citation searching</hd> <p>Using backward/forward citation searching will improve the quality of a search, especially for linguistically diverse topics that are difficult to capture by keyword searches alone.[<reflink idref="bib23" id="ref43">23</reflink>] To identify ideal medical databases for backward citation searching, we select the <bold>"Backward citation searching" preset</bold> and sort the list via <bold>"Backward citation score × Subject coverage (descending)"</bold> based on the Medicine subject we have already selected.</p> <p>To effectively download citations for subsequent deduplication and screening, we need highly capable databases with extensive export options. Thus, we additionally select the <bold>"Bulk select &amp; export options" button</bold> and receive (<reflink idref="bib1" id="ref44">1</reflink>) Lens, (<reflink idref="bib2" id="ref45">2</reflink>) Web of Science Core Collection, (<reflink idref="bib3" id="ref46">3</reflink>) Scopus, (<reflink idref="bib4" id="ref47">4</reflink>) Science Citation Index Expanded (via Web of Science), (<reflink idref="bib4" id="ref48">4</reflink>) Medline (via Web of Science), (<reflink idref="bib5" id="ref49">5</reflink>) Social Sciences Citation Index (via Web of Science). The top‐ranked databases cover more medical records and have higher coverage and accuracy of backward citations. The top database is <bold>Lens</bold>—a capable choice, but the quality of its backward citation information is somewhat flawed (score of 82.35%). The best option, with a superior citation score yet somewhat inferior subject coverage, is therefore the <bold>Web of Science Core Collection</bold> (score of 94.17%). However, it is important to bear in mind that the Web of Science Core Collection contains different database versions and should only be considered if a researcher has access to its main databases (e.g., SSCI, SCI) and they offer sufficient retrospective coverage.</p> <hd id="AN0180736605-24">Forward citation searching</hd> <p>The <bold>"Forward citation searching"</bold> preset with the sorting option <bold>"Forward citation score (descending)"</bold> lists databases with the most forward citation coverages at the top. To tailor results to medicine, we also select the Medicine subject and the sorting option <bold>"Forward citation score × Subject coverage (descending)."</bold> To filter out databases with inadequate <bold>"Bulk select &amp; export options,"</bold> we also activate this filter. The resulting list ranks databases with higher medical coverage and more comprehensive forward citation indices toward the top; they are: (<reflink idref="bib1" id="ref50">1</reflink>) Lens, (<reflink idref="bib2" id="ref51">2</reflink>) Scilit, (<reflink idref="bib3" id="ref52">3</reflink>) Scopus, (<reflink idref="bib4" id="ref53">4</reflink>) CAS SciFinder‐n, and (<reflink idref="bib5" id="ref54">5</reflink>) Medline (via Web of Science).</p> <p>Google Scholar—the gold standard in forward citation coverage—is not included in the list as it does not natively support bulk exports. A workaround may be the Publish or Perish software,[<reflink idref="bib24" id="ref55">24</reflink>] which allows downloading of up to 1000 forward citations per publication year for individual seed documents. If researchers seek particular types or qualities of citations, they may access more limited and specialized databases—such as Scopus, which indexes higher‐quality journals, or Medline (via Web of Science), which indexes mostly medical documents.</p> <hd id="AN0180736605-25">Searching for specific record types</hd> <p>Systematic reviewers must include various record types in their analysis—particularly journal articles, conference proceedings, previous literature reviews, gray literature, and preprints. Different databases cover these record types to varying degrees. Thus, to allow targeted searches, Search Smart tells reviewers which databases offer the most coverage for these types. Medical reviewers seeking gray literature, for example, select Medicine as the preferred subject, select the <bold>"Gray literature" filter</bold> under record type coverage, and sort the databases via the <bold>"Subject × Record type coverage (absolute/descending)"</bold> option. The resulting list reveals that (<reflink idref="bib1" id="ref56">1</reflink>) Bielefeld Academic Search Engine, (<reflink idref="bib2" id="ref57">2</reflink>) Lens, and (<reflink idref="bib3" id="ref58">3</reflink>) Scite cover most medical gray literature among the databases analyzed at Search Smart. In the case of medical preprints, this list would be: (<reflink idref="bib1" id="ref59">1</reflink>) Dimensions, (<reflink idref="bib2" id="ref60">2</reflink>) Scilit, and (<reflink idref="bib3" id="ref61">3</reflink>) OpenAIRE. If medical researchers are interested in databases that specialize most in medical reviews, they may select the "review" filter under record type coverage and the <bold>"Subject × Record type coverage (relative/descending)"</bold> sorting. In this case, the resulting list is: (<reflink idref="bib1" id="ref62">1</reflink>) Cochrane Database of Systematic Reviews, (<reflink idref="bib2" id="ref63">2</reflink>) Epistemonikos, and (<reflink idref="bib3" id="ref64">3</reflink>) SAGE Journals Online. (Note that record type information is currently unavailable for Core, Google Scholar, Mendeley, Naver Academic, and Semantic Scholar. Thus, even though these databases may indeed cover a specific record type, they will still be ranked at the bottom).</p> <hd id="AN0180736605-26">Clinical trials databases</hd> <p>When relevant to the topic, medical systematic reviewers must search clinical trials databases.[[<reflink idref="bib6" id="ref65">6</reflink>]] In the <bold>Clinical trials view</bold>, Search Smart lists the largest clinical trials databases. By default, Search Smart sorts the most comprehensive trials databases at the top, with Cochrane Library—CENTRAL currently being the most comprehensive. If researchers need to employ specific searches, such as systematic keyword or forward or backward citation searches, they can simply select the appropriate preset to further refine the list (see respective use cases).</p> <hd id="AN0180736605-27">Resulting selection of databases for a medical systematic review</hd> <p>Based on the previous selections, Search Smart recommends medical systematic reviewers to start with these principal databases as a minimum (any supplementary databases may be added on top): Lens, Dimensions, CINAHL Plus (via EBSCOhost), and Embase (via Ovid) for <emph>systematic keyword searches</emph>, Lens or the Web of Science Core Collection for <emph>backward citation searches</emph>, Lens or Google Scholar for <emph>forward citation searches</emph>, Bielefeld Academic Search Engine as the database with most medical <emph>gray literature</emph>, and Cochrane Library—CENTRAL with most <emph>clinical trials</emph>. These recommendations reflect guidance on combining different search techniques[<reflink idref="bib6" id="ref66">6</reflink>] and include principal databases that are functionally more suitable and offer superior relative/absolute coverages compared to the four recommended in a popular study of optimal database combinations, for example.[<reflink idref="bib19" id="ref67">19</reflink>]</p> <p>As researchers may have different coverage and functionality requirements, these suggestions can easily be refined by adding or adapting filter settings. More specifically, when systematic reviewers cannot access the most highly recommended databases, they can quickly determine their next best alternatives. The assistance of librarians and other information specialists may help to specify search strategies further.[<reflink idref="bib25" id="ref68">25</reflink>]</p> <hd id="AN0180736605-28">HOW SEARCH SMART WAS DEVELOPED</hd> <p>Search Smart was developed with funding from the Austrian Science Fund to create a user‐friendly tool that allows users to quickly assess which databases are most suitable for their search needs.[<reflink idref="bib26" id="ref69">26</reflink>] Search Smart builds on peer‐reviewed research,[[<reflink idref="bib5" id="ref70">5</reflink>], [<reflink idref="bib27" id="ref71">27</reflink>]] introducing and refining various scientometric methods to collect diverse database information (for an overview, see Supplementary Material, Data S1). These methods permit databases' coverage and functionality to be interrogated without system access so Search Smart can independently verify or supplement information published by database providers or university libraries. This is crucial, as search providers rarely describe search options—or, worse, a surprisingly high proportion of information available is inaccurate. For example, metamorphic testing detected unreported issues with search string interpretation in every fourth database.[<reflink idref="bib5" id="ref72">5</reflink>] Without such tests, these issues would have remained undetected, search providers would keep on advertising this function, and researchers would continue to rely on it. For many of the 583 criteria on which Search Smart collects information, it is also the only information provider.</p> <p>To provide accurate coverage and functionality information, Search Smart relies on five unique data collection methods: Query Hit Counts (QHC),[<reflink idref="bib28" id="ref73">28</reflink>] backward and forward citation scores,[<reflink idref="bib29" id="ref74">29</reflink>] Basket of Keywords (BOK),[<reflink idref="bib27" id="ref75">27</reflink>] metamorphic testing, and interface reviews.[<reflink idref="bib5" id="ref76">5</reflink>] All these methods have the advantage that they can independently collect information without the support of database providers. Using these methods supports Search Smart's goal to collect data from all different types of academic literature databases—that is, aggregators, journal platforms, repositories, search engines, clinical trials databases, bibliographic databases, and digital libraries.</p> <hd id="AN0180736605-29">Limitations</hd> <p>Search Smart's innovative methods enable the unprecedented comparison of coverage and functionality across a wide array of databases. However, its insights have some inherent limitations. First, while estimates of subject coverage are good, and often the only ones available, they are still estimates. Thus, Search Smart's rankings should be seen not as 100% accurate, but rather as informative about the orders of magnitude that a database is likely more or less suitable compared to others (details are discussed here[<reflink idref="bib27" id="ref77">27</reflink>]). Coverage estimates are likely less representative for ASJC subject categories covering diverse sub‐fields such as the social sciences. Further, Search Smart's 26‐category ASJC system does not allow filtering for sub‐disciplines. This is less of an issue for disciplines such as medicine or psychology, which are well represented by the classification system. However, researchers from a social science sub‐discipline such as archaeology or criminology may find it harder to identify suitable databases based on the less granular 26‐category ASJC system. These researchers may resort to their respective super‐category, yet Search Smart is likely more suitable to assess larger, multidisciplinary databases and less suitable for smaller specialized ones. Moreover, while the database coverage of Search Smart is increasing, specialized smaller databases—particularly those with a focus on a sub‐discipline—are not exhaustively represented. Future updates may bring a more granular classification structure, solving some of these issues.</p> <p>Second, while Search Smart displays one of the largest selections of large scholarly databases covering mainly English‐language documents, it does not cover <emph>all</emph> scholarly databases by any means. This focus is necessary in order to achieve comparability through Search Smart's focused data collection methods. While many of the databases on Search Smart also cover some non‐English literature, users specifically seeking non‐English or specific regional information will need to look elsewhere.</p> <p>Third, ideally, we would know the <emph>overlap</emph> of all potentially relevant databases to select a combination with broad joint coverage—that is, the combination that exhibits the least overlap. Unfortunately, Search Smart's data collection methods do not allow this. To validate and supplement its recommendations, users may read multidisciplinary overlap comparisons—however, they are limited to a few databases[[<reflink idref="bib2" id="ref78">2</reflink>], [<reflink idref="bib30" id="ref79">30</reflink>]]: Google Scholar, Scopus, Web of Science Core Collection, Dimensions, Crossref, and Microsoft Academic.</p> <p>Fourth, search systems tend to innovate only after prolonged periods of stasis. Google Scholar, for example, has barely improved its functionality in recent years. While Search Smart regularly updates its data to reflect databases' functionality based on automatic tests and manual reviews, it will occasionally include outdated assessments. Search Smart encourages users to let it know if they spot errors or outdated information, which Search Smart will aim to resolve as soon as possible. To inform users about the timeliness of the data underlying its recommendations, Search Smart reports data retrieval dates for all tests and reviews in the database details and its Excel exports.</p> <p>To achieve the best outcomes, researchers should keep all these considerations in mind. Then, with the help of Search Smart, studies that rely on suboptimal or entirely inadequate databases[<reflink idref="bib32" id="ref80">32</reflink>] could improve their quality.</p> <hd id="AN0180736605-30">CONCLUSION</hd> <p>Overall, we believe Search Smart's recommendations are a significant step toward scholars finding and using the most suitable databases for their research. Search Smart currently covers databases that collectively receive over 1 billion visits per month[<reflink idref="bib2" id="ref81">2</reflink>] and are a cornerstone of researchers' work routines worldwide. While most researchers search with the same familiar handful of databases, Search Smart guides them to discover superior alternatives, making their search routines more productive. Search Smart users can learn to search with confidence among the most important English‐focused academic databases—both innovative newcomers and established stalwarts, whether free or less accessible. Search Smart highlights that all databases are different, and should only be used when they fit the purpose at hand, that is, when search heuristics—such as keyword or citation searching—match their capabilities (see a recent commentary[<reflink idref="bib26" id="ref82">26</reflink>]).</p> <p>Search Smart encourages researchers to demand more from search systems and consider switching to better options. Increased switching behavior, in turn, should fuel healthy competition among search providers, encouraging them to improve functionality essential to researchers in their pursuit of good science. As new search systems appear each year and incumbents periodically change, Search Smart aims to become a resource that researchers can regularly check to see how their go‐to systems compare with innovative newcomers. It is our aspiration that database providers enhance their services based on Search Smart's insights—a symbiotic relationship that is sure to improve the discovery of knowledge.</p> <hd id="AN0180736605-31">AUTHOR CONTRIBUTIONS</hd> <p> <bold>Michael Gusenbauer:</bold> Conceptualization; investigation; funding acquisition; writing – original draft; writing – review and editing; visualization; validation; methodology; software; formal analysis; project administration; resources; supervision; data curation.</p> <hd id="AN0180736605-32">ACKNOWLEDGMENTS</hd> <p>I would like to express my gratitude to the editors and the two anonymous reviewers for their guidance and to Laurent Lang for his continuous support.</p> <hd id="AN0180736605-33">FUNDING INFORMATION</hd> <p>Search Smart (searchsmart.org) was developed with funding from the Austrian Science Fund.</p> <hd id="AN0180736605-34">CONFLICT OF INTEREST STATEMENT</hd> <p>The author declares no conflicts of interest.</p> <hd id="AN0180736605-35">DATA AVAILABILITY STATEMENT</hd> <p>Data sharing is not applicable to this article as no datasets were generated or analyzed during the current study.</p> <p>GRAPH: Data S1. Description of testing and data collection methods.</p> <ref id="AN0180736605-36"> <title> Footnotes </title> <blist> <bibl id="bib1" idref="ref1" type="bt">1</bibl> <bibtext> According to Scopus data: the database hosted about 86 million records in 2022, whereof 44 million had been published since 2009. Similarly, 2.2 million records were published in 2009; by 2022 this had risen to about 4 million.</bibtext> </blist> <blist> <bibl id="bib2" idref="ref3" type="bt">2</bibl> <bibtext> At present, Search Smart analyzes 106 paywalled and non‐paywalled databases (of which six exclusively cover clinical trials). Non‐paywalled systems analyzed at Search Smart are accessed about a billion times per month. Together with paywalled systems' total page visits, the total will likely considerably exceed 1 billion/month. Calculations are based on data from SimilarWeb, a major provider of website analytics. The analysis excludes the paywalled databases of SCOPUS, Web of Science, ProQuest, EBSCOhost, Ovid, and CAS SciFinder‐n, for which no reliable traffic data are available. Data are collected for users navigating a specific sub‐domain. Most of the domains are search‐focused (e.g., scholar.google.com). Yet, some (sub‐)domains also involve other services such as publishing (e.g., sciencedirect.com). Data for Google Scholar's 75 top‐level domains were aggregated. The data show that a few databases receive disproportionally high traffic, while most are rarely used—despite being highly capable.</bibtext> </blist> </ref> <ref id="AN0180736605-37"> <title> REFERENCES </title> <blist> <bibtext> Boeker M, Vach W, Motschall E. Google scholar as replacement for systematic literature searches: good relative recall and precision are not enough. BMC Med Res Methodol. 2013 ; 13 : 131. doi: 10.1186/1471‐2288‐13‐131</bibtext> </blist> <blist> <bibtext> Martín‐Martín A, Thelwall M, Orduna‐Malea E, Delgado López‐Cózar E. Google Scholar, Microsoft Academic, Scopus, Dimensions, Web of Science, and OpenCitations' COCI: a multidisciplinary comparison of coverage via citations. Scientometrics. 2021 ; 126 (1): 871 ‐ 906. doi: 10.1007/s11192‐020‐03690‐4</bibtext> </blist> <blist> <bibl id="bib3" idref="ref4" type="bt">3</bibl> <bibtext> Gusenbauer M. A free online guide to researchers' best search options. Nature. 2023 ; 615 : 586. doi: 10.1038/d41586‐023‐00845‐0</bibtext> </blist> <blist> <bibl id="bib4" idref="ref5" type="bt">4</bibl> <bibtext> Elsevier. What are Scopus Subject Area Categories and ASJC Codes? Updated July 15, 2024. Accessed July 15, 2024. https://service.elsevier.com/app/answers/detail/a_id/12007/supporthub/scopus/</bibtext> </blist> <blist> <bibl id="bib5" idref="ref6" type="bt">5</bibl> <bibtext> Gusenbauer M, Haddaway NR. Which academic search systems are suitable for systematic reviews or meta‐analyses? Evaluating retrieval qualities of Google Scholar, PubMed and 26 other resources. Res Synth Methods. 2020 ; 11 (2): 181 ‐ 217. doi: 10.1002/jrsm.1378</bibtext> </blist> <blist> <bibl id="bib6" idref="ref7" type="bt">6</bibl> <bibtext> Higgins J, Thomas J, Chandler J, et al., eds. Cochrane Handbook for Systematic Reviews of Interventions. Version 6.4; 2024. Accessed July 15, 2024. <ulink href="http://www.training.cochrane.org/handbook">http://www.training.cochrane.org/handbook</ulink></bibtext> </blist> <blist> <bibl id="bib7" idref="ref8" type="bt">7</bibl> <bibtext> Higgins J, Lasserson T, Thomas J, Flemyng E, Churchill R. Methodological Expectations of Cochrane Intervention Reviews (MECIR) [Version August 2023]. Cochrane ; 2023.</bibtext> </blist> <blist> <bibl id="bib8" idref="ref9" type="bt">8</bibl> <bibtext> Briner RB, Denyer D, Rousseau DM. Evidence‐based management: concept cleanup time? Acad Manag Perspect. 2009 ; 23 (4): 19 ‐ 32.</bibtext> </blist> <blist> <bibl id="bib9" idref="ref10" type="bt">9</bibl> <bibtext> Kugley S, Wade A, Thomas J, et al. Searching for studies: guidelines on information retrieval for Campbell Systematic Reviews. Methods Res Pap. 2017 ; 13 : 1 ‐ 73.</bibtext> </blist> <blist> <bibtext> Pullin AS, Frampton G, Livoreil B, Petrokofsky G. Guidelines and Standards for Evidence Synthesis in Environmental Management: Version 5.1. 2022. Accessed July 15, 2024. <ulink href="http://www.environmentalevidence.org/information-for-authors">http://www.environmentalevidence.org/information-for-authors</ulink></bibtext> </blist> <blist> <bibtext> van Eck NJ, Waltman L. Software survey: VOSviewer, a computer program for bibliometric mapping. Scientometrics. 2010 ; 84 (2): 523 ‐ 538. doi: 10.1007/s11192‐009‐0146‐3</bibtext> </blist> <blist> <bibtext> Aria M, Cuccurullo C. bibliometrix: an R‐tool for comprehensive science mapping analysis. J Informet. 2017 ; 11 (4): 959 ‐ 975.</bibtext> </blist> <blist> <bibtext> Booth A. How much searching is enough? Comprehensive versus optimal retrieval for technology assessments. Int J Technol Assess Health Care. 2010 ; 26 (4): 431 ‐ 435. doi: 10.1017/S0266462310000966</bibtext> </blist> <blist> <bibtext> Ogilvie D, Hamilton V, Egan M, Petticrew M. Systematic reviews of health effects of social interventions: 1. Finding the evidence: how far should you go? J Epidemiol Community Health. 2005 ; 59 (9): 804 ‐ 808. doi: 10.1136/jech.2005.034181</bibtext> </blist> <blist> <bibtext> Chen C. CiteSpace II: detecting and visualizing emerging trends and transient patterns in scientific literature. J Am Soc Inf Sci. 2006 ; 57 (3): 359 ‐ 377. doi: 10.1002/asi.20317</bibtext> </blist> <blist> <bibtext> Gusenbauer M. The age of abundant scholarly information and its synthesis—a time when 'just google it' is no longer enough. Res Synth Methods. 2021 ; 12 (6): 684 ‐ 691. doi: 10.1002/jrsm.1520</bibtext> </blist> <blist> <bibtext> Stevinson C, Lawlor DA. Searching multiple databases for systematic reviews: added value or diminishing returns? Complement Ther Med. 2004 ; 12 (4): 228 ‐ 232. doi: 10.1016/j.ctim.2004.09.003</bibtext> </blist> <blist> <bibtext> Lemeshow AR, Blum RE, Berlin JA, Stoto MA, Colditz GA. Searching one or two databases was insufficient for meta‐analysis of observational studies. J Clin Epidemiol. 2005 ; 58 (9): 867 ‐ 873. doi: 10.1016/j.jclinepi.2005.03.004</bibtext> </blist> <blist> <bibtext> Bramer WM, Rethlefsen ML, Kleijnen J, Franco OH. Optimal database combinations for literature searches in systematic reviews: a prospective exploratory study. Syst Rev. 2017 ; 6 (245): 1 ‐ 12. doi: 10.1186/s13643‐017‐0644‐y</bibtext> </blist> <blist> <bibtext> Lefebvre C, Glanville J, Briscoe S, et al. Technical supplement to chapter 4: searching for and selecting studies. In: Higgins J, Thomas J, Chandler J, et al., eds. Cochrane Handbook for Systematic Reviews of Interventions [Version 6.4]. Cochrane ; 2023. Accessed July 15, 2024. <ulink href="http://www.training.cochrane.org/handbook">http://www.training.cochrane.org/handbook</ulink></bibtext> </blist> <blist> <bibtext> Aagaard T, Lund H, Juhl C. Optimizing literature search in systematic reviews—are MEDLINE, EMBASE and CENTRAL enough for identifying effect studies within the area of musculoskeletal disorders? BMC Med Res Methodol. 2016 ; 16 (1): 161. doi: 10.1186/s12874‐016‐0264‐6</bibtext> </blist> <blist> <bibtext> Singh VK, Srichandan SS, Piryani R, Kanaujia A, Bhattacharya S. Google scholar as a pointer to open full‐text sources of research articles: a useful tool for researchers in regions with poor access to scientific literature. Afr J Sci Technol Innov Dev. 2022 ; 15 : 450 ‐ 457. doi: 10.1080/20421338.2022.2124689</bibtext> </blist> <blist> <bibtext> Cantrell A, Booth A, Chambers D. A systematic review case study of urgent and emergency care configuration found citation searching of Web of Science and Google Scholar of similar value. Health Info Libr J. 2022 ; 41 : 166 ‐ 181. doi: 10.1111/hir.12428</bibtext> </blist> <blist> <bibtext> Harzing AW. Publish or Perish. 2007. Accessed July 15, 2024. https://harzing.com/resources/publish-or-perish</bibtext> </blist> <blist> <bibtext> Rethlefsen ML, Farrell AM, Osterhaus Trzasko LC, Brigham TJ. Librarian co‐authors correlated with higher quality reported search strategies in general internal medicine systematic reviews. J Clin Epidemiol. 2015 ; 68 (6): 617 ‐ 626. doi: 10.1016/j.jclinepi.2014.11.025</bibtext> </blist> <blist> <bibtext> Gusenbauer M, Haddaway NR. What every researcher should know about searching—clarified concepts, search advice, and an agenda to improve finding in academia. Res Synth Methods. 2021 ; 12 (2): 136 ‐ 147. doi: 10.1002/jrsm.1457</bibtext> </blist> <blist> <bibtext> Gusenbauer M. Search where you will find most: comparing the disciplinary coverage of 56 bibliographic databases. Scientometrics. 2022 ; 127 : 2683 ‐ 2745. doi: 10.1007/s11192‐022‐04289‐7</bibtext> </blist> <blist> <bibtext> Gusenbauer M. Google Scholar to overshadow them all? Comparing the sizes of 12 academic search engines and bibliographic databases. Scientometrics. 2019 ; 118 (1): 177 ‐ 214. doi: 10.1007/s11192‐018‐2958‐5</bibtext> </blist> <blist> <bibtext> Gusenbauer M. Beyond Google Scholar, Scopus, and Web of Science: an evaluation of the backward and forward citation coverage of 59 databases' citation indices. Res Synth Methods. 2024. doi: 10.1002/jrsm.1729</bibtext> </blist> <blist> <bibtext> Visser M, van Eck NJ, Waltman L. Large‐scale comparison of bibliographic data sources: Scopus, Web of Science, Dimensions, Crossref, and Microsoft Academic. Quant Sci Stud. 2021 ; 2 (1): 20 ‐ 41. doi: 10.1162/qss_a_00112</bibtext> </blist> <blist> <bibtext> Singh VK, Singh P, Karmakar M, Leta J, Mayr P. The journal coverage of Web of Science, Scopus and Dimensions: a comparative analysis. Scientometrics. 2021 ; 126 (6): 5113 ‐ 5142. doi: 10.1007/s11192‐021‐03948‐5</bibtext> </blist> <blist> <bibtext> Ioannidis JPA. The mass production of redundant, misleading, and conflicted systematic reviews and meta‐analyses. Milbank Q. 2016 ; 94 (3): 485 ‐ 514. doi: 10.1111/1468‐0009.12210</bibtext> </blist> <blist> <bibtext> Orduña‐Malea E, Ayllón JM, Martín‐Martín A, Delgado López‐Cózar E. About the size of Google Scholar: playing the numbers. EC3 Work Pap. 2014 ; 18 (23): 931 ‐ 949.</bibtext> </blist> <blist> <bibtext> Segura S, Towey D, Zhou ZQ, Chen TY. Metamorphic testing: testing the untestable. IEEE Softw. 2020 ; 37 (3): 46 ‐ 53. doi: 10.1109/MS.2018.2875968</bibtext> </blist> </ref> <aug> <p>By Michael Gusenbauer</p> <p>Reported by Author</p> </aug> <nolink nlid="nl1" bibid="bib10" firstref="ref11"></nolink> <nolink nlid="nl2" bibid="bib11" firstref="ref12"></nolink> <nolink nlid="nl3" bibid="bib12" firstref="ref13"></nolink> <nolink nlid="nl4" bibid="bib13" firstref="ref16"></nolink> <nolink nlid="nl5" bibid="bib14" firstref="ref17"></nolink> <nolink nlid="nl6" bibid="bib15" firstref="ref20"></nolink> <nolink nlid="nl7" bibid="bib16" firstref="ref23"></nolink> <nolink nlid="nl8" bibid="bib17" firstref="ref26"></nolink> <nolink nlid="nl9" bibid="bib19" firstref="ref27"></nolink> <nolink nlid="nl10" bibid="bib21" firstref="ref28"></nolink> <nolink nlid="nl11" bibid="bib22" firstref="ref42"></nolink> <nolink nlid="nl12" bibid="bib23" firstref="ref43"></nolink> <nolink nlid="nl13" bibid="bib24" firstref="ref55"></nolink> <nolink nlid="nl14" bibid="bib25" firstref="ref68"></nolink> <nolink nlid="nl15" bibid="bib26" firstref="ref69"></nolink> <nolink nlid="nl16" bibid="bib27" firstref="ref71"></nolink> <nolink nlid="nl17" bibid="bib28" firstref="ref73"></nolink> <nolink nlid="nl18" bibid="bib29" firstref="ref74"></nolink> <nolink nlid="nl19" bibid="bib30" firstref="ref79"></nolink> <nolink nlid="nl20" bibid="bib32" firstref="ref80"></nolink> |
|---|---|
| Header | DbId: eric DbLabel: ERIC An: EJ1447363 AccessLevel: 3 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Searchsmart.org: Guiding Researchers to the Best Databases and Search Systems for Systematic Reviews and Beyond – Name: Language Label: Language Group: Lang Data: English – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Michael+Gusenbauer%22">Michael Gusenbauer</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0001-7768-2351">0000-0001-7768-2351</externalLink>) – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="SO" term="%22Research+Synthesis+Methods%22"><i>Research Synthesis Methods</i></searchLink>. 2024 15(6):1200-1213. – Name: Avail Label: Availability Group: Avail Data: Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us – Name: PeerReviewed Label: Peer Reviewed Group: SrcInfo Data: Y – Name: Pages Label: Page Count Group: Src Data: 14 – Name: DatePubCY Label: Publication Date Group: Date Data: 2024 – Name: Audience Label: Intended Audience Group: Audnce Data: Researchers – Name: TypeDocument Label: Document Type Group: TypDoc Data: Journal Articles<br />Reports - Descriptive – Name: Subject Label: Descriptors Group: Su Data: <searchLink fieldCode="DE" term="%22Researchers%22">Researchers</searchLink><br /><searchLink fieldCode="DE" term="%22Research+Methodology%22">Research Methodology</searchLink><br /><searchLink fieldCode="DE" term="%22Research+Skills%22">Research Skills</searchLink><br /><searchLink fieldCode="DE" term="%22Research+Tools%22">Research Tools</searchLink><br /><searchLink fieldCode="DE" term="%22Databases%22">Databases</searchLink><br /><searchLink fieldCode="DE" term="%22Information+Retrieval%22">Information Retrieval</searchLink><br /><searchLink fieldCode="DE" term="%22Search+Strategies%22">Search Strategies</searchLink><br /><searchLink fieldCode="DE" term="%22Open+Educational+Resources%22">Open Educational Resources</searchLink><br /><searchLink fieldCode="DE" term="%22Open+Source+Technology%22">Open Source Technology</searchLink><br /><searchLink fieldCode="DE" term="%22Search+Engines%22">Search Engines</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+Software+Reviews%22">Computer Software Reviews</searchLink> – Name: DOI Label: DOI Group: ID Data: 10.1002/jrsm.1746 – Name: ISSN Label: ISSN Group: ISSN Data: 1759-2879<br />1759-2887 – Name: Abstract Label: Abstract Group: Ab Data: When searching for scholarly documents, researchers often stick with the same familiar handful of databases. Yet, just beyond these limited horizons lie dozens of alternatives with which they could search more effectively, whether for quick lookups or thorough searches in systematic reviews or meta-analyses. Searchsmart.org is a free website that guides researchers to particularly suitable search options for their particular disciplines, offering a wide array of resources, including search engines, aggregators, journal platforms, repositories, clinical trials databases, bibliographic databases, and digital libraries. Search Smart currently evaluates the coverage and functionality of more than a hundred leading scholarly databases, including most major multidisciplinary databases and many that are discipline-specific. Search Smart's primary use cases involve database-selection decisions as part of systematic reviews, meta-analyses, or bibliometric analyses. Researchers can use up to 583 criteria to filter and sort recommendations of databases and the interfaces through which they can be accessed for user-friendliness, search rigor, or relevance. With specific pre-defined filter settings, researchers can quickly identify particularly suitable databases for Boolean keyword searching and forward or backward citation searching. Overall, Search Smart's recommendations help researchers to discover knowledge more effectively and efficiently by selecting the more suitable databases for their tasks. – Name: AbstractInfo Label: Abstractor Group: Ab Data: As Provided – Name: DateEntry Label: Entry Date Group: Date Data: 2024 – Name: AN Label: Accession Number Group: ID Data: EJ1447363 |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1447363 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1002/jrsm.1746 Languages: – Text: English PhysicalDescription: Pagination: PageCount: 14 StartPage: 1200 Subjects: – SubjectFull: Researchers Type: general – SubjectFull: Research Methodology Type: general – SubjectFull: Research Skills Type: general – SubjectFull: Research Tools Type: general – SubjectFull: Databases Type: general – SubjectFull: Information Retrieval Type: general – SubjectFull: Search Strategies Type: general – SubjectFull: Open Educational Resources Type: general – SubjectFull: Open Source Technology Type: general – SubjectFull: Search Engines Type: general – SubjectFull: Computer Software Reviews Type: general Titles: – TitleFull: Searchsmart.org: Guiding Researchers to the Best Databases and Search Systems for Systematic Reviews and Beyond Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Michael Gusenbauer IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 11 Type: published Y: 2024 Identifiers: – Type: issn-print Value: 1759-2879 – Type: issn-electronic Value: 1759-2887 Numbering: – Type: volume Value: 15 – Type: issue Value: 6 Titles: – TitleFull: Research Synthesis Methods Type: main |
| ResultId | 1 |