'It Has No Meaning to Me.' How Do Researchers Understand the Effectiveness of Literature Searches? A Qualitative Analysis and Preliminary Typology of Understandings

Saved in:
Bibliographic Details
Title: 'It Has No Meaning to Me.' How Do Researchers Understand the Effectiveness of Literature Searches? A Qualitative Analysis and Preliminary Typology of Understandings
Language: English
Authors: Cooper, Chris (ORCID 0000-0003-0864-5607), Garside, Ruth (ORCID 0000-0003-1649-4773), Varley-Campbell, Joanna, Talens-Bou, Juan, Booth, Andrew (ORCID 0000-0003-4808-3880), Britten, Nicky (ORCID 0000-0002-7533-414X)
Source: Research Synthesis Methods. Sep 2020 11(5):627-640.
Availability: Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us
Peer Reviewed: Y
Page Count: 14
Publication Date: 2020
Document Type: Journal Articles
Reports - Research
Descriptors: Literature Reviews, Researchers, Classification, Definitions, Information Seeking
DOI: 10.1002/jrsm.1426
ISSN: 1759-2879
Abstract: This study aimed to address the question: what does "effectiveness" mean to researchers in the context of literature searching for systematic reviews? We conducted a thematic analysis of responses to an e-mail survey. Eighty-nine study authors, whose studies met inclusion in a recent review (2018), were contacted via e-mail and asked three questions; one directly asking the question: in literature searching, what does effective (or effectiveness in) literature searching mean to you? Thirty-eight (46%) responses were received from diverse professional groups, including: literature searchers, systematic reviewers, clinicians and researchers. A shared understanding of what effectiveness means was not identified. Instead, five themes were developed from data: (1) effectiveness is described as a metric; (2) effectiveness is a balance between metrics; (3) effectiveness can be categorized by search purpose; (4) effectiveness is an outcome; and, (5) effectiveness is an experimental concept. We propose that these themes constitute a preliminary typology of understandings. No single definition of effectiveness was identified. The proposed typology suggests that different researchers have differing understandings of effectiveness. This could lead to uncertainty as to the aim and the purpose of literature searches and confusion about the outcomes. The typology offers a potential route for further exploration.
Abstractor: As Provided
Entry Date: 2020
Accession Number: EJ1266496
Database: ERIC
Full text is not displayed to guests.
Description
Abstract:This study aimed to address the question: what does "effectiveness" mean to researchers in the context of literature searching for systematic reviews? We conducted a thematic analysis of responses to an e-mail survey. Eighty-nine study authors, whose studies met inclusion in a recent review (2018), were contacted via e-mail and asked three questions; one directly asking the question: in literature searching, what does effective (or effectiveness in) literature searching mean to you? Thirty-eight (46%) responses were received from diverse professional groups, including: literature searchers, systematic reviewers, clinicians and researchers. A shared understanding of what effectiveness means was not identified. Instead, five themes were developed from data: (1) effectiveness is described as a metric; (2) effectiveness is a balance between metrics; (3) effectiveness can be categorized by search purpose; (4) effectiveness is an outcome; and, (5) effectiveness is an experimental concept. We propose that these themes constitute a preliminary typology of understandings. No single definition of effectiveness was identified. The proposed typology suggests that different researchers have differing understandings of effectiveness. This could lead to uncertainty as to the aim and the purpose of literature searches and confusion about the outcomes. The typology offers a potential route for further exploration.
ISSN:1759-2879
DOI:10.1002/jrsm.1426