Is One Study as Good as Three? College Graduates Seem to Think So, Even if They Took Statistics Classes

Saved in:
Bibliographic Details
Title: Is One Study as Good as Three? College Graduates Seem to Think So, Even if They Took Statistics Classes
Language: English
Authors: Thompson, W. Burt (ORCID 0000-0001-6078-8846), Garry, Amanda, Taylor, John, Radell, Milen L.
Source: Psychology Learning and Teaching. Jul 2020 19(2):143-160.
Availability: SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Peer Reviewed: Y
Page Count: 18
Publication Date: 2020
Document Type: Journal Articles
Reports - Research
Tests/Questionnaires
Education Level: Higher Education
Postsecondary Education
Descriptors: College Graduates, Statistics, Misconceptions, Probability, Data Interpretation, Research Utilization, Inferences
DOI: 10.1177/1475725719877590
ISSN: 1475-7257
Abstract: When people interpret the outcome of a research study, do they consider other relevant information such as prior research? In the current study, 251 college graduates read a single brief fictitious news article. The article summarized the findings of a study that found positive results for a new drug. Three versions of the article varied the amount and type of previous research: (a) two prior studies that found the drug did not work, (b) no prior studies of the drug, or (c) two prior studies that found the drug had a positive effect. After reading the article, participants estimated the probability the drug is effective. Averagepro estimates were similar for the three articles, even for participants who reported more statistics experience. Overall, just 4% of participants appeared to use prior research to make probability estimates--most seemed to focus on the latest study, while ignoring or discounting prior studies. Implications for statistics education and reporting are discussed.
Abstractor: As Provided
Entry Date: 2020
Accession Number: EJ1254416
Database: ERIC
Description
Abstract:When people interpret the outcome of a research study, do they consider other relevant information such as prior research? In the current study, 251 college graduates read a single brief fictitious news article. The article summarized the findings of a study that found positive results for a new drug. Three versions of the article varied the amount and type of previous research: (a) two prior studies that found the drug did not work, (b) no prior studies of the drug, or (c) two prior studies that found the drug had a positive effect. After reading the article, participants estimated the probability the drug is effective. Averagepro estimates were similar for the three articles, even for participants who reported more statistics experience. Overall, just 4% of participants appeared to use prior research to make probability estimates--most seemed to focus on the latest study, while ignoring or discounting prior studies. Implications for statistics education and reporting are discussed.
ISSN:1475-7257
DOI:10.1177/1475725719877590