Critically Reading Science-Related Texts Produced by ChatGPT

Saved in:
Bibliographic Details
Title: Critically Reading Science-Related Texts Produced by ChatGPT
Language: English
Authors: Pablo Antonio Archila (ORCID 0000-0003-0225-4701), Brigithe Tatiana Ortiz, Anne-Marie Truscott de Mejía, Jorge Molina
Source: Science & Education. 2025 34(6):4627-4662.
Availability: Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
Peer Reviewed: Y
Page Count: 36
Publication Date: 2025
Document Type: Journal Articles
Reports - Research
Education Level: Higher Education
Postsecondary Education
Descriptors: Critical Reading, Scientific and Technical Information, Artificial Intelligence, Science Materials, Accuracy, Persuasive Discourse, Concept Mapping, Undergraduate Students, Introductory Courses, College Science, Scientific Literacy, Digital Literacy
DOI: 10.1007/s11191-025-00639-y
ISSN: 0926-7220
1573-1901
Abstract: Since its launch in November 2022, Chat Generative Pretrained Transformer (ChatGPT) has rapidly become an attractive artificial intelligence (AI) tool for students around the globe. This chatbot is becoming more and more popular because of its ability to generate science-related texts practically indistinguishable from human-produced texts. While a major shortcoming of texts generated by ChatGPT is that these can contain false and/or inaccurate scientific information, very little is known about how to promote critical reading of science-related texts produced by this AI tool. We aimed at showing that the construction of scientific argument maps--visual representation of scientific argument structure--can be used to foster critical reading of these texts. The data were drawn from the argument diagrams constructed by 44 undergraduates (27 females and 17 males, 17-23 years old) during an introductory science course and audio recordings of student discussions as part of the process of co-creation of argument maps. The findings suggest that argument mapping effectively supported participants' critical reading of ChatGPT-generated texts while engaged them in the construction of arguments, the anticipation of counterarguments, and the production of rebuttals. This study contributes to the literature on scientific AI literacy--the combination of scientific literacy with AI literacy --by providing insights into how to engage students in the critical reading of science-related texts produced by generative AI technology.
Abstractor: As Provided
Entry Date: 2026
Accession Number: EJ1499327
Database: ERIC
Description
Abstract:Since its launch in November 2022, Chat Generative Pretrained Transformer (ChatGPT) has rapidly become an attractive artificial intelligence (AI) tool for students around the globe. This chatbot is becoming more and more popular because of its ability to generate science-related texts practically indistinguishable from human-produced texts. While a major shortcoming of texts generated by ChatGPT is that these can contain false and/or inaccurate scientific information, very little is known about how to promote critical reading of science-related texts produced by this AI tool. We aimed at showing that the construction of scientific argument maps--visual representation of scientific argument structure--can be used to foster critical reading of these texts. The data were drawn from the argument diagrams constructed by 44 undergraduates (27 females and 17 males, 17-23 years old) during an introductory science course and audio recordings of student discussions as part of the process of co-creation of argument maps. The findings suggest that argument mapping effectively supported participants' critical reading of ChatGPT-generated texts while engaged them in the construction of arguments, the anticipation of counterarguments, and the production of rebuttals. This study contributes to the literature on scientific AI literacy--the combination of scientific literacy with AI literacy --by providing insights into how to engage students in the critical reading of science-related texts produced by generative AI technology.
ISSN:0926-7220
1573-1901
DOI:10.1007/s11191-025-00639-y