GPT-4.1 and Llama 3.3 70 fail to detect clinically relevant errors in radiology reports in zero-shot evaluation.

Saved in:
Bibliographic Details
Title: GPT-4.1 and Llama 3.3 70 fail to detect clinically relevant errors in radiology reports in zero-shot evaluation.
Authors: Akinci D'Antonoli T; Division of Diagnostic and Interventional Neuroradiology, Department of Radiology, University Hospital Basel, Basel, Switzerland. tugba.akincidantonoli@unibas.ch.; Department of Pediatric Radiology, University Children's Hospital Basel, Basel, Switzerland. tugba.akincidantonoli@unibas.ch., Adams LC; Institute of Diagnostic and Interventional Radiology, TUM University Hospital, TUM School of Medicine and Health, Technical University of Munich, Munich, Germany., Lübberstedt J; Institute of Diagnostic and Interventional Radiology, TUM University Hospital, TUM School of Medicine and Health, Technical University of Munich, Munich, Germany., Graf MM; Institute of Diagnostic and Interventional Radiology, TUM University Hospital, TUM School of Medicine and Health, Technical University of Munich, Munich, Germany., Mertens CJ; Institute of Diagnostic and Interventional Radiology, TUM University Hospital, TUM School of Medicine and Health, Technical University of Munich, Munich, Germany., Busch F; Institute of Diagnostic and Interventional Radiology, TUM University Hospital, TUM School of Medicine and Health, Technical University of Munich, Munich, Germany., Ziegelmayer S; Institute of Diagnostic and Interventional Radiology, TUM University Hospital, TUM School of Medicine and Health, Technical University of Munich, Munich, Germany., Makowski MR; Institute of Diagnostic and Interventional Radiology, TUM University Hospital, TUM School of Medicine and Health, Technical University of Munich, Munich, Germany., Bressem K; Institute of Diagnostic and Interventional Radiology, TUM University Hospital, TUM School of Medicine and Health, Technical University of Munich, Munich, Germany.; Department of Cardiovascular Radiology and Nuclear Medicine, German Heart Center Munich, TUM University Hospital, Munich, Germany., Luiken I; Institute of Diagnostic and Interventional Radiology, TUM University Hospital, TUM School of Medicine and Health, Technical University of Munich, Munich, Germany.
Source: European radiology [Eur Radiol] 2026 Jun 19. Date of Electronic Publication: 2026 Jun 19.
Publication Type: Journal Article
Journal Info: Publisher: Springer International Country of Publication: Germany NLM ID: 9114774 Publication Model: Print-Electronic Cited Medium: Internet ISSN: 1432-1084 (Electronic) Linking ISSN: 09387994 NLM ISO Abbreviation: Eur Radiol Subsets: MEDLINE
Database: MEDLINE Ultimate
Description
ISSN:1432-1084
DOI:10.1007/s00330-026-12697-z