View in EDS

From promise to practice: challenges and pitfalls in the evaluation of large language models for data extraction in evidence synthesis.

Saved in:
Bibliographic Details
Title: From promise to practice: challenges and pitfalls in the evaluation of large language models for data extraction in evidence synthesis.
Authors: Gartlehner G; RTI International, Research Triangle Park, North Carolina, USA gerald.gartlehner@donau-uni.ac.at.; Department for Evidence-based Medicine and Evaluation, University for Continuing Education Krems, Krems, Austria., Kahwati L; RTI International, Research Triangle Park, North Carolina, USA., Nussbaumer-Streit B; Department for Evidence-based Medicine and Evaluation, University for Continuing Education Krems, Krems, Austria., Crotty K; RTI International, Research Triangle Park, North Carolina, USA., Hilscher R; RTI International, Research Triangle Park, North Carolina, USA., Kugley S; RTI International, Research Triangle Park, North Carolina, USA., Viswanathan M; RTI International, Research Triangle Park, North Carolina, USA., Thomas I; RTI International, Research Triangle Park, North Carolina, USA., Konet A; RTI International, Research Triangle Park, North Carolina, USA., Booth G; RTI International, Research Triangle Park, North Carolina, USA., Chew R; RTI International, Research Triangle Park, North Carolina, USA.
Source: BMJ evidence-based medicine [BMJ Evid Based Med] 2025 Dec 01; Vol. 30 (6), pp. 385-389. Date of Electronic Publication: 2025 Dec 01.
Publication Type: Journal Article
Journal Info: Publisher: BMJ Publishing Group Country of Publication: England NLM ID: 101719009 Publication Model: Electronic Cited Medium: Internet ISSN: 2515-4478 (Electronic) Linking ISSN: 2515446X NLM ISO Abbreviation: BMJ Evid Based Med Subsets: MEDLINE; In Process
Database: MEDLINE Ultimate
FullText Text:
  Availability: 0
Header DbId: mdl
DbLabel: MEDLINE Ultimate
An: 39797673
AccessLevel: 2
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: From promise to practice: challenges and pitfalls in the evaluation of large language models for data extraction in evidence synthesis.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AU" term="%22Gartlehner+G%22">Gartlehner G</searchLink>; RTI International, Research Triangle Park, North Carolina, USA gerald.gartlehner@donau-uni.ac.at.; Department for Evidence-based Medicine and Evaluation, University for Continuing Education Krems, Krems, Austria.<br /><searchLink fieldCode="AU" term="%22Kahwati+L%22">Kahwati L</searchLink>; RTI International, Research Triangle Park, North Carolina, USA.<br /><searchLink fieldCode="AU" term="%22Nussbaumer-Streit+B%22">Nussbaumer-Streit B</searchLink>; Department for Evidence-based Medicine and Evaluation, University for Continuing Education Krems, Krems, Austria.<br /><searchLink fieldCode="AU" term="%22Crotty+K%22">Crotty K</searchLink>; RTI International, Research Triangle Park, North Carolina, USA.<br /><searchLink fieldCode="AU" term="%22Hilscher+R%22">Hilscher R</searchLink>; RTI International, Research Triangle Park, North Carolina, USA.<br /><searchLink fieldCode="AU" term="%22Kugley+S%22">Kugley S</searchLink>; RTI International, Research Triangle Park, North Carolina, USA.<br /><searchLink fieldCode="AU" term="%22Viswanathan+M%22">Viswanathan M</searchLink>; RTI International, Research Triangle Park, North Carolina, USA.<br /><searchLink fieldCode="AU" term="%22Thomas+I%22">Thomas I</searchLink>; RTI International, Research Triangle Park, North Carolina, USA.<br /><searchLink fieldCode="AU" term="%22Konet+A%22">Konet A</searchLink>; RTI International, Research Triangle Park, North Carolina, USA.<br /><searchLink fieldCode="AU" term="%22Booth+G%22">Booth G</searchLink>; RTI International, Research Triangle Park, North Carolina, USA.<br /><searchLink fieldCode="AU" term="%22Chew+R%22">Chew R</searchLink>; RTI International, Research Triangle Park, North Carolina, USA.
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22101719009%22">BMJ evidence-based medicine</searchLink> [BMJ Evid Based Med] 2025 Dec 01; Vol. 30 (6), pp. 385-389. <i>Date of Electronic Publication: </i>2025 Dec 01.
– Name: TypePub
  Label: Publication Type
  Group: TypPub
  Data: Journal Article
– Name: TitleSource
  Label: Journal Info
  Group: Src
  Data: <i>Publisher: </i><searchLink fieldCode="PB" term="%22BMJ+Publishing+Group%22">BMJ Publishing Group </searchLink><i>Country of Publication: </i>England <i>NLM ID: </i>101719009 <i>Publication Model: </i>Electronic <i>Cited Medium: </i>Internet <i>ISSN: </i>2515-4478 (Electronic) <i>Linking ISSN: </i><searchLink fieldCode="IS" term="%222515446X%22">2515446X </searchLink><i>NLM ISO Abbreviation: </i>BMJ Evid Based Med <i>Subsets: </i>MEDLINE; In Process
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=mdl&AN=39797673
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1136/bmjebm-2024-113199
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        StartPage: 385
    Titles:
      – TitleFull: From promise to practice: challenges and pitfalls in the evaluation of large language models for data extraction in evidence synthesis.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Gartlehner G
      – PersonEntity:
          Name:
            NameFull: Kahwati L
      – PersonEntity:
          Name:
            NameFull: Nussbaumer-Streit B
      – PersonEntity:
          Name:
            NameFull: Crotty K
      – PersonEntity:
          Name:
            NameFull: Hilscher R
      – PersonEntity:
          Name:
            NameFull: Kugley S
      – PersonEntity:
          Name:
            NameFull: Viswanathan M
      – PersonEntity:
          Name:
            NameFull: Thomas I
      – PersonEntity:
          Name:
            NameFull: Konet A
      – PersonEntity:
          Name:
            NameFull: Booth G
      – PersonEntity:
          Name:
            NameFull: Chew R
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 12
              Text: 2025 Dec 01
              Type: published
              Y: 2025
          Identifiers:
            – Type: issn-electronic
              Value: 2515-4478
          Numbering:
            – Type: volume
              Value: 30
            – Type: issue
              Value: 6
          Titles:
            – TitleFull: BMJ evidence-based medicine
              Type: main
ResultId 1