View in EDS PDF Full Text

Knowledge distillation and dataset distillation of large language models: emerging trends, challenges, and future directions.

Saved in:
Bibliographic Details
Title: Knowledge distillation and dataset distillation of large language models: emerging trends, challenges, and future directions.
Authors: Fang, Luyang1, Yu, Xiaowei2, Cai, Jiazhang1, Chen, Yongkai3, Wu, Shushan1, Liu, Zhengliang4, Yang, Zhenyuan4, Lu, Haoran1, Gong, Xilin1, Liu, Yufang1, Ma, Terry5, Ruan, Wei4, Abbasi, Ali6, Zhang, Jing2, Wang, Tao1, Latif, Ehsan7, Liu, Wei8, Zhang, Wei9, Kolouri, Soheil6, Zhai, Xiaoming7
Source: Artificial Intelligence Review; Jan2026, Vol. 59 Issue 1, p1-62, 62p
Database: Applied Science & Technology Source
FullText Links:
  – Type: pdflink
Text:
  Availability: 0
Header DbId: aci
DbLabel: Applied Science & Technology Source
An: 191169762
AccessLevel: 2
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Knowledge distillation and dataset distillation of large language models: emerging trends, challenges, and future directions.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AU" term="%22Fang%2C+Luyang%22">Fang, Luyang</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AU" term="%22Yu%2C+Xiaowei%22">Yu, Xiaowei</searchLink><relatesTo>2</relatesTo><br /><searchLink fieldCode="AU" term="%22Cai%2C+Jiazhang%22">Cai, Jiazhang</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AU" term="%22Chen%2C+Yongkai%22">Chen, Yongkai</searchLink><relatesTo>3</relatesTo><br /><searchLink fieldCode="AU" term="%22Wu%2C+Shushan%22">Wu, Shushan</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AU" term="%22Liu%2C+Zhengliang%22">Liu, Zhengliang</searchLink><relatesTo>4</relatesTo><br /><searchLink fieldCode="AU" term="%22Yang%2C+Zhenyuan%22">Yang, Zhenyuan</searchLink><relatesTo>4</relatesTo><br /><searchLink fieldCode="AU" term="%22Lu%2C+Haoran%22">Lu, Haoran</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AU" term="%22Gong%2C+Xilin%22">Gong, Xilin</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AU" term="%22Liu%2C+Yufang%22">Liu, Yufang</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AU" term="%22Ma%2C+Terry%22">Ma, Terry</searchLink><relatesTo>5</relatesTo><br /><searchLink fieldCode="AU" term="%22Ruan%2C+Wei%22">Ruan, Wei</searchLink><relatesTo>4</relatesTo><br /><searchLink fieldCode="AU" term="%22Abbasi%2C+Ali%22">Abbasi, Ali</searchLink><relatesTo>6</relatesTo><br /><searchLink fieldCode="AU" term="%22Zhang%2C+Jing%22">Zhang, Jing</searchLink><relatesTo>2</relatesTo><br /><searchLink fieldCode="AU" term="%22Wang%2C+Tao%22">Wang, Tao</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AU" term="%22Latif%2C+Ehsan%22">Latif, Ehsan</searchLink><relatesTo>7</relatesTo><br /><searchLink fieldCode="AU" term="%22Liu%2C+Wei%22">Liu, Wei</searchLink><relatesTo>8</relatesTo><br /><searchLink fieldCode="AU" term="%22Zhang%2C+Wei%22">Zhang, Wei</searchLink><relatesTo>9</relatesTo><br /><searchLink fieldCode="AU" term="%22Kolouri%2C+Soheil%22">Kolouri, Soheil</searchLink><relatesTo>6</relatesTo><br /><searchLink fieldCode="AU" term="%22Zhai%2C+Xiaoming%22">Zhai, Xiaoming</searchLink><relatesTo>7</relatesTo>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Artificial+Intelligence+Review%22">Artificial Intelligence Review</searchLink>; Jan2026, Vol. 59 Issue 1, p1-62, 62p
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=aci&AN=191169762
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1007/s10462-025-11423-3
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 62
        StartPage: 1
    Titles:
      – TitleFull: Knowledge distillation and dataset distillation of large language models: emerging trends, challenges, and future directions.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Fang, Luyang
      – PersonEntity:
          Name:
            NameFull: Yu, Xiaowei
      – PersonEntity:
          Name:
            NameFull: Cai, Jiazhang
      – PersonEntity:
          Name:
            NameFull: Chen, Yongkai
      – PersonEntity:
          Name:
            NameFull: Wu, Shushan
      – PersonEntity:
          Name:
            NameFull: Liu, Zhengliang
      – PersonEntity:
          Name:
            NameFull: Yang, Zhenyuan
      – PersonEntity:
          Name:
            NameFull: Lu, Haoran
      – PersonEntity:
          Name:
            NameFull: Gong, Xilin
      – PersonEntity:
          Name:
            NameFull: Liu, Yufang
      – PersonEntity:
          Name:
            NameFull: Ma, Terry
      – PersonEntity:
          Name:
            NameFull: Ruan, Wei
      – PersonEntity:
          Name:
            NameFull: Abbasi, Ali
      – PersonEntity:
          Name:
            NameFull: Zhang, Jing
      – PersonEntity:
          Name:
            NameFull: Wang, Tao
      – PersonEntity:
          Name:
            NameFull: Latif, Ehsan
      – PersonEntity:
          Name:
            NameFull: Liu, Wei
      – PersonEntity:
          Name:
            NameFull: Zhang, Wei
      – PersonEntity:
          Name:
            NameFull: Kolouri, Soheil
      – PersonEntity:
          Name:
            NameFull: Zhai, Xiaoming
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Text: Jan2026
              Type: published
              Y: 2026
          Identifiers:
            – Type: issn-print
              Value: 02692821
          Numbering:
            – Type: volume
              Value: 59
            – Type: issue
              Value: 1
          Titles:
            – TitleFull: Artificial Intelligence Review
              Type: main
ResultId 1