Knowledge distillation and dataset distillation of large language models: emerging trends, challenges, and future directions.

Saved in:
Bibliographic Details
Title: Knowledge distillation and dataset distillation of large language models: emerging trends, challenges, and future directions.
Authors: Fang, Luyang1, Yu, Xiaowei2, Cai, Jiazhang1, Chen, Yongkai3, Wu, Shushan1, Liu, Zhengliang4, Yang, Zhenyuan4, Lu, Haoran1, Gong, Xilin1, Liu, Yufang1, Ma, Terry5, Ruan, Wei4, Abbasi, Ali6, Zhang, Jing2, Wang, Tao1, Latif, Ehsan7, Liu, Wei8, Zhang, Wei9, Kolouri, Soheil6, Zhai, Xiaoming7
Source: Artificial Intelligence Review; Jan2026, Vol. 59 Issue 1, p1-62, 62p
Database: Applied Science & Technology Source
Description
ISSN:02692821
DOI:10.1007/s10462-025-11423-3