MicroBERT: Distilling MoE-Based Knowledge from BERT into a Lighter Model.

Saved in:
Bibliographic Details
Title: MicroBERT: Distilling MoE-Based Knowledge from BERT into a Lighter Model.
Authors: Zheng, Dashun1, p2212871@mpu.edu.mo, Li, Jiaxuan1, Yang, Yunchu1, Wang, Yapeng1, Pang, Patrick Cheong-Iao1, mail@patrickpang.net
Source: Applied Sciences (2076-3417); Jul2024, Vol. 14 Issue 14, p6171, 14p
Database: Applied Science & Technology Source
Full text is not displayed to guests.
Description
ISSN:20763417
DOI:10.3390/app14146171