FedKSS: One-shot federated learning with kernel space statistics.
Saved in:
| Title: | FedKSS: One-shot federated learning with kernel space statistics. |
|---|---|
| Authors: | Ding, Jiaman1,2 (AUTHOR) jiamanding@kust.edu.cn, Jiang, Linglin1,2 (AUTHOR) jiangll2024@126.com, Jia, Lianyin1,2 (AUTHOR) lianyinjia@kust.edu.cn, Fu, Xiaodong1,2 (AUTHOR) xdfu@kust.edu.cn, Jiang, Ying1,2 (AUTHOR) jy_910@163.com |
| Source: | Information Fusion. Nov2026, Vol. 135, pN.PAG-N.PAG. 1p. |
| Subjects: | Federated learning, Feature selection, Machine learning, Heterogeneity |
| Abstract: | • Proposes FedKSS, a training-free one-shot FL method via kernel statistics, cutting compute costs. • Introduces adaptive optimal layer selection to pick discriminative features, boosting performance. • Adds kernel feature alignment for personalization, needing one extra round for efficient FL. • Slashes comms and boosts privacy by uploading statistics, not full model parameters. • Beats SOTA by 15.71% global acc and 5.52% personalized acc under high heterogeneity. One-shot Federated Learning (FL) has emerged as a promising learning paradigm, capable of training a global model through a single communication round. However, existing one-shot FL methods still face the problem of high computational cost on the server or clients and struggle to handle non-IID (Independent and Identically Distributed) data stably and effectively. To address these issues, we propose FedKSS, a novel federated learning method based on kernel space statistics. Specifically, FedKSS maps features into a high-dimensional kernel space using Random Fourier Features, calculates local statistics on each client, and uploads these statistics to the server. The server then aggregates these local statistics to obtain global statistics, and based on this, computes the global prototype and covariance, thereby directly constructing a kernelized training-free classifier. To further enhance the discriminative power of the classifier, we introduce an optimal layer selection mechanism that uses features from different layers of the pre-trained model to construct the classifier and evaluate its performance, thereby determining the optimal feature layer for the current data distribution. In addition, we extend this method to personalization scenario, where clients only need one extra round of communication to download the global prototype from the server and achieve personalized learning through feature alignment. Experiments under high heterogeneity show that, compared with state-of-the-art methods, FedKSS improves global accuracy by 15.71% and local personalization accuracy by 5.52% across multiple benchmark datasets. These results confirm the effectiveness of FedKSS in data-heterogeneity settings. [ABSTRACT FROM AUTHOR] |
| Copyright of Information Fusion is the property of Elsevier B.V. and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Engineering Source |
| FullText | Text: Availability: 0 |
|---|---|
| Header | DbId: egs DbLabel: Engineering Source An: 194552886 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: FedKSS: One-shot federated learning with kernel space statistics. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Ding%2C+Jiaman%22">Ding, Jiaman</searchLink><relatesTo>1,2</relatesTo> (AUTHOR)<i> jiamanding@kust.edu.cn</i><br /><searchLink fieldCode="AR" term="%22Jiang%2C+Linglin%22">Jiang, Linglin</searchLink><relatesTo>1,2</relatesTo> (AUTHOR)<i> jiangll2024@126.com</i><br /><searchLink fieldCode="AR" term="%22Jia%2C+Lianyin%22">Jia, Lianyin</searchLink><relatesTo>1,2</relatesTo> (AUTHOR)<i> lianyinjia@kust.edu.cn</i><br /><searchLink fieldCode="AR" term="%22Fu%2C+Xiaodong%22">Fu, Xiaodong</searchLink><relatesTo>1,2</relatesTo> (AUTHOR)<i> xdfu@kust.edu.cn</i><br /><searchLink fieldCode="AR" term="%22Jiang%2C+Ying%22">Jiang, Ying</searchLink><relatesTo>1,2</relatesTo> (AUTHOR)<i> jy_910@163.com</i> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22Information+Fusion%22">Information Fusion</searchLink>. Nov2026, Vol. 135, pN.PAG-N.PAG. 1p. – Name: Subject Label: Subjects Group: Su Data: <searchLink fieldCode="DE" term="%22Federated+learning%22">Federated learning</searchLink><br /><searchLink fieldCode="DE" term="%22Feature+selection%22">Feature selection</searchLink><br /><searchLink fieldCode="DE" term="%22Machine+learning%22">Machine learning</searchLink><br /><searchLink fieldCode="DE" term="%22Heterogeneity%22">Heterogeneity</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: • Proposes FedKSS, a training-free one-shot FL method via kernel statistics, cutting compute costs. • Introduces adaptive optimal layer selection to pick discriminative features, boosting performance. • Adds kernel feature alignment for personalization, needing one extra round for efficient FL. • Slashes comms and boosts privacy by uploading statistics, not full model parameters. • Beats SOTA by 15.71% global acc and 5.52% personalized acc under high heterogeneity. One-shot Federated Learning (FL) has emerged as a promising learning paradigm, capable of training a global model through a single communication round. However, existing one-shot FL methods still face the problem of high computational cost on the server or clients and struggle to handle non-IID (Independent and Identically Distributed) data stably and effectively. To address these issues, we propose FedKSS, a novel federated learning method based on kernel space statistics. Specifically, FedKSS maps features into a high-dimensional kernel space using Random Fourier Features, calculates local statistics on each client, and uploads these statistics to the server. The server then aggregates these local statistics to obtain global statistics, and based on this, computes the global prototype and covariance, thereby directly constructing a kernelized training-free classifier. To further enhance the discriminative power of the classifier, we introduce an optimal layer selection mechanism that uses features from different layers of the pre-trained model to construct the classifier and evaluate its performance, thereby determining the optimal feature layer for the current data distribution. In addition, we extend this method to personalization scenario, where clients only need one extra round of communication to download the global prototype from the server and achieve personalized learning through feature alignment. Experiments under high heterogeneity show that, compared with state-of-the-art methods, FedKSS improves global accuracy by 15.71% and local personalization accuracy by 5.52% across multiple benchmark datasets. These results confirm the effectiveness of FedKSS in data-heterogeneity settings. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of Information Fusion is the property of Elsevier B.V. and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=194552886 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1016/j.inffus.2026.104443 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 1 StartPage: N.PAG Subjects: – SubjectFull: Federated learning Type: general – SubjectFull: Feature selection Type: general – SubjectFull: Machine learning Type: general – SubjectFull: Heterogeneity Type: general Titles: – TitleFull: FedKSS: One-shot federated learning with kernel space statistics. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Ding, Jiaman – PersonEntity: Name: NameFull: Jiang, Linglin – PersonEntity: Name: NameFull: Jia, Lianyin – PersonEntity: Name: NameFull: Fu, Xiaodong – PersonEntity: Name: NameFull: Jiang, Ying IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 11 Text: Nov2026 Type: published Y: 2026 Identifiers: – Type: issn-print Value: 15662535 Numbering: – Type: volume Value: 135 Titles: – TitleFull: Information Fusion Type: main |
| ResultId | 1 |