Multi-label feature selection based on minimizing feature redundancy of mutual information.

Saved in:
Bibliographic Details
Title: Multi-label feature selection based on minimizing feature redundancy of mutual information.
Authors: Zhou, Gaozhi1 (AUTHOR) gz_zhou@stu.kust.edu.cn, Li, Runxin1,2 (AUTHOR) rxli@kust.edu.cn, Shang, Zhenhong1 (AUTHOR) szh@kust.edu.cn, Li, Xiaowu1 (AUTHOR) lxwlxw66@kust.edu.cn, Jia, Lianyin1 (AUTHOR) lianyinjia@kust.edu.cn
Source: Neurocomputing. Nov2024, Vol. 607, pN.PAG-N.PAG. 1p.
Subjects: Model theory
Abstract: Multi-label feature selection is an indispensable technology in the preprocessing of multi-label high-dimensional data. Approaches utilizing information theory and sparse models hold promise in this domain, demonstrating strong performance. Although there have been extensive literatures using l 1 and l 2 , 1 -norms to identify label-specific features and common features in the feature space, they all ignore the redundant information interference problem when different features are learned simultaneously. Considering that features and labels in multi-label data are rarely linearly correlated, the MFS-MFR approach is presented to generate a representation of the nonlinear correlation between features and labels using the mutual information estimator. Following that, MFS-MFR detects specific and common features in the feature-label mutual information space using two coefficient matrices constrained by the l 1 and l 2 , 1 -norms, respectively. In particular, we define a non-zero correlation constraint that effectively minimizes the redundant correlation between the two matrices. Moreover, a manifold regularization term is devised to preserve the local information of the mutual information space. To solve the optimization model with nonlinear binary regular term, we employ a novel solution approach called S-FISTA. Extensive experiments across 15 multi-label benchmark datasets, comparing against 11 top-performing multi-label feature selection methods, demonstrate the superior performance of MFS-MFR. [ABSTRACT FROM AUTHOR]
Copyright of Neurocomputing is the property of Elsevier B.V. and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
FullText Text:
  Availability: 0
Header DbId: egs
DbLabel: Engineering Source
An: 179499502
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Multi-label feature selection based on minimizing feature redundancy of mutual information.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Zhou%2C+Gaozhi%22">Zhou, Gaozhi</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> gz_zhou@stu.kust.edu.cn</i><br /><searchLink fieldCode="AR" term="%22Li%2C+Runxin%22">Li, Runxin</searchLink><relatesTo>1,2</relatesTo> (AUTHOR)<i> rxli@kust.edu.cn</i><br /><searchLink fieldCode="AR" term="%22Shang%2C+Zhenhong%22">Shang, Zhenhong</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> szh@kust.edu.cn</i><br /><searchLink fieldCode="AR" term="%22Li%2C+Xiaowu%22">Li, Xiaowu</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> lxwlxw66@kust.edu.cn</i><br /><searchLink fieldCode="AR" term="%22Jia%2C+Lianyin%22">Jia, Lianyin</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> lianyinjia@kust.edu.cn</i>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Neurocomputing%22">Neurocomputing</searchLink>. Nov2024, Vol. 607, pN.PAG-N.PAG. 1p.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Model+theory%22">Model theory</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Multi-label feature selection is an indispensable technology in the preprocessing of multi-label high-dimensional data. Approaches utilizing information theory and sparse models hold promise in this domain, demonstrating strong performance. Although there have been extensive literatures using l 1 and l 2 , 1 -norms to identify label-specific features and common features in the feature space, they all ignore the redundant information interference problem when different features are learned simultaneously. Considering that features and labels in multi-label data are rarely linearly correlated, the MFS-MFR approach is presented to generate a representation of the nonlinear correlation between features and labels using the mutual information estimator. Following that, MFS-MFR detects specific and common features in the feature-label mutual information space using two coefficient matrices constrained by the l 1 and l 2 , 1 -norms, respectively. In particular, we define a non-zero correlation constraint that effectively minimizes the redundant correlation between the two matrices. Moreover, a manifold regularization term is devised to preserve the local information of the mutual information space. To solve the optimization model with nonlinear binary regular term, we employ a novel solution approach called S-FISTA. Extensive experiments across 15 multi-label benchmark datasets, comparing against 11 top-performing multi-label feature selection methods, demonstrate the superior performance of MFS-MFR. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Neurocomputing is the property of Elsevier B.V. and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=179499502
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1016/j.neucom.2024.128392
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 1
        StartPage: N.PAG
    Subjects:
      – SubjectFull: Model theory
        Type: general
    Titles:
      – TitleFull: Multi-label feature selection based on minimizing feature redundancy of mutual information.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Zhou, Gaozhi
      – PersonEntity:
          Name:
            NameFull: Li, Runxin
      – PersonEntity:
          Name:
            NameFull: Shang, Zhenhong
      – PersonEntity:
          Name:
            NameFull: Li, Xiaowu
      – PersonEntity:
          Name:
            NameFull: Jia, Lianyin
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 28
              M: 11
              Text: Nov2024
              Type: published
              Y: 2024
          Identifiers:
            – Type: issn-print
              Value: 09252312
          Numbering:
            – Type: volume
              Value: 607
          Titles:
            – TitleFull: Neurocomputing
              Type: main
ResultId 1