View in EDS HTML Full Text PDF Full Text

Lower bound on the information-loss incurred by compressing a depth-2 feed-forward layer of transformer into a single fully connected layer.

Saved in:
Bibliographic Details
Title: Lower bound on the information-loss incurred by compressing a depth-2 feed-forward layer of transformer into a single fully connected layer.
Authors: Matzinger, Heinrich1, matzi@math.gatech.edu, Komatuzaki, Aran1
Source: Journal of Algorithms & Computational Technology; 6/9/2026, Vol. 20, p1-18, 18p
Database: Applied Science & Technology Source
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
Text:
  Availability: 1
Header DbId: aci
DbLabel: Applied Science & Technology Source
An: 194446458
AccessLevel: 2
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Lower bound on the information-loss incurred by compressing a depth-2 feed-forward layer of transformer into a single fully connected layer.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AU" term="%22Matzinger%2C+Heinrich%22">Matzinger, Heinrich</searchLink><relatesTo>1</relatesTo>, <i>matzi@math.gatech.edu</i><br /><searchLink fieldCode="AU" term="%22Komatuzaki%2C+Aran%22">Komatuzaki, Aran</searchLink><relatesTo>1</relatesTo>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Journal+of+Algorithms+%26+Computational+Technology%22">Journal of Algorithms & Computational Technology</searchLink>; 6/9/2026, Vol. 20, p1-18, 18p
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=aci&AN=194446458
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1177/17483026261455599
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 18
        StartPage: 1
    Titles:
      – TitleFull: Lower bound on the information-loss incurred by compressing a depth-2 feed-forward layer of transformer into a single fully connected layer.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Matzinger, Heinrich
      – PersonEntity:
          Name:
            NameFull: Komatuzaki, Aran
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 09
              M: 06
              Text: 6/9/2026
              Type: published
              Y: 2026
          Identifiers:
            – Type: issn-print
              Value: 17483018
          Numbering:
            – Type: volume
              Value: 20
          Titles:
            – TitleFull: Journal of Algorithms & Computational Technology
              Type: main
ResultId 1