Harnessing Large Language Models for Software Issue Learning and Knowledge Retention.

Saved in:
Bibliographic Details
Title: Harnessing Large Language Models for Software Issue Learning and Knowledge Retention.
Authors: CHEN, SZU-YU1 adsylviata@gmail.com, HUANG, NAN-JUNG1 njhuang.cs11@nycu.edu.tw, KOONG, CHORNG-SHIUH2 csko@mail.ntcu.edu.tw, HUANG, SHIH-KUN1 skhuang@nycu.edu.tw
Source: Journal of Information Science & Engineering. May2026, Vol. 42 Issue 3, p703-726. 24p.
Subjects: Language models, Defect tracking (Computer software development), Intelligent tutoring systems, Memory, Software engineering, Computer programming education, Generative adversarial networks, Instructional systems
Abstract: Project issues often capture the challenges and solutions encountered during software development, making them valuable learning resources for avoiding redundant problem-solving efforts. However, the volume and complexity of issue data present a significant challenge for effective learning. This study proposes an AI-assisted approach to issue-based learning. Leveraging a large language model (LLM) for issue classification and filtering and drawing inspiration from the generative component of Generative Adversarial Networks (GANs) (while excluding the adversarial aspect), we generate plausible yet incorrect answer options to enhance question difficulty. This design supports a gradual, layered learning process. Using open-source project issues from GitHub as the data source, we developed a learning platform called SPILSG to generate and deliver learning materials. Experimental results demonstrate the following: (1) The GPT-4-0613 model achieved the highest compliance rates at 37.4% and 50.6%; (2) In terms of reading effectiveness, the LLM-based SP1LSG system significantly improved novices' understanding of software project issues; and (3) Usability evaluations indicated a generally positive user experience. In summary, AI-assisted learning offers a time-efficient way for learners to comprehend project contexts, familiarize themselves with codebases, and enhance their programming proficiency. [ABSTRACT FROM AUTHOR]
Copyright of Journal of Information Science & Engineering is the property of Institute of Information Science, Academia Sinica and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
FullText Links:
  – Type: pdflink
Text:
  Availability: 0
Header DbId: egs
DbLabel: Engineering Source
An: 193961065
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Harnessing Large Language Models for Software Issue Learning and Knowledge Retention.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22CHEN%2C+SZU-YU%22">CHEN, SZU-YU</searchLink><relatesTo>1</relatesTo><i> adsylviata@gmail.com</i><br /><searchLink fieldCode="AR" term="%22HUANG%2C+NAN-JUNG%22">HUANG, NAN-JUNG</searchLink><relatesTo>1</relatesTo><i> njhuang.cs11@nycu.edu.tw</i><br /><searchLink fieldCode="AR" term="%22KOONG%2C+CHORNG-SHIUH%22">KOONG, CHORNG-SHIUH</searchLink><relatesTo>2</relatesTo><i> csko@mail.ntcu.edu.tw</i><br /><searchLink fieldCode="AR" term="%22HUANG%2C+SHIH-KUN%22">HUANG, SHIH-KUN</searchLink><relatesTo>1</relatesTo><i> skhuang@nycu.edu.tw</i>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Journal+of+Information+Science+%26+Engineering%22">Journal of Information Science & Engineering</searchLink>. May2026, Vol. 42 Issue 3, p703-726. 24p.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Language+models%22">Language models</searchLink><br /><searchLink fieldCode="DE" term="%22Defect+tracking+%28Computer+software+development%29%22">Defect tracking (Computer software development)</searchLink><br /><searchLink fieldCode="DE" term="%22Intelligent+tutoring+systems%22">Intelligent tutoring systems</searchLink><br /><searchLink fieldCode="DE" term="%22Memory%22">Memory</searchLink><br /><searchLink fieldCode="DE" term="%22Software+engineering%22">Software engineering</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+programming+education%22">Computer programming education</searchLink><br /><searchLink fieldCode="DE" term="%22Generative+adversarial+networks%22">Generative adversarial networks</searchLink><br /><searchLink fieldCode="DE" term="%22Instructional+systems%22">Instructional systems</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Project issues often capture the challenges and solutions encountered during software development, making them valuable learning resources for avoiding redundant problem-solving efforts. However, the volume and complexity of issue data present a significant challenge for effective learning. This study proposes an AI-assisted approach to issue-based learning. Leveraging a large language model (LLM) for issue classification and filtering and drawing inspiration from the generative component of Generative Adversarial Networks (GANs) (while excluding the adversarial aspect), we generate plausible yet incorrect answer options to enhance question difficulty. This design supports a gradual, layered learning process. Using open-source project issues from GitHub as the data source, we developed a learning platform called SPILSG to generate and deliver learning materials. Experimental results demonstrate the following: (1) The GPT-4-0613 model achieved the highest compliance rates at 37.4% and 50.6%; (2) In terms of reading effectiveness, the LLM-based SP1LSG system significantly improved novices' understanding of software project issues; and (3) Usability evaluations indicated a generally positive user experience. In summary, AI-assisted learning offers a time-efficient way for learners to comprehend project contexts, familiarize themselves with codebases, and enhance their programming proficiency. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Journal of Information Science & Engineering is the property of Institute of Information Science, Academia Sinica and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=193961065
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.6688/JISE.202605_42(3).0013
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 24
        StartPage: 703
    Subjects:
      – SubjectFull: Language models
        Type: general
      – SubjectFull: Defect tracking (Computer software development)
        Type: general
      – SubjectFull: Intelligent tutoring systems
        Type: general
      – SubjectFull: Memory
        Type: general
      – SubjectFull: Software engineering
        Type: general
      – SubjectFull: Computer programming education
        Type: general
      – SubjectFull: Generative adversarial networks
        Type: general
      – SubjectFull: Instructional systems
        Type: general
    Titles:
      – TitleFull: Harnessing Large Language Models for Software Issue Learning and Knowledge Retention.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: CHEN, SZU-YU
      – PersonEntity:
          Name:
            NameFull: HUANG, NAN-JUNG
      – PersonEntity:
          Name:
            NameFull: KOONG, CHORNG-SHIUH
      – PersonEntity:
          Name:
            NameFull: HUANG, SHIH-KUN
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 05
              Text: May2026
              Type: published
              Y: 2026
          Identifiers:
            – Type: issn-print
              Value: 10162364
          Numbering:
            – Type: volume
              Value: 42
            – Type: issue
              Value: 3
          Titles:
            – TitleFull: Journal of Information Science & Engineering
              Type: main
ResultId 1