Exploring the Effectiveness of AI Course Assistants on the Student Learning Experience

Saved in:
Bibliographic Details
Title: Exploring the Effectiveness of AI Course Assistants on the Student Learning Experience
Language: English
Authors: George Hanshaw (ORCID 0000-0002-5986-3965), Joanna Vance (ORCID 0009-0008-3597-1313), Craig Brewer (ORCID 0009-0004-5067-5476)
Source: Open Praxis. 2024 16(4):627-644.
Availability: International Council for Open and Distance Education. Lilleakerveien 23, 0283 Oslo, Norway. Tel: +47-22-06-26-30; Fax: +47-22-06-26-31; e-mail: icde@icde.org; Web site: https://openpraxis.org/
Peer Reviewed: Y
Page Count: 18
Publication Date: 2024
Document Type: Journal Articles
Reports - Research
Education Level: Higher Education
Postsecondary Education
Descriptors: Instructional Effectiveness, Artificial Intelligence, Student Experience, Undergraduate Students, Undergraduate Study, Computer Assisted Instruction, Academic Achievement, Grades (Scholastic), Student Motivation, Self Efficacy, Student Attitudes, Learner Engagement, Natural Language Processing, Online Courses, Learning Strategies, Religion Studies, Introductory Courses, Psychology, Technology Uses in Education
Geographic Terms: California (Los Angeles)
Assessment and Survey Identifiers: Motivated Strategies for Learning Questionnaire
ISSN: 1369-9997
2304-070X
Abstract: This study examines the impact of AI course assistants on student learning experiences in online undergraduate courses at Los Angeles Pacific University. A controlled experiment involving 92 students across treatment and control groups was conducted to evaluate the effectiveness of AI assistants developed by Nectir. The treatment group had access to AI assistants, while the control group did not. The study measured grades, intrinsic motivation, self-efficacy, and students' perceptions of engagement, encouragement, and support. Results indicated that the AI course assistants significantly improved students' grades and intrinsic motivation, with moderate effect sizes observed. Self-efficacy also showed a significant positive impact, suggesting that AI course assistants can enhance students' confidence in their academic abilities. However, there were no statistically significant differences in students' feelings of engagement, encouragement, and support, potentially due to the high-touch model already in place at the university. The findings underscore the potential of AI technology to complement existing student support systems, providing continuous personalized assistance that can improve academic performance and intrinsic motivation. Further research is recommended to explore the long-term effects of AI course assistants and their interaction with other support mechanisms to optimize student outcomes and address equity gaps in online education.
Abstractor: As Provided
Entry Date: 2025
Accession Number: EJ1456708
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=EJ1456708
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: EJ1456708
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Exploring the Effectiveness of AI Course Assistants on the Student Learning Experience
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22George+Hanshaw%22">George Hanshaw</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-5986-3965">0000-0002-5986-3965</externalLink>)<br /><searchLink fieldCode="AR" term="%22Joanna+Vance%22">Joanna Vance</searchLink> (ORCID <externalLink term="https://orcid.org/0009-0008-3597-1313">0009-0008-3597-1313</externalLink>)<br /><searchLink fieldCode="AR" term="%22Craig+Brewer%22">Craig Brewer</searchLink> (ORCID <externalLink term="https://orcid.org/0009-0004-5067-5476">0009-0004-5067-5476</externalLink>)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Open+Praxis%22"><i>Open Praxis</i></searchLink>. 2024 16(4):627-644.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: International Council for Open and Distance Education. Lilleakerveien 23, 0283 Oslo, Norway. Tel: +47-22-06-26-30; Fax: +47-22-06-26-31; e-mail: icde@icde.org; Web site: https://openpraxis.org/
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 18
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2024
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Higher+Education%22">Higher Education</searchLink><br /><searchLink fieldCode="EL" term="%22Postsecondary+Education%22">Postsecondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Instructional+Effectiveness%22">Instructional Effectiveness</searchLink><br /><searchLink fieldCode="DE" term="%22Artificial+Intelligence%22">Artificial Intelligence</searchLink><br /><searchLink fieldCode="DE" term="%22Student+Experience%22">Student Experience</searchLink><br /><searchLink fieldCode="DE" term="%22Undergraduate+Students%22">Undergraduate Students</searchLink><br /><searchLink fieldCode="DE" term="%22Undergraduate+Study%22">Undergraduate Study</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+Assisted+Instruction%22">Computer Assisted Instruction</searchLink><br /><searchLink fieldCode="DE" term="%22Academic+Achievement%22">Academic Achievement</searchLink><br /><searchLink fieldCode="DE" term="%22Grades+%28Scholastic%29%22">Grades (Scholastic)</searchLink><br /><searchLink fieldCode="DE" term="%22Student+Motivation%22">Student Motivation</searchLink><br /><searchLink fieldCode="DE" term="%22Self+Efficacy%22">Self Efficacy</searchLink><br /><searchLink fieldCode="DE" term="%22Student+Attitudes%22">Student Attitudes</searchLink><br /><searchLink fieldCode="DE" term="%22Learner+Engagement%22">Learner Engagement</searchLink><br /><searchLink fieldCode="DE" term="%22Natural+Language+Processing%22">Natural Language Processing</searchLink><br /><searchLink fieldCode="DE" term="%22Online+Courses%22">Online Courses</searchLink><br /><searchLink fieldCode="DE" term="%22Learning+Strategies%22">Learning Strategies</searchLink><br /><searchLink fieldCode="DE" term="%22Religion+Studies%22">Religion Studies</searchLink><br /><searchLink fieldCode="DE" term="%22Introductory+Courses%22">Introductory Courses</searchLink><br /><searchLink fieldCode="DE" term="%22Psychology%22">Psychology</searchLink><br /><searchLink fieldCode="DE" term="%22Technology+Uses+in+Education%22">Technology Uses in Education</searchLink>
– Name: Subject
  Label: Geographic Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22California+%28Los+Angeles%29%22">California (Los Angeles)</searchLink>
– Name: SubjectThesaurus
  Label: Assessment and Survey Identifiers
  Group: Su
  Data: <searchLink fieldCode="SU" term="%22Motivated+Strategies+for+Learning+Questionnaire%22">Motivated Strategies for Learning Questionnaire</searchLink>
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 1369-9997<br />2304-070X
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: This study examines the impact of AI course assistants on student learning experiences in online undergraduate courses at Los Angeles Pacific University. A controlled experiment involving 92 students across treatment and control groups was conducted to evaluate the effectiveness of AI assistants developed by Nectir. The treatment group had access to AI assistants, while the control group did not. The study measured grades, intrinsic motivation, self-efficacy, and students' perceptions of engagement, encouragement, and support. Results indicated that the AI course assistants significantly improved students' grades and intrinsic motivation, with moderate effect sizes observed. Self-efficacy also showed a significant positive impact, suggesting that AI course assistants can enhance students' confidence in their academic abilities. However, there were no statistically significant differences in students' feelings of engagement, encouragement, and support, potentially due to the high-touch model already in place at the university. The findings underscore the potential of AI technology to complement existing student support systems, providing continuous personalized assistance that can improve academic performance and intrinsic motivation. Further research is recommended to explore the long-term effects of AI course assistants and their interaction with other support mechanisms to optimize student outcomes and address equity gaps in online education.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2025
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1456708
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1456708
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 18
        StartPage: 627
    Subjects:
      – SubjectFull: Instructional Effectiveness
        Type: general
      – SubjectFull: Artificial Intelligence
        Type: general
      – SubjectFull: Student Experience
        Type: general
      – SubjectFull: Undergraduate Students
        Type: general
      – SubjectFull: Undergraduate Study
        Type: general
      – SubjectFull: Computer Assisted Instruction
        Type: general
      – SubjectFull: Academic Achievement
        Type: general
      – SubjectFull: Grades (Scholastic)
        Type: general
      – SubjectFull: Student Motivation
        Type: general
      – SubjectFull: Self Efficacy
        Type: general
      – SubjectFull: Student Attitudes
        Type: general
      – SubjectFull: Learner Engagement
        Type: general
      – SubjectFull: Natural Language Processing
        Type: general
      – SubjectFull: Online Courses
        Type: general
      – SubjectFull: Learning Strategies
        Type: general
      – SubjectFull: Religion Studies
        Type: general
      – SubjectFull: Introductory Courses
        Type: general
      – SubjectFull: Psychology
        Type: general
      – SubjectFull: Technology Uses in Education
        Type: general
      – SubjectFull: California (Los Angeles)
        Type: general
      – SubjectFull: Motivated Strategies for Learning Questionnaire
        Type: general
    Titles:
      – TitleFull: Exploring the Effectiveness of AI Course Assistants on the Student Learning Experience
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: George Hanshaw
      – PersonEntity:
          Name:
            NameFull: Joanna Vance
      – PersonEntity:
          Name:
            NameFull: Craig Brewer
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2024
          Identifiers:
            – Type: issn-print
              Value: 1369-9997
            – Type: issn-electronic
              Value: 2304-070X
          Numbering:
            – Type: volume
              Value: 16
            – Type: issue
              Value: 4
          Titles:
            – TitleFull: Open Praxis
              Type: main
ResultId 1