Test–retest reliability, practice effects and estimates of change: A study on the Mindmore digital cognitive assessment tool.

Saved in:
Bibliographic Details
Title: Test–retest reliability, practice effects and estimates of change: A study on the Mindmore digital cognitive assessment tool.
Authors: Bergman, Ingvar, Franke Föyen, Ludwig, Gustavsson, Anders, Van den Hurk, Wobbie
Source: Scandinavian Journal of Psychology. Feb2025, Vol. 66 Issue 1, p1-14. 14p.
Subjects: Digital technology, Mental health surveys, Language & languages, Cognitive testing, Research evaluation, Questionnaires, Cognitive processing speed, Executive function, Attention, Statistical reliability, Neuropsychological tests, Memory, Research methodology, Intraclass correlation, Psychological tests
Geographic Terms: Sweden
Abstract: The present study aimed to establish test–retest reliability and investigate practice effects of the Mindmore cognitive assessment tool, a digital adaptation of traditional pencil and paper tests designed for self‐administration. Additionally, normative change scores for the most frequently used tests were derived. A total of 149 healthy Swedish adults (aged 20–79) completed the test battery twice, 1 month apart. The battery assessed attention and processing speed, memory, language, visuospatial functions, and executive functions. Test–retest reliability, measured by ICC and Spearman coefficients, and practice effects were estimated for 22 main‐scores and 33 sub‐scores. Regression models were used to assess change in performance while controlling for demographics, computer equipment, testing location (online or in‐laboratory) and baseline performance for 12 main‐scores and nine sub‐scores. Test–retest reliability was good for 11 main‐scores (≥0.70), satisfactory for five (0.60–0.69), and minimal for six (<0.60) albeit three having satisfactory sub‐scores. Practice effects were observed for tests with a major speed component, but not for reaction time, sustained attention, verbal memory and naming (alternate forms), nor visuospatial functions. Trackpad negatively influenced change for one test. Demographics and testing location did not significantly affect the change scores. Our study provides support for test–retest reliability and practice effects of the Mindmore cognitive assessment tool which were comparable to those of traditional tests. These findings, together with the normative change scores, can aid researchers and clinicians in interpreting test results and distinguishing between normal variations in performance and changes indicative of clinical impairment. [ABSTRACT FROM AUTHOR]
Copyright of Scandinavian Journal of Psychology is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Psychology and Behavioral Sciences Collection
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
Text:
  Availability: 1
Header DbId: pbh
DbLabel: Psychology and Behavioral Sciences Collection
An: 183850978
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Test–retest reliability, practice effects and estimates of change: A study on the Mindmore digital cognitive assessment tool.
– Name: Author
  Label: Authors
  Group: Au
  Data: &lt;searchLink fieldCode=&quot;AR&quot; term=&quot;%22Bergman%2C+Ingvar%22&quot;&gt;Bergman, Ingvar&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;AR&quot; term=&quot;%22Franke+F&#246;yen%2C+Ludwig%22&quot;&gt;Franke F&#246;yen, Ludwig&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;AR&quot; term=&quot;%22Gustavsson%2C+Anders%22&quot;&gt;Gustavsson, Anders&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;AR&quot; term=&quot;%22Van+den+Hurk%2C+Wobbie%22&quot;&gt;Van den Hurk, Wobbie&lt;/searchLink&gt;
– Name: TitleSource
  Label: Source
  Group: Src
  Data: &lt;searchLink fieldCode=&quot;JN&quot; term=&quot;%22Scandinavian+Journal+of+Psychology%22&quot;&gt;Scandinavian Journal of Psychology&lt;/searchLink&gt;. Feb2025, Vol. 66 Issue 1, p1-14. 14p.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: &lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Digital+technology%22&quot;&gt;Digital technology&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Mental+health+surveys%22&quot;&gt;Mental health surveys&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Language+%26+languages%22&quot;&gt;Language &amp; languages&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Cognitive+testing%22&quot;&gt;Cognitive testing&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Research+evaluation%22&quot;&gt;Research evaluation&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Questionnaires%22&quot;&gt;Questionnaires&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Cognitive+processing+speed%22&quot;&gt;Cognitive processing speed&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Executive+function%22&quot;&gt;Executive function&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Attention%22&quot;&gt;Attention&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Statistical+reliability%22&quot;&gt;Statistical reliability&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Neuropsychological+tests%22&quot;&gt;Neuropsychological tests&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Memory%22&quot;&gt;Memory&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Research+methodology%22&quot;&gt;Research methodology&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Intraclass+correlation%22&quot;&gt;Intraclass correlation&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Psychological+tests%22&quot;&gt;Psychological tests&lt;/searchLink&gt;
– Name: SubjectGeographic
  Label: Geographic Terms
  Group: Su
  Data: &lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Sweden%22&quot;&gt;Sweden&lt;/searchLink&gt;
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: The present study aimed to establish test–retest reliability and investigate practice effects of the Mindmore cognitive assessment tool, a digital adaptation of traditional pencil and paper tests designed for self‐administration. Additionally, normative change scores for the most frequently used tests were derived. A total of 149 healthy Swedish adults (aged 20–79) completed the test battery twice, 1 month apart. The battery assessed attention and processing speed, memory, language, visuospatial functions, and executive functions. Test–retest reliability, measured by ICC and Spearman coefficients, and practice effects were estimated for 22 main‐scores and 33 sub‐scores. Regression models were used to assess change in performance while controlling for demographics, computer equipment, testing location (online or in‐laboratory) and baseline performance for 12 main‐scores and nine sub‐scores. Test–retest reliability was good for 11 main‐scores (≥0.70), satisfactory for five (0.60–0.69), and minimal for six (&lt;0.60) albeit three having satisfactory sub‐scores. Practice effects were observed for tests with a major speed component, but not for reaction time, sustained attention, verbal memory and naming (alternate forms), nor visuospatial functions. Trackpad negatively influenced change for one test. Demographics and testing location did not significantly affect the change scores. Our study provides support for test–retest reliability and practice effects of the Mindmore cognitive assessment tool which were comparable to those of traditional tests. These findings, together with the normative change scores, can aid researchers and clinicians in interpreting test results and distinguishing between normal variations in performance and changes indicative of clinical impairment. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: &lt;i&gt;Copyright of Scandinavian Journal of Psychology is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder&#39;s express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.&lt;/i&gt; (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=pbh&AN=183850978
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1111/sjop.13054
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 14
        StartPage: 1
    Subjects:
      – SubjectFull: Digital technology
        Type: general
      – SubjectFull: Mental health surveys
        Type: general
      – SubjectFull: Language & languages
        Type: general
      – SubjectFull: Cognitive testing
        Type: general
      – SubjectFull: Research evaluation
        Type: general
      – SubjectFull: Questionnaires
        Type: general
      – SubjectFull: Cognitive processing speed
        Type: general
      – SubjectFull: Executive function
        Type: general
      – SubjectFull: Attention
        Type: general
      – SubjectFull: Statistical reliability
        Type: general
      – SubjectFull: Neuropsychological tests
        Type: general
      – SubjectFull: Memory
        Type: general
      – SubjectFull: Research methodology
        Type: general
      – SubjectFull: Intraclass correlation
        Type: general
      – SubjectFull: Psychological tests
        Type: general
      – SubjectFull: Sweden
        Type: general
    Titles:
      – TitleFull: Test–retest reliability, practice effects and estimates of change: A study on the Mindmore digital cognitive assessment tool.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Bergman, Ingvar
      – PersonEntity:
          Name:
            NameFull: Franke Föyen, Ludwig
      – PersonEntity:
          Name:
            NameFull: Gustavsson, Anders
      – PersonEntity:
          Name:
            NameFull: Van den Hurk, Wobbie
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 02
              Text: Feb2025
              Type: published
              Y: 2025
          Identifiers:
            – Type: issn-print
              Value: 00365564
          Numbering:
            – Type: volume
              Value: 66
            – Type: issue
              Value: 1
          Titles:
            – TitleFull: Scandinavian Journal of Psychology
              Type: main
ResultId 1