Research summary: Test-Retest Reliability, Practice Effects and Estimates of Change: A Study on the Mindmore Digital Cognitive Assessment Tool

A summary of a study investigating the test-retest reliability of Mindmore.

Background

Cognitive tests are important tools in clinical diagnostics and research. Digital tools offer opportunities for standardised administration, precise measurement and efficient documentation. Mindmore is a digital cognitive testing platform adapted from traditional tests for self-administration, both in a laboratory setting and online.

Aim

The study aims to investigate the test-retest reliability and practice effects of Mindmore. In addition, normative change values have been developed for the most frequently used tests. The goal is to give clinicians and researchers tools to distinguish between normal variation and clinically relevant changes in cognitive performance.

Method

A total of 149 healthy Swedish adults aged 20–79 took part, completing the test battery twice, one month apart. The tests assessed attention and processing speed, memory, language, visuospatial functions and executive functions. Test-retest reliability was measured using ICC and Spearman’s correlation coefficients, and practice effects were estimated for 22 main scores and 33 subscores.

Results

Test-retest reliability was good for 11 main scores (≥ .70), adequate for five (.60–.69) and minimal for six (< .60), as illustrated in the figure below. Practice effects were observed for tests with a large speed component, but not for reaction time, sustained attention, verbal memory and naming (with alternate forms), or visuospatial functions. Factors such as sex, education and test setting (online or in the laboratory) did not significantly affect change scores.

Figure: Reliability (intraclass correlation coefficients, ICC) for all included tests.

Conclusion

The study shows that Mindmore has good test-retest reliability and practice effects comparable to those of traditional tests. Together with normative change values, these results can help clinicians interpret test results and distinguish between normal variation in performance and changes indicating clinical impairment. Digital tools such as Mindmore can improve the accuracy and efficiency of cognitive assessments, benefiting patient care.

Reference:

Bergman, I., Franke Föyen, L., Gustavsson, A., Van den Hurk, W. (2024) Test-retest reliability, practice effects and estimates of change: A study on the Mindmore digital cognitive assessment tool. Scandinavian Journal of Psychology.