Abstract Details

Title Reliability of Unsupervised Digital Cognitive Assessment in a Large Adult Population Across the Aging Lifespan from INTUITION: A Brain Health Study

Topic Aging, Dementia, and Behavioral Neurology

Presentation(s) S8 - Behavioral and Cognitive Neurology (5:06 PM-5:18 PM)

Poster/Presentation
Number 009

Background

Mobile and remote cognitive assessments may expedite patient screening for populations vulnerable to accelerated brain aging. As access to personal electronics increases, the modalities for data collection widen. Emerging evidence supports the case for the feasibility and validity of remote, digital cognitive assessments. However, test-retest reliability remains unknown in unsupervised settings and when performed at scale in diverse, heterogenous populations.

Objective

To assess the feasibility and reliability of an unsupervised, digital cognitive battery performed by participants enrolled in the INTUITION (NCT05058950) study, who represent a U.S. adult population at-risk for cognitive decline.

Design/Methods The INTUITION study is an observational two-year virtual study of 23,000 adults across the aging lifespan. Participants complete a monthly web-based 30-minute digital cognitive battery on a personal computing device. The assessment contains five tasks from the Cambridge Neuropsychological Test Automated Battery (CANTAB), which is designed to interrogate performance on specific cognitive domains, including attention, executive function, and episodic memory. We assessed test-retest reliability for key cognitive outcome variables with Pearson and intra-class correlations.

Results The INTUITION study was 91% enrolled (N=20,916) as of September 2022. N=9,415 participants have provided at least 5 sequential CANTAB assessments. Moderate-to-high test-retest reliability was observed for key outcome variables (range; r=0.42-0.80). Subtle, but measurable learning effects were noted across initial sessions and then abated alongside rising performance reliability following subsequent assessments. We present detailed test-retest reliabilities for representative outcomes of each CANTAB assessment from the total study population and by cohort.

Conclusions We demonstrated moderate-to-strong reliability in key cognitive outcome measures and reliability increased as a function of age. Reliability findings were comparable to those reported in the literature for supervised cognitive assessments. These initial results suggest remote and unsupervised cognitive testing is plausible and sufficiently reliable and can be self-administered in ecologically valid real-world settings.

Authors/Disclosures
Michael G. Erkkinen, MD (Brigham and Women's Hospital) PRESENTER	Dr. Erkkinen has received personal compensation in the range of $5,000-$9,999 for serving as a Consultant for Biogen.
Monroe Butler, MD, PhD	Dr. Butler has received personal compensation for serving as an employee of Biogen. Dr. Butler has stock in Biogen.
	No disclosure on file
Matt Hobbs (Biogen)	Mr. Hobbs has received personal compensation for serving as an employee of Biogen. Mr. Hobbs has stock in Biogen.
Audrey Gabelle, MD (Hospital Gui De Chauliac)	No disclosure on file
	No disclosure on file
Paramita Saha-Chaudhuri	No disclosure on file
	No disclosure on file
	No disclosure on file
	No disclosure on file
Matt T. Bianchi, MD, PhD	No disclosure on file
Shibeshih Belachew, MD	Dr. Belachew has received personal compensation for serving as an employee of Biogen Inc. Dr. Belachew has received stock or an ownership interest from Biogen Inc.