Open AccessCombining Multimodal Behavioral Data of Gait, Speech, and Drawing for Classification of Alzheimer’s Disease and Mild Cognitive Impairment
Author(s) -
Yasunori Yamada,
Kaoru Shinkawa,
Masatomo Kobayashi,
Vittorio Caggiano,
Miyuki Nemoto,
Kiyotaka Nemoto,
Tetsuaki Arai
Publication year - 2021
Publication title -
journal of alzheimer's disease
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.677
H-Index - 139
eISSN - 1875-8908
pISSN - 1387-2877
DOI - 10.3233/jad-210684
Subject(s) - modalities , gait , cognitive impairment , modality (human–computer interaction) , cognition , physical medicine and rehabilitation , psychology , alzheimer's disease , disease , audiology , medicine , neuroscience , artificial intelligence , computer science , pathology , social science , sociology
Background: Gait, speech, and drawing behaviors have been shown to be sensitive to the diagnosis of Alzheimer’s disease (AD) and mild cognitive impairment (MCI). However, previous studies focused on only analyzing individual behavioral modalities, although these studies suggested that each of these modalities may capture different profiles of cognitive impairments associated with AD. Objective: We aimed to investigate if combining behavioral data of gait, speech, and drawing can improve classification performance compared with the use of individual modality and if each of these behavioral data can be associated with different cognitive and clinical measures for the diagnosis of AD and MCI. Methods: Behavioral data of gait, speech, and drawing were acquired from 118 AD, MCI, and cognitively normal (CN) participants. Results: Combining all three behavioral modalities achieved 93.0% accuracy for classifying AD, MCI, and CN, and only 81.9% when using the best individual behavioral modality. Each of these behavioral modalities was statistically significantly associated with different cognitive and clinical measures for diagnosing AD and MCI. Conclusion: Our findings indicate that these behaviors provide different and complementary information about cognitive impairments such that classification of AD and MCI is superior to using either in isolation.