Open AccessMultimodal 3D Deep Learning for Early Diagnosis of Alzheimer’s Disease
Author(s) -
Seung Kyu Kim,
Quan Anh Duong,
Jin Kyu Gahm
Publication year - 2024
Publication title -
ieee access
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.587
H-Index - 127
ISSN - 2169-3536
DOI - 10.1109/access.2024.3381862
Subject(s) - aerospace , bioengineering , communication, networking and broadcast technologies , components, circuits, devices and systems , computing and processing , engineered materials, dielectrics and plasmas , engineering profession , fields, waves and electromagnetics , general topics for engineers , geoscience , nuclear engineering , photonics and electrooptics , power, energy and industry applications , robotics and control systems , signal processing and analysis , transportation
Alzheimer’s disease (AD) is a neurodegenerative disease that affects the elderly and leads to cognitive decline and memory loss. Treatments for stopping or slowing the progression of AD have not been discovered yet; therefore, delaying the progression of AD is the only option, which makes early diagnosis of AD crucial. Additionally, although Aβ plaques and tau proteins are considered the causes of early AD, few studies have used this information to diagnose early AD. In this study, a middle-fusion multimodal model is proposed for the diagnosis of early AD. The proposed multimodal model extracts features without loss using a depthwise separable convolution block without an activation function. Subsequently, middle fusion is applied using mix skip connection and sharing weight convolution blocks, both designed to learn the complex relationships between modalities. In contrast to other studies, the proposed approach has three main novelties. 1) A middle-fusion multimodal model is proposed for the early diagnosis of AD. 2) The proposed model is evaluated using Aβ PET and tau protein PET data collected from the Alzheimer’s Disease Neuroimaging Initiative (ADNI). 3) A novel region-of-interest (ROI) extraction method is proposed for the hippocampus, middle temporal, and inferior temporal regions, which are known to be affected in the early stages of AD. In the experimental results, the proposed multimodal model achieved a balanced accuracy of 1.00, for the task of Alzheimer’s disease vs cognitive normal (CN) and 0.76 for the task of mild cognitive impairment vs cognitive normal.