Hierarchical Information Aggregation for Incomplete Multimodal Alzheimer's Disease Diagnosis

Jinghua Wang (Harbin Institute of Technology) · Jie Wen (Harbin Institute of Technology, Shenzhen) · Chengliang Liu (Shenzhen University) · Que Yuanxi (Shenzhen University) · Qihao Xu (Harbin Institute of Technology) · Yabo Liu (Harbin Institute of Technology, Shenzhen) · Xiaoling Luo (Shenzhen University)
alzheimer's diseaseconvolution-based architecturediagnostic frameworkearly-stage diagnosisheterogeneous medical datahierarchical spatial feature extractionhilbert curvejoint diagnosislong-range dependenciesmamba blockmodality collapsemodality-specific informationmultimodal artificial intelligencemutual information learningspatial discontinuitiesvoxel serialization

Alzheimer's Disease (AD) poses a significant health threat to the aging population, underscoring the critical need for early diagnosis to delay disease progression and improve patient quality of life. Recent advances in heterogeneous multimodal artificial intelligence (AI) have facilitated comprehensive joint diagnosis, yet practical clinical scenarios frequently encounter incomplete modalities due to factors like high acquisition costs or radiation risks. Moreover, traditional convolution-based architecture face inherent limitations in capturing long-range dependencies and handling heterogeneous medical data efficiently. To address these challenges, in our proposed heterogeneous multimodal diagnostic framework (HAD), we develop a multi-view Hilbert curve-based Mamba block and a hierarchical spatial feature extraction module to simultaneously capture local spatial features and global dependencies, effectively alleviating spatial discontinuities introduced by voxel serialization. Furthermore, to balance semantic consistency and modal specificity, we build a unified mutual information learning objective in the heterogeneous multimodal embedding space, which maintains effective learning of modality-specific information to avoid modality collapse caused by model preference. Extensive experiments demonstrate that our HAD significantly outperforms state-of-the-art methods in various modality-missing scenarios, providing an efficient and reliable solution for early-stage AD diagnosis.