Clinicians implicitly incorporate the complementarity of multi-modal data for disease diagnosis. Often a varied order of importance for this heterogeneous data is considered for personalized decisions. Current learning-based methods have achieved better performance with uniform attention to individual information, but a very few have focused on patient-specific attention learning schemes for each modality. Towards this, we introduce a model which not only improves the disease prediction but also focuses on learning patient-specific order of importance for multi-modal data elements. In order to achieve this, we take advantage of LSTM-based attention mechanism and graph convolutional networks (GCNs) to design our model. GCNs learn multi-modal but class-specific features from the entire population of patients, whereas the attention mechanism optimally fuses these multi-modal features into a final decision, separately for each patient. In this paper, we apply the proposed approach for disease prediction task for Parkinson's and Alzheimer's using two public medical datasets.
机构:
Sun Yat Sen Univ, Sch Pharmaceut Sci, 132 East Circle, Guangzhou 510006, Guangdong, Peoples R China
Sun Yat Sen Univ, Sch Data & Comp Sci, 132 East Circle, Guangzhou 510006, Guangdong, Peoples R ChinaSun Yat Sen Univ, Sch Pharmaceut Sci, 132 East Circle, Guangzhou 510006, Guangdong, Peoples R China
Li, Xiuming
Yan, Xin
论文数: 0引用数: 0
h-index: 0
机构:
Sun Yat Sen Univ, Sch Pharmaceut Sci, 132 East Circle, Guangzhou 510006, Guangdong, Peoples R China
Sun Yat Sen Univ, Sch Data & Comp Sci, 132 East Circle, Guangzhou 510006, Guangdong, Peoples R ChinaSun Yat Sen Univ, Sch Pharmaceut Sci, 132 East Circle, Guangzhou 510006, Guangdong, Peoples R China
Yan, Xin
Gu, Qiong
论文数: 0引用数: 0
h-index: 0
机构:
Sun Yat Sen Univ, Sch Pharmaceut Sci, 132 East Circle, Guangzhou 510006, Guangdong, Peoples R China
Sun Yat Sen Univ, Sch Data & Comp Sci, 132 East Circle, Guangzhou 510006, Guangdong, Peoples R ChinaSun Yat Sen Univ, Sch Pharmaceut Sci, 132 East Circle, Guangzhou 510006, Guangdong, Peoples R China
Gu, Qiong
Zhou, Huihao
论文数: 0引用数: 0
h-index: 0
机构:
Sun Yat Sen Univ, Sch Pharmaceut Sci, 132 East Circle, Guangzhou 510006, Guangdong, Peoples R China
Sun Yat Sen Univ, Sch Data & Comp Sci, 132 East Circle, Guangzhou 510006, Guangdong, Peoples R ChinaSun Yat Sen Univ, Sch Pharmaceut Sci, 132 East Circle, Guangzhou 510006, Guangdong, Peoples R China
Zhou, Huihao
Wu, Di
论文数: 0引用数: 0
h-index: 0
机构:
Sun Yat Sen Univ, Sch Pharmaceut Sci, 132 East Circle, Guangzhou 510006, Guangdong, Peoples R China
Sun Yat Sen Univ, Sch Data & Comp Sci, 132 East Circle, Guangzhou 510006, Guangdong, Peoples R ChinaSun Yat Sen Univ, Sch Pharmaceut Sci, 132 East Circle, Guangzhou 510006, Guangdong, Peoples R China
Wu, Di
Xu, Jun
论文数: 0引用数: 0
h-index: 0
机构:
Sun Yat Sen Univ, Sch Pharmaceut Sci, 132 East Circle, Guangzhou 510006, Guangdong, Peoples R China
Sun Yat Sen Univ, Sch Data & Comp Sci, 132 East Circle, Guangzhou 510006, Guangdong, Peoples R China
Wuyi Univ, Sch Comp Sci & Technol, 99 Yingbin Rd, Jiangmen 529020, Peoples R ChinaSun Yat Sen Univ, Sch Pharmaceut Sci, 132 East Circle, Guangzhou 510006, Guangdong, Peoples R China
机构:
School of Artificial Intelligence and Data Science, Hebei University of Technology, Tianjin,300401, ChinaSchool of Artificial Intelligence and Data Science, Hebei University of Technology, Tianjin,300401, China
Tian, Hongli
Cui, Yao
论文数: 0引用数: 0
h-index: 0
机构:
School of Artificial Intelligence and Data Science, Hebei University of Technology, Tianjin,300401, ChinaSchool of Artificial Intelligence and Data Science, Hebei University of Technology, Tianjin,300401, China
Cui, Yao
Yan, Huiqiang
论文数: 0引用数: 0
h-index: 0
机构:
School of Economics and Management, Hebei University of Technology, Tianjin,300401, ChinaSchool of Artificial Intelligence and Data Science, Hebei University of Technology, Tianjin,300401, China
机构:
Beijing Univ Technol, Fac Informat Technol, Beijing 100124, Peoples R ChinaBeijing Univ Technol, Fac Informat Technol, Beijing 100124, Peoples R China
Lin, Yongze
Bi, Jing
论文数: 0引用数: 0
h-index: 0
机构:
Beijing Univ Technol, Fac Informat Technol, Beijing 100124, Peoples R ChinaBeijing Univ Technol, Fac Informat Technol, Beijing 100124, Peoples R China
Bi, Jing
Yuan, Haitao
论文数: 0引用数: 0
h-index: 0
机构:
Beihang Univ, Sch Automat Sci & Elect Engn, Beijing 100191, Peoples R ChinaBeijing Univ Technol, Fac Informat Technol, Beijing 100124, Peoples R China
Yuan, Haitao
论文数: 引用数:
h-index:
机构:
Wang, Gongming
Zhou, Mengchu
论文数: 0引用数: 0
h-index: 0
机构:
New Jersey Inst Technol, Dept Elect & Comp Engn, Newark, NJ 07102 USA
King Abdulaziz Univ, Ctr Res Excellence Renewable Energy & Power Syst, Jeddah 21589, Saudi ArabiaBeijing Univ Technol, Fac Informat Technol, Beijing 100124, Peoples R China
机构:
College of Electrical and Information Engineering, Lanzhou University of Technology, Gansu, Lanzhou,730050, China
College of Electrical Engineering, Northwest Minzu University, Gansu, Lanzhou,730030, ChinaCollege of Electrical and Information Engineering, Lanzhou University of Technology, Gansu, Lanzhou,730050, China
Xiao, Wenjuan
Wang, Xiaoming
论文数: 0引用数: 0
h-index: 0
机构:
College of Electrical and Information Engineering, Lanzhou University of Technology, Gansu, Lanzhou,730050, ChinaCollege of Electrical and Information Engineering, Lanzhou University of Technology, Gansu, Lanzhou,730050, China