A Glimpse of 3D/2D Chest CT Feature Fusion

被引:0
|
作者
Ibrahim, Mohamed Ramzy [1 ]
Fathalla, Karma M. [1 ]
Youssef, Sherin M. [1 ]
机构
[1] Arab Acad Sci Technol & Maritime Transport, Comp Engn Dept, Coll Engn & Technol, Alexandria, Egypt
关键词
deep learning; 3D convolution; feature fusion; computed tomography; COVID-19; COVID-19;
D O I
10.1109/ICMISI61517.2024.10580107
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Prompt diagnosis and severity assessment of respiratory infections in 3D chest volumes of computed tomography (CT) scans is crucial for improving their prognosis. This study introduces an innovative Integrative Computer-Aided Framework (ICAF) to gauge the severity of lung infections from 3D chest scans. ICAF integrates volumetric 3D and traditional 2D features. These 3D features are derived using a designed 3D-Convolution Neural Network (3D-Norm-VGG16) model inspired by literature, while 2D features are obtained via a fuzzy-based Region of Interest (RoI) segmentation. ICAF effectively identifies ground glass opacities (GGO) within 3D CT volumes, offering improved severity analysis. ICAF is therefore applied to categorize the severity of COVID-19. Comprehensive testing on datasets such as MosMedData delivers outstanding performance. It achieved an overall accuracy of 98.40%, average precision, recall, and f1-score of 98.04%, 97.87%, and 97.95%, respectively, surpassing state-of-the-art models.
引用
收藏
页码:15 / 18
页数:4
相关论文
共 50 条
  • [1] Semantic Scene Completion With 2D and 3D Feature Fusion
    Park, Sang-Min
    Ha, Jong-Eun
    [J]. IEEE Access, 2024, 12 : 141594 - 141603
  • [2] 2D facial expression recognition via 3D reconstruction and feature fusion
    Moeini, Ali
    Faez, Karim
    Sadeghi, Hamid
    Moeini, Hossein
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2016, 35 : 1 - 14
  • [3] Hybrid Deep Feature Fusion of 2D CNN and 3D CNN for Vestibule Segmentation from CT Images
    Zhang, Ruicong
    Zhuo, Li
    Chen, Meijuan
    Yin, Hongxia
    Li, Xiaoguang
    Wang, Zhenchang
    [J]. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE, 2022, 2022
  • [4] 2D/3D facial feature extraction
    Akakin, Hatice Cmar
    Salah, Albert Ali
    Akarun, Lale
    Sankur, Bulent
    [J]. IMAGE PROCESSING: ALGORITHMS AND SYSTEMS, NEURAL NETWORKS, AND MACHINE LEARNING, 2006, 6064
  • [5] Robotic Needle Insertion With 2D Ultrasound–3D CT Fusion Guidance
    Lei, Long
    Zhao, Baoliang
    Qi, Xiaozhi
    Mi, Rui
    Ye, Hai
    Zhang, Peng
    Wang, Qiong
    Heng, Pheng-Ann
    Hu, Ying
    [J]. IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2023, 4 (6152-6164) : 1 - 13
  • [6] Automatic Detection of 2D and 3D Lung Nodules in Chest Spiral CT Scans
    El-Baz, Ayman
    Elnakib, Ahmed
    Abou El-Ghar, Mohamed
    Gimel'farb, Georgy
    Falk, Robert
    Farag, Aly
    [J]. INTERNATIONAL JOURNAL OF BIOMEDICAL IMAGING, 2013, 2013
  • [7] Robust multimodal 2D and 3D face authentication using local feature fusion
    Ouamane, A.
    Belahcene, M.
    Benakcha, A.
    Bourennane, S.
    Taleb-Ahmed, A.
    [J]. SIGNAL IMAGE AND VIDEO PROCESSING, 2016, 10 (01) : 129 - 137
  • [8] Robust multimodal 2D and 3D face authentication using local feature fusion
    A. Ouamane
    M. Belahcene
    A. Benakcha
    S. Bourennane
    A. Taleb-Ahmed
    [J]. Signal, Image and Video Processing, 2016, 10 : 129 - 137
  • [9] A 2D/3D Data Fusion with Range Estimation on 2D sensor
    Takashi, Matsuzaki
    Hiroshi, Kameda
    Kazuhiko, Yamamoto
    Tatsuo, Fuji
    Ryoji, Maekawa
    [J]. 2008 PROCEEDINGS OF SICE ANNUAL CONFERENCE, VOLS 1-7, 2008, : 3296 - +
  • [10] 3D reconstruction based on 2D view feature
    Gao, Wei
    Peng, Qunsheng
    [J]. Jisuanji Xuebao/Chinese Journal of Computers, 1999, 22 (05): : 481 - 485