Multimodal Deep Learning in Semantic Image Segmentation: A Review

被引:4
|
作者
Raman, Vishal [1 ]
Kumari, Madhu [1 ]
机构
[1] NIT Hamirpur, Hamirpur, Himachal Prades, India
关键词
Multimodal learning; semantic image segmentation; deep learning; NETWORKS;
D O I
10.1145/3291064.3291067
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In recent years, there has been a lot of research in the area of semantic image segmentation, which involves breaking down an image into its discrete components, such that humans can give meaning to its contents. From the humble beginnings of image search using human-provided captions, content-based image retrieval has come a long way. Yet, areas of research and improvement are far from diminishing. In this paper we will take a look at how multi-modal approaches to semantic image segmentation are setting the new standard in image search and retrieval.
引用
收藏
页码:7 / 11
页数:5
相关论文
共 50 条
  • [41] A Systematic Literature Review on Machine Learning and Deep Learning Methods for Semantic Segmentation
    Sohail, Ali
    Nawaz, Naeem A. A.
    Shah, Asghar Ali
    Rasheed, Saim
    Ilyas, Sheeba
    Ehsan, Muhammad Khurram
    [J]. IEEE ACCESS, 2022, 10 : 134557 - 134570
  • [42] Multimodal image semantic segmentation based on attention mechanism
    Zhang Ji-you
    Zhang Rong-fen
    Liu Yu-hong
    Yuan Wen-hao
    [J]. CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2023, 38 (07) : 975 - 984
  • [43] A SEGMENTATION BASED ROBUST DEEP LEARNING FRAMEWORK FOR MULTIMODAL RETINAL IMAGE REGISTRATION
    Wang, Yiqian
    Zhang, Junkang
    An, Cheolhong
    Cavichini, Melina
    Jhingan, Mahima
    Amador-Patarroyo, Manuel J.
    Long, Christopher P.
    Bartsch, Dirk-Uwe G.
    Freeman, William R.
    Nguyen, Truong Q.
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 1369 - 1373
  • [44] Deep Multimodal Fusion Network for Semantic Segmentation Using Remote Sensing Image and LiDAR Data
    Sun, Yangjie
    Fu, Zhongliang
    Sun, Chuanxia
    Hu, Yinglei
    Zhang, Shengyuan
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [45] Review of Real-Time Semantic Segmentation Algorithms for Deep Learning
    He, Jiafeng
    Chen, Hongwei
    Luo, Dehan
    [J]. Computer Engineering and Applications, 2023, 59 (08) : 13 - 27
  • [46] A review of deep learning methods for semantic segmentation of remote sensing imagery
    Yuan, Xiaohui
    Shi, Jianfang
    Gu, Lichuan
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2021, 169
  • [47] A Review of Deep Learning-Based Semantic Segmentation for Point Cloud
    Zhang, Jiaying
    Zhao, Xiaoli
    Chen, Zheng
    Lu, Zhejun
    [J]. IEEE ACCESS, 2019, 7 : 179118 - 179133
  • [48] Research on Semantic Segmentation Method of Urban Streetscape Image Based on Deep Learning
    Gan Peixin
    Luo Xiaoyan
    Liu Bo
    Li Lu
    Shi Xiaofeng
    [J]. SEVENTH ASIA PACIFIC CONFERENCE ON OPTICS MANUFACTURE (APCOM 2021), 2022, 12166
  • [49] MwUnet: A semantic segmentation deep learning method for the ultrasonic image of hydronephrosis in children
    Peng, Haoran
    Guan, Yu
    Li, Jianqiang
    Xu, Xi
    Wen, Pengceng
    Yang, Jijiang
    Jia, Yanhe
    Xie, Xianghui
    Li, Minglei
    Wang, Xiaoman
    Xin, Yue
    He, Yuzhu
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2021, : 1894 - 1899
  • [50] Combining deep learning and ontology reasoning for remote sensing image semantic segmentation
    Li, Yansheng
    Ouyang, Song
    Zhang, Yongjun
    [J]. KNOWLEDGE-BASED SYSTEMS, 2022, 243