Automated Generation of Chinese Text-Image Summaries Using Deep Learning Techniques

被引:0
|
作者
Xu, Meiling [1 ,2 ]
Abd Rahman, Hayati [1 ]
Li, Feng [1 ,2 ]
机构
[1] Univ Teknol MARA, Coll Comp Informat & Math, Shah Alam 40450, Malaysia
[2] Hebei Finance Univ, Coll Comp & Informat Engn, Baoding 071051, Peoples R China
关键词
Chinese text-image summaries; automated summary generation; deep learning; MaliGAN; cross-modal similarity retrieval; adaptive fusion strategy;
D O I
10.18280/ts.400644
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the era of the internet, an abundance of Chinese text-image content is continuously produced, necessitating effective automated technologies for processing and summarizing these materials. Automated generation of Chinese text-image summaries facilitates rapid comprehension of key information, thereby enhancing the efficiency of information consumption. Due to the unique characteristics of the Chinese language, traditional automatic summarization techniques are inadequately transferable, prompting the development of text-image summary generation technologies tailored to Chinese features. Research indicates that while existing natural language processing and deep learning techniques have made strides in text summarization, deficiencies remain in the deep semantic mining and integration of text-image content. This study primarily focuses on two aspects: Firstly, a generative approach based on an enhanced MaliGAN model, employing deep learning models to improve text generation quality. Secondly, a retrieval-based approach, utilizing cross-modal similarity retrieval to extract text information most relevant to the image content, guiding summary generation. Additionally, this study innovatively proposes a model architecture comprising segmentation, cross-modal retrieval, and adaptive fusion strategy modules, significantly augmenting the accuracy and reliability of text-image summary generation.
引用
收藏
页码:2835 / 2843
页数:9
相关论文
共 50 条
  • [21] The Importance of the Depth for Text-Image Selection Strategy in Learning-To-Rank
    Buffoni, David
    Tollari, Sabrina
    Gallinari, Patrick
    ADVANCES IN INFORMATION RETRIEVAL, 2011, 6611 : 743 - 746
  • [22] Image DeHazing Using Deep Learning Techniques
    Choudhary, Ravi Raj
    Jisnu, K. K.
    Meena, Gaurav
    INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND DATA SCIENCE, 2020, 167 : 1110 - 1119
  • [23] Text-Image Theory: Comparative Semiotic Studies on Chinese Traditional Literature and Arts
    Yingzi, Wang
    Xianzhang, Zhao
    CRITICAL ARTS-SOUTH-NORTH CULTURAL AND MEDIA STUDIES, 2023, 37 (04): : 114 - 115
  • [24] Image Description Generation Using Deep Learning
    Supe, Neha
    Patil, Deepti
    Mahadevan, Revathi
    Pandhre, Tanvi
    Joshi, Bharti
    INVENTIVE COMMUNICATION AND COMPUTATIONAL TECHNOLOGIES, ICICCT 2019, 2020, 89 : 1239 - 1244
  • [25] Complementary or Substitutive? A Novel Deep Learning Method to Leverage Text-image Interactions for Multimodal Review Helpfulness Prediction
    Xiao, Shuaiyong
    Chen, Gang
    Zhang, Chenghong
    Li, Xiangge
    EXPERT SYSTEMS WITH APPLICATIONS, 2022, 208
  • [26] Contrastive completing learning for practical text-image person ReID: Robuster and cheaper
    Du, Guodong
    Gong, Tiantian
    Zhang, Liyan
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 248
  • [27] Authorship Detection on Classical Chinese Text Using Deep Learning
    Zhao, Lingmei
    Shi, Jianjun
    Zhang, Chenkai
    Liu, Zhixiang
    APPLIED SCIENCES-BASEL, 2025, 15 (04):
  • [28] Extractive Text-Image Summarization Using Multi-Modal RNN
    Chen, Jingqiang
    Hai Zhuge
    2018 14TH INTERNATIONAL CONFERENCE ON SEMANTICS, KNOWLEDGE AND GRIDS (SKG), 2018, : 245 - 248
  • [29] A deep learning approach for image and text classification using neutrosophy
    Wajid M.A.
    Zafar A.
    Wajid M.S.
    International Journal of Information Technology, 2024, 16 (2) : 853 - 859
  • [30] Text-to-Microstructure Generation Using Generative Deep Learning
    Zheng, Xiaoyang
    Watanabe, Ikumu
    Paik, Jamie
    Li, Jingjing
    Guo, Xiaofeng
    Naito, Masanobu
    SMALL, 2024, 20 (37)