Oppositional Harris Hawks Optimization with Deep Learning-Based Image Captioning

被引:0
|
作者
Kavitha, V. R. [1 ]
Nimala, K. [2 ]
Beno, A. [3 ]
Ramya, K. C. [4 ]
Kadry, Seifedine [5 ]
Kang, Byeong-Gwon [6 ]
Nam, Yunyoung [7 ]
机构
[1] Prathyusha Engn Coll, Dept Comp Sci & Engn, Thiruvallur 602025, India
[2] SRM Inst Sci & Technol, Dept Networking & Commun, Chennai, Tamil Nadu, India
[3] Dr Sivanthi Aditanar Coll Engn, Dept Elect & Commun Engn, Tiruchendur 628215, India
[4] Sri Krishna Coll Engn & Technol, Dept Elect & Elect Engn, Coimbatore 641008, Tamil Nadu, India
[5] Noroff Univ Coll, Dept Appl Data Sci, Kristiansand, Norway
[6] Soonchunhyang Univ, Dept Informat & Commun Engn, Asan, South Korea
[7] Soonchunhyang Univ, Dept Comp Sci & Engn, Asan, South Korea
来源
关键词
Image captioning; natural language processing; artificial intelligence; machine learning; deep learning; FUSION;
D O I
10.32604/csse.2023.024553
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Image Captioning is an emergent topic of research in the domain of artificial intelligence (AI). It utilizes an integration of Computer Vision (CV) and Natural Language Processing (NLP) for generating the image descriptions. It finds use in several application areas namely recommendation in editing applications, utilization in virtual assistance, etc. The development of NLP and deep learning (DL) models find useful to derive a bridge among the visual details and textual semantics. In this view, this paper introduces an Oppositional Harris Hawks Optimization with Deep Learning based Image Captioning (OHHODLIC) technique. The OHHO-DLIC technique involves the design of distinct levels of pre-processing. Moreover, the feature extraction of the images is carried out by the use of EfficientNet model. Furthermore, the image captioning is performed by bidirectional long short term memory (BiLSTM) model, comprising encoder as well as decoder. At last, the oppositional Harris Hawks optimization (OHHO) based hyperparameter tuning process is performed for effectively adjusting the hyperparameter of the EfficientNet and BiLSTM models. The experimental analysis of the OHHO-DLIC technique is carried out on the Flickr 8k Dataset and a comprehensive comparative analysis highlighted the better performance over the recent approaches.
引用
收藏
页码:579 / 593
页数:15
相关论文
共 50 条
  • [1] Deep learning-based robust medical image watermarking exploiting DCT and Harris hawks optimization
    Chacko, Anusha
    Chacko, Shanty
    [J]. INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2022, 37 (08) : 4810 - 4844
  • [2] Improving Deep Learning-Based Recommendation Attack Detection Using Harris Hawks Optimization
    Zhou, Quanqiang
    Huang, Cheng
    Duan, Liangliang
    [J]. APPLIED SCIENCES-BASEL, 2022, 12 (19):
  • [3] Deep learning-based solar image captioning
    Baek, Ji-Hye
    Kim, Sujin
    Choi, Seonghwan
    Park, Jongyeob
    Kim, Dongil
    [J]. ADVANCES IN SPACE RESEARCH, 2024, 73 (06) : 3270 - 3281
  • [4] Multi-Strategy Enhanced Harris Hawks Optimization for Global Optimization and Deep Learning-Based Channel Estimation Problems
    Sun, Yunshan
    Huang, Qian
    Liu, Ting
    Cheng, Yuetong
    Li, Yanqin
    [J]. MATHEMATICS, 2023, 11 (02)
  • [5] Deep Reinforcement Learning-based Image Captioning with Embedding Reward
    Ren, Zhou
    Wang, Xiaoyu
    Zhang, Ning
    Lv, Xutao
    Li, Li-Jia
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 1151 - 1159
  • [6] From Show to Tell: A Survey on Deep Learning-Based Image Captioning
    Stefanini, Matteo
    Cornia, Marcella
    Baraldi, Lorenzo
    Cascianelli, Silvia
    Fiameni, Giuseppe
    Cucchiara, Rita
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (01) : 539 - 559
  • [7] An enhanced version of Harris Hawks Optimization by dimension learning-based hunting for Breast Cancer Detection
    Navneet Kaur
    Lakhwinder Kaur
    Sikander Singh Cheema
    [J]. Scientific Reports, 11
  • [8] An enhanced version of Harris Hawks Optimization by dimension learning-based hunting for Breast Cancer Detection
    Kaur, Navneet
    Kaur, Lakhwinder
    Cheema, Sikander Singh
    [J]. SCIENTIFIC REPORTS, 2021, 11 (01)
  • [9] Crop Disease Diagnosis with Deep Learning-Based Image Captioning and Object Detection
    Lee, Dong In
    Lee, Ji Hwan
    Jang, Seung Ho
    Oh, Se Jong
    Doo, Ill Chul
    [J]. APPLIED SCIENCES-BASEL, 2023, 13 (05):
  • [10] Automated Video-Based Face Detection Using Harris Hawks Optimization with Deep Learning
    Almuqren, Latifah
    Hamza, Manar Ahmed
    Mohamed, Abdullah
    Abdelmageed, Amgad Atta
    [J]. CMC-COMPUTERS MATERIALS & CONTINUA, 2023, 75 (03): : 4917 - 4933