Facial Wrinkle Detection with Multiscale Spatial Feature Fusion Based on Image Enhancement and ASFF-SEUnet

被引:1
|
作者
Chen, Jiang [1 ]
He, Mingfang [1 ]
Cai, Weiwei [2 ]
机构
[1] Cent South Univ Forestry & Technol, Sch Comp & Informat Engn, Changsha 410004, Peoples R China
[2] Jiangnan Univ, Sch Artificial Intelligence & Comp Sci, Wuxi 214122, Peoples R China
关键词
wrinkle detection; multiscale; image enhancement; Unet; feature fusion;
D O I
10.3390/electronics12244897
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Wrinkles, crucial for age estimation and skin quality assessment, present challenges due to their uneven distribution, varying scale, and sensitivity to factors like lighting. To overcome these challenges, this study presents facial wrinkle detection with multiscale spatial feature fusion based on image enhancement and an adaptively spatial feature fusion squeeze-and-excitation Unet network (ASFF-SEUnet) model. Firstly, in order to improve wrinkle features and address the issue of uneven illumination in wrinkle images, an innovative image enhancement algorithm named Coiflet wavelet transform Donoho threshold and improved Retinex (CT-DIR) is proposed. Secondly, the ASFF-SEUnet model is designed to enhance the accuracy of full-face wrinkle detection across all age groups under the influence of lighting factors. It replaces the encoder part of the Unet network with EfficientNet, enabling the simultaneous adjustment of depth, width, and resolution for improved wrinkle feature extraction. The squeeze-and-excitation (SE) attention mechanism is introduced to grasp the correlation and importance among features, thereby enhancing the extraction of local wrinkle details. Finally, the adaptively spatial feature fusion (ASFF) module is incorporated to adaptively fuse multiscale features, capturing facial wrinkle information comprehensively. Experimentally, the method excels in detecting facial wrinkles amid complex backgrounds, robustly supporting facial skin quality diagnosis and age assessment.
引用
收藏
页数:20
相关论文
共 50 条
  • [21] ACMFNet: Asymmetric Convolutional Feature Enhancement and Multiscale Fusion Network for Change Detection
    Le, Weipeng
    Huang, Liang
    Tang, Bo-Hui
    Tian, Qiuyuan
    Wang, Min
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 6958 - 6971
  • [22] Face Detection and Facial Feature Extraction Based on a Fusion of Knowledge Based Method and Morphological Image Processing
    Devadethan, S.
    Titus, Geevarghese
    Purushothaman, S.
    2014 ANNUAL INTERNATIONAL CONFERENCE ON EMERGING RESEARCH AREAS: MAGNETICS, MACHINES AND DRIVES (AICERA/ICMMD), 2014,
  • [23] Hyperspectral Image Classification Based on Multiscale Spatial Information Fusion
    Li, Hong
    Song, Yalong
    Chen, C. L. Philip
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2017, 55 (09): : 5302 - 5312
  • [24] Underwater Optical Image Enhancement Based on Dominant Feature Image Fusion
    Lin Sen
    Chi Kai-chen
    Li Wen-tao
    Tang Yan-dong
    ACTA PHOTONICA SINICA, 2020, 49 (03)
  • [25] Gaussian Pyramid Based Multiscale Feature Fusion for Hyperspectral Image Classification
    Li, Shutao
    Hao, Qiaobo
    Kang, Xudong
    Benediktsson, Jon Atli
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2018, 11 (09) : 3312 - 3324
  • [26] Feature and Contrast Enhancement of Mammographic Image Based on Multiscale Analysis and Morphology
    Wu, Shibin
    Yu, Shaode
    Yang, Yuhan
    Xie, Yaoqin
    COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE, 2013, 2013
  • [27] Feature and contrast enhancement of mammographic image based on multiscale analysis and morphology
    Wu, Shibin
    Zhu, Qingsong
    Yang, Yuhan
    Xie, Yaoqin
    2013 IEEE INTERNATIONAL CONFERENCE ON INFORMATION AND AUTOMATION (ICIA), 2013, : 521 - 526
  • [28] Self-Attention Guidance and Multiscale Feature Fusion-Based UAV Image Object Detection
    Zhang, Yunzuo
    Wu, Cunyu
    Zhang, Tian
    Liu, Yameng
    Zheng, Yuxin
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [29] FESSD:SSD target detection based on feature fusion and feature enhancement
    Qian, Huaming
    Wang, Huilin
    Feng, Shuai
    Yan, Shuya
    JOURNAL OF REAL-TIME IMAGE PROCESSING, 2023, 20 (01)
  • [30] FESSD:SSD target detection based on feature fusion and feature enhancement
    Huaming Qian
    Huilin Wang
    Shuai Feng
    Shuya Yan
    Journal of Real-Time Image Processing, 2023, 20