Low-light wheat image enhancement using an explicit inter-channel sparse transformer

被引:1
|
作者
Wang, Yu [1 ]
Wang, Fei [2 ]
Li, Kun [2 ]
Feng, Xuping [3 ]
Hou, Wenhui [1 ]
Liu, Lu [1 ]
Chen, Liqing [1 ]
He, Yong [3 ]
Wang, Yuwei [1 ]
机构
[1] Anhui Agr Univ, Coll Engn, Hefei 230036, Peoples R China
[2] Hefei Univ Technol, Sch Comp Sci & Informat Engn, Hefei 230601, Peoples R China
[3] Zhejiang Univ, Coll Biosyst Engn & Food Sci, Hangzhou 310058, Zhejiang, Peoples R China
关键词
Wheat ears detection; Low -light enhancement; Deep learning; Sparse transformer; Top; k operator;
D O I
10.1016/j.compag.2024.109169
中图分类号
S [农业科学];
学科分类号
09 ;
摘要
Low -light image enhancement poses a significant challenge in agricultural settings, particularly for time -series captured wheat images. The use of time -series captured image data can improve the accuracy of wheat yield prediction by analyzing the growth status and characteristics of wheat. Given the difficulty of capturing paired wheat images in various lighting conditions, a method based on the Global Wheat Head Detection (GWHD) dataset is presented to synthesize pairs of low-light/normal-light wheat images. This approach expands to create a new dataset, LN-GWHD, specifically for the task of enhancing wheat images in low -light conditions. Importantly, it enables a more extensive evaluation of wheat image restoration tasks and performance accuracy under more controlled and diverse conditions. It is worth noting that this method can be extended to a wide range of scenarios for the enhancement of low -light situations. Where low -light conditions are common due to various factors such as weather, existing methods based on the transformer architecture have achieved state-of-the-art (SOTA) enhancement performance by capturing relationships between low -light feature channels. However, these approaches perform the similarity computation on all tokens and may introduce redundant features, limiting their ability to focus on critical information for high -quality image reconstruction. To recover more highquality wheat image information, the explicit inter -channel sparse transformer (EIST) network is proposed, which is specifically designed to recover wheat images under low -light conditions. EIST comprises multiple blocks, each featuring explicit sparse top - k attention (ESTA) and bilateral gated feed -forward network (BGFN). ESTA dynamically selects the most critical information by focusing on the top - k key labels in each query, while BGFN enhances valid information interaction through re -double filtering. The overall architecture employs transformers to learn correlations and features between different image channels, resulting in noise reduction, detail enhancement, and improved clarity. Additionally, the Fourier spectrum loss is introduced to constrain the image reconstruction in the frequency domain, allowing more detailed information to be recovered. Extensive experiments on the LN-GWHD datasets demonstrate that EIST surpasses SOTA methods. Furthermore, our approach achieves superior results in detecting low -light wheat ears during back -end evaluation.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Low-light image enhancement using transformer with color fusion and channel attention
    Sun, Yinbang
    Sun, Jing
    Sun, Fuming
    Wang, Fasheng
    Li, Haojie
    [J]. JOURNAL OF SUPERCOMPUTING, 2024, 80 (13): : 18365 - 18391
  • [2] A Single Image Enhancement using Inter-channel Correlation
    Kim, Jin
    Jeong, Soowoong
    Kim, Yong-Ho
    Lee, Sangkeun
    [J]. 2012 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS (ICCE), 2012, : 496 - 497
  • [3] LET: a local enhancement transformer for low-light image enhancement
    Pan, Lei
    Tian, Jun
    Zheng, Yuan
    Fu, Qiang
    Zhao, Zhiqing
    [J]. JOURNAL OF ELECTRONIC IMAGING, 2024, 33 (02)
  • [4] LiCENt: Low-Light Image Enhancement Using the Light Channel of HSL
    Garg, Atik
    Pan, Xin-Wen
    Dung, Lan-Rong
    [J]. IEEE ACCESS, 2022, 10 : 33547 - 33560
  • [5] Low-light image enhancement with geometrical sparse representation
    Jin Tan
    Taiping Zhang
    Linchang Zhao
    Darong Huang
    Zhenyuan Zhang
    [J]. Applied Intelligence, 2023, 53 : 11019 - 11033
  • [6] LIELFormer: Low-Light Image Enhancement with a Lightweight Transformer
    Zhao, Wei
    Xie, Zhaoyang
    Huang, Lina
    [J]. ADVANCES IN COMPUTER GRAPHICS, CGI 2023, PT I, 2024, 14495 : 489 - 500
  • [7] Low-light image enhancement with geometrical sparse representation
    Tan, Jin
    Zhang, Taiping
    Zhao, Linchang
    Huang, Darong
    Zhang, Zhenyuan
    [J]. APPLIED INTELLIGENCE, 2023, 53 (09) : 11019 - 11033
  • [8] Unsupervised Low-Light Image Enhancement Using Bright Channel Prior
    Lee, Hunsang
    Sohn, Kwanghoon
    Min, Dongbo
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2020, 27 (251-255) : 251 - 255
  • [9] LOW-LIGHT IMAGE ENHANCEMENT USING CNN AND BRIGHT CHANNEL PRIOR
    Tao, Li
    Zhu, Chuang
    Song, Jiawen
    Lu, Tao
    Jia, Huizhu
    Xie, Xiaodong
    [J]. 2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 3215 - 3219
  • [10] Adaptive lightweight Transformer network for low-light image enhancement
    Meng, De
    Lei, Zhichun
    [J]. SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (6-7) : 5365 - 5375