Priors Guided Extreme Underwater Image Compression for Machine Vision and Human Vision

被引:2
|
作者
Fang, Zhengkai [1 ]
Shen, Liquan [2 ]
Li, Mengyao [1 ]
Wang, Zhengyong [1 ]
Jin, Yanliang [1 ]
机构
[1] Shanghai Univ, Sch Commun & Informat Engn, Shanghai 200444, Peoples R China
[2] Shanghai Univ, Key Lab Specialty Fiber Opt & Opt Access Networks, Joint Int Res Lab Specialty Fiber Opt & Adv Commun, Shanghai 200444, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature enhance; generative compression; scalable coding; underwater image compression; EFFICIENCY;
D O I
10.1109/JOE.2023.3235058
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
A low bit-rate compression is required for underwater images due to the limited bandwidth in underwater acoustic communication, which limits performances of both machine analysis and human perception in most underwater applications. Few existing compression methods consider the unique characteristics of underwater images such as color shift and haze effect to better fulfill requirements of various applications under low bit-rates. To address this problem, we propose a novel extreme underwater image compression framework, which can provide scalability to support machine vision and human vision with the assistance of underwater priors. Specifically, the base layer is composed of a feature extractor and a generator, where global structural edges and high-level features of regions with a significant impact on machine analysis are extracted and used for reconstructing a feature-matching image for analysis purpose. Considering the negative influence of underwater imaging processes on machine vision, in this article, a feature degradation removal module guided by underwater priors is proposed to alleviate feature-level degradation via taking analysis-friendly enhanced images as auxiliary information. As for the enhancement layer aiming for human vision, the residual between the original image and the reconstruction from base layer is compressed. A feature attention block and a background light recovery block are designed utilizing features extracted from enhanced images and the underwater before further recovering the original scene with a good perception quality under low bit-rates. Experimental results demonstrate the superiority of our framework in both machine vision tasks and perception quality compared with traditional compression methods and learned-based methods.
引用
收藏
页码:888 / 902
页数:15
相关论文
共 50 条
  • [1] Prior-Guided Contrastive Image Compression for Underwater Machine Vision
    Fang, Zhengkai
    Shen, Liquan
    Li, Mengyao
    Wang, Zhengyong
    Jin, Yanliang
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (06) : 2950 - 2961
  • [2] Deep underwater image compression for enhanced machine vision applications
    Zhang, Hanshu
    Fan, Suzhen
    Zou, Shuo
    Yu, Zhibin
    Zheng, Bing
    FRONTIERS IN MARINE SCIENCE, 2024, 11
  • [3] Extreme Underwater Image Compression Using Physical Priors
    Li, Mengyao
    Shen, Liquan
    Lin, Yufei
    Wang, Kun
    Chen, Jinbo
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (04) : 1937 - 1951
  • [4] Group Image Compression for Dual Use of Machine and Human Vision
    Fang, Xin
    Wu, Xiaolin
    Li, Fan
    Duan, Yiping
    Tao, Xiaoming
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2025, 35 (03) : 2820 - 2831
  • [5] ICMH-Net: Neural Image Compression Towards both Machine Vision and Human Vision
    Liu, Lei
    Hu, Zhihao
    Chen, Zhenghao
    Xu, Dong
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 8047 - 8056
  • [6] Preprocessing Enhanced Image Compression for Machine Vision
    Lu, Guo
    Ge, Xingtong
    Zhong, Tianxiong
    Hu, Qiang
    Geng, Jing
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (12) : 13556 - 13568
  • [7] Image Compression for Machine and Human Vision with Spatial-Frequency Adaptation
    Li, Han
    Li, Shaohui
    Ding, Shuangrui
    Dai, Wenrui
    Cao, Maida
    Li, Chenglin
    Zou, Junni
    Xiong, Hongkai
    COMPUTER VISION - ECCV 2024, PT LI, 2025, 15109 : 382 - 399
  • [8] Slimmable Multi-Task Image Compression for Human and Machine Vision
    Cao, Jiangzhong
    Yao, Ximei
    Zhang, Huan
    Jin, Jian
    Zhang, Yun
    Ling, Bingo Wing-Kuen
    IEEE ACCESS, 2023, 11 : 29946 - 29958
  • [9] MAGIC: Machine-Learning-Guided Image Compression for Vision Applications in Internet of Things
    Chakraborty, Prabuddha
    Cruz, Jonathan
    Bhunia, Swarup
    IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (09) : 7303 - 7315
  • [10] Opponent color, human vision and wavelets for image compression
    Nadenau, MJ
    Reichel, J
    SEVENTH COLOR IMAGING CONFERENCE: COLOR SCIENCE, SYSTEMS AND APPLICATIONS: PUTTING IT ALL TOGETHER, 1999, : 237 - 242