Self-Supervised Marine Video Analysis via Siamese Network

被引:0
|
作者
Liang, Ju [1 ]
Song, Jihan [1 ,2 ]
Li, Qianqian [1 ]
Shi, Zhensheng [1 ,3 ]
Gu, Zhaorui [1 ]
Zheng, Haiyong [1 ]
Zheng, Bing [1 ,4 ]
机构
[1] Ocean Univ China, Underwater Vis Lab Ouc Ai, Qingdao, Peoples R China
[2] Ocean Univ China, Coll Informat Sci & Engn, Qingdao, Peoples R China
[3] Ocean Univ China, Frontiers Sci Ctr Deep Ocean Multispheres & Earth, Qingdao, Peoples R China
[4] Ocean Univ China, Sanya Oceanog Inst, Qingdao, Peoples R China
基金
中国国家自然科学基金;
关键词
Self-supervised learning; Marine video analysis; Siamese network; Marine organism detection; Marine scene recognition; Marine organism action recognition; SCENE;
D O I
暂无
中图分类号
U6 [水路运输]; P75 [海洋工程];
学科分类号
0814 ; 081505 ; 0824 ; 082401 ;
摘要
At present, advanced equipment has provided strong data support for marine scientific research. However, it is unrealistic to rely on manpower analysis to analyze the huge amount of data. Therefore, it is an effective and good method to use computer vision method to automatically identify and analyze marine video. In this paper, a self-supervised learning method based on siamese network is designed to learn the effective visual representation in marine unlabeled video, and the model is transferred to three downstream tasks: marine organism action recognition, marine organism detection, and marine scene recognition. We are on the latest dataset to experiment to evaluation the effectiveness of our method. Experimental results show that our method has certain competitiveness and effectiveness in the three downstream tasks.
引用
收藏
页数:7
相关论文
共 50 条
  • [1] SELF-SUPERVISED SPEAKER VERIFICATION WITH SIMPLE SIAMESE NETWORK AND SELF-SUPERVISED REGULARIZATION
    Sang, Mufan
    Li, Haoqi
    Liu, Fang
    Arnold, Andrew O.
    Wan, Li
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 6127 - 6131
  • [2] Cascaded Siamese Self-supervised Audio to Video GAN
    Aldausari, Nuha
    Sowmya, Arcot
    Marcus, Nadine
    Mohammadi, Gelareh
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 4690 - 4699
  • [3] Self-supervised Siamese Autoencoders
    Baier, Friederike
    Mair, Sebastian
    Fadel, Samuel G.
    [J]. ADVANCES IN INTELLIGENT DATA ANALYSIS XXII, PT I, IDA 2024, 2024, 14641 : 117 - 128
  • [4] Self-supervised Learning for Endoscopic Video Analysis
    Hirsch, Roy
    Caron, Mathilde
    Cohen, Regev
    Livne, Amir
    Shapiro, Ron
    Golany, Tomer
    Goldenberg, Roman
    Freedman, Daniel
    Rivlin, Ehud
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023, PT V, 2023, 14224 : 569 - 578
  • [5] Self-supervised Video Hashing via Bidirectional Transformers
    Li, Shuyan
    Li, Xiu
    Lu, Jiwen
    Zhou, Jie
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 13544 - 13553
  • [6] Siamese Network Based Multiscale Self-Supervised Heterogeneous Graph Representation Learning
    Chen, Zijun
    Luo, Lihui
    Li, Xunkai
    Jiang, Bin
    Guo, Qiang
    Wang, Chunpeng
    [J]. IEEE ACCESS, 2022, 10 : 98490 - 98500
  • [7] Self-supervised Siamese keypoint inference network for human pose estimation and tracking
    Xiangyang Wang
    Yuhui Tian
    Rui Wang
    [J]. Machine Vision and Applications, 2024, 35
  • [8] Self-supervised Siamese keypoint inference network for human pose estimation and tracking
    Wang, Xiangyang
    Tian, Yuhui
    Wang, Rui
    [J]. MACHINE VISION AND APPLICATIONS, 2024, 35 (02)
  • [9] Exploring the Equivalence of Siamese Self-Supervised Learning via A Unified Gradient Framework
    Tao, Chenxin
    Wang, Honghui
    Zhu, Xizhou
    Dong, Jiahua
    Song, Shiji
    Huang, Gao
    Dai, Jifeng
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 14411 - 14420
  • [10] Self-supervised Video Transformer
    Ranasinghe, Kanchana
    Naseer, Muzammal
    Khan, Salman
    Khan, Fahad Shahbaz
    Ryoo, Michael S.
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 2864 - 2874