Self-Supervised Marine Video Analysis via Siamese Network

被引:0
|
作者
Liang, Ju [1 ]
Song, Jihan [1 ,2 ]
Li, Qianqian [1 ]
Shi, Zhensheng [1 ,3 ]
Gu, Zhaorui [1 ]
Zheng, Haiyong [1 ]
Zheng, Bing [1 ,4 ]
机构
[1] Ocean Univ China, Underwater Vis Lab Ouc Ai, Qingdao, Peoples R China
[2] Ocean Univ China, Coll Informat Sci & Engn, Qingdao, Peoples R China
[3] Ocean Univ China, Frontiers Sci Ctr Deep Ocean Multispheres & Earth, Qingdao, Peoples R China
[4] Ocean Univ China, Sanya Oceanog Inst, Qingdao, Peoples R China
基金
中国国家自然科学基金;
关键词
Self-supervised learning; Marine video analysis; Siamese network; Marine organism detection; Marine scene recognition; Marine organism action recognition; SCENE;
D O I
暂无
中图分类号
U6 [水路运输]; P75 [海洋工程];
学科分类号
0814 ; 081505 ; 0824 ; 082401 ;
摘要
At present, advanced equipment has provided strong data support for marine scientific research. However, it is unrealistic to rely on manpower analysis to analyze the huge amount of data. Therefore, it is an effective and good method to use computer vision method to automatically identify and analyze marine video. In this paper, a self-supervised learning method based on siamese network is designed to learn the effective visual representation in marine unlabeled video, and the model is transferred to three downstream tasks: marine organism action recognition, marine organism detection, and marine scene recognition. We are on the latest dataset to experiment to evaluation the effectiveness of our method. Experimental results show that our method has certain competitiveness and effectiveness in the three downstream tasks.
引用
收藏
页数:7
相关论文
共 50 条
  • [41] Self-supervised deep partial adversarial network for micro-video multimodal classification
    Li, Yun
    Liu, Shuyi
    Wang, Xuejun
    Jing, Peiguang
    [J]. INFORMATION SCIENCES, 2023, 630 : 356 - 369
  • [42] Continuous frame motion sensitive self-supervised collaborative network for video representation learning
    Bi, Shuai
    Hu, Zhengping
    Zhao, Mengyao
    Zhang, Hehao
    Di, Jirui
    Sun, Zhe
    [J]. ADVANCED ENGINEERING INFORMATICS, 2023, 56
  • [43] Deep Discriminative Supervised Hashing via Siamese Network
    Li, Yang
    Miao, Zhuang
    Wang, Jiabao
    Zhang, Yafei
    Li, Hang
    [J]. IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2017, E100D (12) : 3036 - 3040
  • [44] Self-Supervised Scene-Debiasing for Video Representation Learning via Background Patching
    Assefa, Maregu
    Jiang, Wei
    Gedamu, Kumie
    Yilma, Getinet
    Kumeda, Bulbula
    Ayalew, Melese
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 5500 - 5515
  • [45] SOFT: Self-supervised sparse Optical Flow Transformer for video stabilization via quaternion
    Wang, Naiyao
    Zhou, Changdong
    Zhu, Rongfeng
    Zhang, Bo
    Wang, Ye
    Liu, Hongbo
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 130
  • [46] Facial Video-Based Remote Physiological Measurement via Self-Supervised Learning
    Yue, Zijie
    Shi, Miaojing
    Ding, Shuai
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (11) : 13844 - 13859
  • [47] Consistent 3D Hand Reconstruction in Video via Self-Supervised Learning
    Tu, Zhigang
    Huang, Zhisheng
    Chen, Yujin
    Kang, Di
    Bao, Linchao
    Yang, Bisheng
    Yuan, Junsong
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (08) : 9469 - 9485
  • [48] Self-supervised Video Representation Learning via Capturing Semantic Changes Indicated by Saccades
    Lai Q.
    Zeng A.
    Wang Y.
    Cao L.
    Li Y.
    Xu Q.
    [J]. IEEE Transactions on Circuits and Systems for Video Technology, 2024, 34 (08) : 1 - 1
  • [49] Foundation Model for Endoscopy Video Analysis via Large-Scale Self-supervised Pre-train
    Wang, Zhao
    Liu, Chang
    Zhang, Shaoting
    Dou, Qi
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023, PT IX, 2023, 14228 : 101 - 111
  • [50] Contrast and Order Representations for Video Self-supervised Learning
    Hu, Kai
    Shao, Jie
    Liu, Yuan
    Raj, Bhiksha
    Savvides, Marios
    Shen, Zhiqiang
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 7919 - 7929