SPINet: self-supervised point cloud frame interpolation network

被引:3
|
作者
Xu, Jiawen [1 ]
Le, Xinyi [2 ,3 ,4 ]
Chen, Cailian [2 ,3 ,4 ]
Guan, Xinping [2 ,3 ,4 ]
机构
[1] Shanghai Jiao Tong Univ, Sch Mech Engn, Shanghai 200240, Peoples R China
[2] Shanghai Jiao Tong Univ, Dept Automat, Shanghai 200240, Peoples R China
[3] Minist Educ China, Key Lab Syst Control & Informat Proc, Shanghai 200240, Peoples R China
[4] Shanghai Engn Res Ctr Intelligent Control & Manag, Shanghai 200240, Peoples R China
来源
NEURAL COMPUTING & APPLICATIONS | 2023年 / 35卷 / 14期
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Deep learning on point cloud; Frame interpolation; Self-supervised learning; 3D scene flow; Attention on point cloud;
D O I
10.1007/s00521-022-06939-6
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
For autonomous vehicles, the acquisition frequency difference between LiDAR (10-20 Hz) and camera (over 100 Hz) makes simultaneous update of two perceptive systems (2D/3D) less efficient. Nowadays, frame interpolation is in urgent need for increasing frame rate of point cloud sequences obtained by LiDAR. However, a major limitation of current full supervised methods is that high frame rate ground truth sequences are hard to access. We propose a novel Self-supervised Point Cloud Frame Interpolation Network (SPINet) accommodating with variable motion situation, retaining geometric consistency, but without the necessity of utilizing G.T. data. Extensive experiments show that our proposed SPINet outperforms the current full supervised methods.
引用
收藏
页码:9951 / 9960
页数:10
相关论文
共 50 条
  • [41] ExpPoint-MAE: Better Interpretability and Performance for Self-Supervised Point Cloud Transformers
    Romanelis, Ioannis
    Fotis, Vlassis
    Moustakas, Konstantinos
    Munteanu, Adrian
    [J]. IEEE ACCESS, 2024, 12 : 53565 - 53578
  • [42] A SELF-SUPERVISED NETWORK EMBEDDING METHOD
    Wang, Dongqi
    Chen, Xin
    Chen, Dongming
    [J]. JOURNAL OF NONLINEAR AND CONVEX ANALYSIS, 2022, 23 (10) : 2319 - 2328
  • [43] Multi-Frame Self-Supervised Depth with Transformers
    Guizilini, Vitor
    Ambrus, Rares
    Chen, Dian
    Zakharov, Sergey
    Gaidon, Adrien
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 160 - 170
  • [44] Regeneration-Constrained Self-Supervised Seismic Data Interpolation
    Song, Aoqi
    Wang, Changpeng
    Zhang, Chunxia
    Zhang, Jiangshe
    Xiong, Deng
    Wei, Xiaoli
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [45] Self-Supervised Learning for Efficient Antialiasing Seismic Data Interpolation
    Yuan, Pengyu
    Wang, Shirui
    Hu, Wenyi
    Nadukandi, Prashanth
    Botero, German Ocampo
    Wu, Xuqing
    Hien Van Nguyen
    Chen, Jiefu
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [46] Self-Supervised Seismic Data Interpolation via Frequency Extrapolation
    Mo, Tongtong
    Sun, Xueyi
    Wang, Benfeng
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [47] Self-supervised rotation-equivariant spherical vector network for learning canonical 3D point cloud orientation
    Chen, Hao
    Zhao, Jieyu
    Chen, Kangxin
    Chen, Yu
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 128
  • [48] Irregularly sampled seismic data interpolation with self-supervised learning
    Fang, Wenqian
    Fu, Lihua
    Wu, Mengyi
    Yue, Jingnan
    Li, Hongwei
    [J]. GEOPHYSICS, 2023, 88 (03) : V175 - V185
  • [49] Masked Spatio-Temporal Structure Prediction for Self-supervised Learning on Point Cloud Videos
    Shen, Zhiqiang
    Sheng, Xiaoxiao
    Fan, Hehe
    Wang, Longguang
    Guo, Yulan
    Liu, Qiong
    Wen, Hao
    Zhou, Xi
    [J]. 2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 16534 - 16543
  • [50] GeoMAE: Masked Geometric Target Prediction for Self-supervised Point Cloud Pre-Training
    Tian, Xiaoyu
    Ran, Haoxi
    Wang, Yue
    Zhao, Hang
    [J]. 2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 13570 - 13580