SPINet: self-supervised point cloud frame interpolation network

被引:3
|
作者
Xu, Jiawen [1 ]
Le, Xinyi [2 ,3 ,4 ]
Chen, Cailian [2 ,3 ,4 ]
Guan, Xinping [2 ,3 ,4 ]
机构
[1] Shanghai Jiao Tong Univ, Sch Mech Engn, Shanghai 200240, Peoples R China
[2] Shanghai Jiao Tong Univ, Dept Automat, Shanghai 200240, Peoples R China
[3] Minist Educ China, Key Lab Syst Control & Informat Proc, Shanghai 200240, Peoples R China
[4] Shanghai Engn Res Ctr Intelligent Control & Manag, Shanghai 200240, Peoples R China
来源
NEURAL COMPUTING & APPLICATIONS | 2023年 / 35卷 / 14期
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Deep learning on point cloud; Frame interpolation; Self-supervised learning; 3D scene flow; Attention on point cloud;
D O I
10.1007/s00521-022-06939-6
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
For autonomous vehicles, the acquisition frequency difference between LiDAR (10-20 Hz) and camera (over 100 Hz) makes simultaneous update of two perceptive systems (2D/3D) less efficient. Nowadays, frame interpolation is in urgent need for increasing frame rate of point cloud sequences obtained by LiDAR. However, a major limitation of current full supervised methods is that high frame rate ground truth sequences are hard to access. We propose a novel Self-supervised Point Cloud Frame Interpolation Network (SPINet) accommodating with variable motion situation, retaining geometric consistency, but without the necessity of utilizing G.T. data. Extensive experiments show that our proposed SPINet outperforms the current full supervised methods.
引用
收藏
页码:9951 / 9960
页数:10
相关论文
共 50 条
  • [1] SPINet: self-supervised point cloud frame interpolation network
    Jiawen Xu
    Xinyi Le
    Cailian Chen
    Xinping Guan
    [J]. Neural Computing and Applications, 2023, 35 : 9951 - 9960
  • [2] PointlNet: Point Cloud Frame Interpolation Network
    Lu, Fan
    Chen, Guang
    Qu, Sanqing
    Li, Zhijun
    Liu, Yinlong
    Knoll, Alois
    [J]. THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 2251 - 2259
  • [3] Self-Supervised Point Cloud Prediction for Autonomous Driving
    Du, Ronghua
    Feng, Rongying
    Gao, Kai
    Zhang, Jinlai
    Liu, Linhong
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, : 17452 - 17467
  • [4] Self-supervised learning for point cloud data: A survey
    Zeng, Changyu
    Wang, Wei
    Nguyen, Anh
    Xiao, Jimin
    Yue, Yutao
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2024, 237
  • [5] Masked Autoencoders for Point Cloud Self-supervised Learning
    Pang, Yatian
    Wang, Wenxiao
    Tay, Francis E. H.
    Liu, Wei
    Tian, Yonghong
    Yuan, Li
    [J]. COMPUTER VISION - ECCV 2022, PT II, 2022, 13662 : 604 - 621
  • [6] DHGCN: Dynamic Hop Graph Convolution Network for Self-Supervised Point Cloud Learning
    Jiang, Jincen
    Zhao, Lizhi
    Lu, Xuequan
    Hu, Wei
    Razzak, Imran
    Wang, Meili
    [J]. THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 11, 2024, : 12883 - 12891
  • [7] SSL-Net: Point-Cloud Generation Network With Self-Supervised Learning
    Sun, Ran
    Gao, Yongbin
    Fang, Zhijun
    Wang, Anjie
    Zhong, Cengsi
    [J]. IEEE ACCESS, 2019, 7 : 82206 - 82217
  • [8] Self-Supervised Point Set Local Descriptors for Point Cloud Registration
    Yuan, Yijun
    Borrmann, Dorit
    Hou, Jiawei
    Ma, Yuexin
    Nuechter, Andreas
    Schwertfeger, Soren
    [J]. SENSORS, 2021, 21 (02) : 1 - 18
  • [9] Point cloud self-supervised learning for machining feature recognition
    Zhang, Hang
    Wang, Wenhu
    Zhang, Shusheng
    Wang, Zhen
    Zhang, Yajun
    Zhou, Jingtao
    Huang, Bo
    [J]. JOURNAL OF MANUFACTURING SYSTEMS, 2024, 77 : 78 - 95
  • [10] Self-Supervised Boundary Point Prediction Task for Point Cloud Domain Adaptation
    Chen, Jintao
    Zhang, Yan
    Huang, Kun
    Ma, Feifan
    Tan, Zhuangbin
    Xu, Zheyu
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (09) : 5878 - 5885