Real-Time Video Matting Based on RVM and Mobile ViT*

被引:0
|
作者
Wu, Chengyu [1 ]
Qin, Jiangshan [1 ]
Li, Xiangyang [2 ]
Zhan, Ao [1 ]
Wang, Zhengqiang [3 ]
机构
[1] Zhejiang Sci Tech Univ, Sch Informat Sci & Engn, Hangzhou 310018, Peoples R China
[2] Southwest China Inst Elect Technol, Chengdu 610036, Peoples R China
[3] Chongqing Univ Posts & Telecommun, Sch Commun & Informat Engn, Chongqing 400065, Peoples R China
关键词
mobile ViT; video matting; deep learning; attention mechanism;
D O I
10.1587/transinf.2023EDL8071
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Real-time matting is a challenging research in deep learning. Conventional CNN (Convolutional Neural Networks) approaches are easy to misjudge the foreground and background semantic and have blurry matting edges, which result from CNN's limited concentration on global context due to receptive field. We propose a real-time matting approach former structure, attention and content-aware guidance to solve issues above. The semantic accuracy improves a lot due to the establishment of global context and long-range pixel information. The experiments show our approach exceeds a 30% reduction in error metrics compared with existing real-time matting approaches.
引用
收藏
页码:792 / 796
页数:5
相关论文
共 50 条
  • [1] Real-Time Video Matting Based on Bilayer Segmentation
    Pham, Viet-Quoc
    Takahashi, Keita
    Naemura, Takeshi
    [J]. COMPUTER VISION - ACCV 2009, PT II, 2010, 5995 : 489 - +
  • [2] Real-time deep hair matting on mobile devices
    Levinshtein, Alex
    Chang, Cheng
    Phung, Edmund
    Kezele, Irina
    Guo, Wenzhangzhi
    Aarabi, Parham
    [J]. 2018 15TH CONFERENCE ON COMPUTER AND ROBOT VISION (CRV), 2018, : 1 - 7
  • [3] Efficient Video Matting on Human Video Clips for Real-Time Application
    Yu, Chao-Liang
    Lin, I-Chen
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 2165 - 2170
  • [4] REAL-TIME VIDEO SUMMARIZATION ON MOBILE
    Marvaniya, Smit
    Damoder, Mogilipaka
    Gopalakrishnan, Viswanath
    Iyer, Kiran Nanjunda
    Soni, Kapil
    [J]. 2016 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2016, : 176 - 180
  • [5] A Novel Real-Time Fall Detection System Based on Real-Time Video and Mobile Phones
    Tong, Chao
    Lian, Yu
    Zhang, Yang
    Xie, Zhongyu
    Long, Xiang
    Niu, Jianwei
    [J]. JOURNAL OF CIRCUITS SYSTEMS AND COMPUTERS, 2017, 26 (04)
  • [6] Research and Application of Real-Time High-Resolution Video Matting Algorithm
    Duan, Beibei
    Fan, Xinggang
    Lei, Yanjing
    Feng, Zehui
    Chan, Sixian
    [J]. 2022 INTERNATIONAL CONFERENCE ON COMPUTERS AND ARTIFICIAL INTELLIGENCE TECHNOLOGIES, CAIT, 2022, : 85 - 92
  • [7] REAL-TIME VIDEO DENOISING ON MOBILE PHONES
    Ehmann, Lana
    Chu, Lun-Cheng
    Tsai, Sung-Fang
    Liang, Chia-Kai
    [J]. 2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 505 - 509
  • [8] A REAL-TIME FALL DETECTION SYSTEM BASED ON HMM AND RVM
    Jiang, Mei
    Chen, Yuyang
    Zhao, Yanyun
    Cai, Anni
    [J]. 2013 IEEE INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (IEEE VCIP 2013), 2013,
  • [9] Integrating Depth-Based and Deep Learning Techniques for Real-Time Video Matting without Green Screens
    Su, Pin-Chen
    Yang, Mau-Tsuen
    [J]. ELECTRONICS, 2024, 13 (16)
  • [10] Quality improvement of real-time video in mobile network
    Sun, Qindong
    Qi, Wenjing
    Zhang, Jingpeng
    [J]. IEEE 20TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS / IEEE 16TH INTERNATIONAL CONFERENCE ON SMART CITY / IEEE 4TH INTERNATIONAL CONFERENCE ON DATA SCIENCE AND SYSTEMS (HPCC/SMARTCITY/DSS), 2018, : 1039 - 1042