Best Frame Selection in a Short Video

被引:0
|
作者
Ren, Jian [1 ,4 ]
Shen, Xiaohui [2 ,4 ]
Lin, Zhe [3 ]
Mech, Radomir [3 ]
机构
[1] Snap Inc, Santa Monica, CA 90405 USA
[2] ByteDance AI Lab, Beijing, Peoples R China
[3] Adobe Res, San Jose, CA USA
[4] Adobe, San Jose, CA USA
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
People usually take short videos to record meaningful moments in their lives. However, selecting the most representative frame, which not only has high image visual quality but also captures video content, from a short video to share or keep is a time-consuming process for one may need to manually go through all the frames in a video to make a decision. In this paper, we introduce the problem of the best frame selection in a short video and aim to solve it automatically. Towards this end, we collect and will release a diverse large-scale short video dataset that includes 11, 000 videos shoot in our daily life. All videos are assumed to be short (e.g., a few seconds) and each video has human-annotated of the best frame. Then we introduce a deep convolutional neural network (CNN) based approach with ranking objective to automatically pick the best frame from frame sequences extracted via short videos. Additionally, we propose new evaluation metrics, especially for the best frame selection. In experiments, we show our approach outperforms various other methods significantly.
引用
收藏
页码:3201 / 3210
页数:10
相关论文
共 50 条
  • [41] Retrospective analysis of time series for frame selection in surveillance video summarization
    Gao, Zhen
    Lu, Guoliang
    Yan, Peng
    Wang, Liang
    SIGNAL IMAGE AND VIDEO PROCESSING, 2017, 11 (04) : 581 - 588
  • [42] Video frame categorization using sort-merge feature selection
    Liu, Y
    Kender, JR
    IEEE WORKSHOP ON MOTION AND VIDEO COMPUTING (MOTION 2002), PROCEEDINGS, 2002, : 72 - 77
  • [43] Active Frame, Location, and Detector Selection for Automated and Manual Video Annotation
    Karasev, Vasiliy
    Ravichandran, Avinash
    Soatto, Stefano
    2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, : 2131 - 2138
  • [44] Efficient video face recognition based on frame selection and quality assessment
    Kharchevnikova, Angelina
    Savchenko, Andrey, V
    PEERJ COMPUTER SCIENCE, 2021,
  • [45] Retrospective analysis of time series for frame selection in surveillance video summarization
    Zhen Gao
    Guoliang Lu
    Peng Yan
    Liang Wang
    Signal, Image and Video Processing, 2017, 11 : 581 - 588
  • [46] Multimodal emotion recognition based on peak frame selection from video
    Sara Zhalehpour
    Zahid Akhtar
    Cigdem Eroglu Erdem
    Signal, Image and Video Processing, 2016, 10 : 827 - 834
  • [47] A Novel Method for Informative Frame Selection in Wireless Capsule Endoscopy Video
    Fan, Yichen
    Meng, Max Q. -H.
    Li, Baopu
    2011 ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2011, : 4864 - 4867
  • [48] Key-frame Selection in WCE Video Based on Shot Detection
    Fu, Yanan
    Liu, Haiying
    Cheng, Yu
    Yan, Tingfang
    Li, Teng
    Meng, Max Q. -H.
    PROCEEDINGS OF THE 10TH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION (WCICA 2012), 2012, : 5030 - 5034
  • [49] Efficient video face recognition based on frame selection and quality assessment
    Kharchevnikova A.
    Savchenko A.V.
    PeerJ Computer Science, 2021, 7 : 1 - 18
  • [50] Frame grabbers get the picture when video cameras fall short
    Strassberg, D
    EDN, 1998, 43 (05) : 87 - +