Best Frame Selection in a Short Video

被引:0
|
作者
Ren, Jian [1 ,4 ]
Shen, Xiaohui [2 ,4 ]
Lin, Zhe [3 ]
Mech, Radomir [3 ]
机构
[1] Snap Inc, Santa Monica, CA 90405 USA
[2] ByteDance AI Lab, Beijing, Peoples R China
[3] Adobe Res, San Jose, CA USA
[4] Adobe, San Jose, CA USA
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
People usually take short videos to record meaningful moments in their lives. However, selecting the most representative frame, which not only has high image visual quality but also captures video content, from a short video to share or keep is a time-consuming process for one may need to manually go through all the frames in a video to make a decision. In this paper, we introduce the problem of the best frame selection in a short video and aim to solve it automatically. Towards this end, we collect and will release a diverse large-scale short video dataset that includes 11, 000 videos shoot in our daily life. All videos are assumed to be short (e.g., a few seconds) and each video has human-annotated of the best frame. Then we introduce a deep convolutional neural network (CNN) based approach with ranking objective to automatically pick the best frame from frame sequences extracted via short videos. Additionally, we propose new evaluation metrics, especially for the best frame selection. In experiments, we show our approach outperforms various other methods significantly.
引用
收藏
页码:3201 / 3210
页数:10
相关论文
共 50 条
  • [1] A Modification of a Stopping Method for Text Recognition in a Video Stream with Best Frame Selection
    Tolstov, Ilya
    Martynov, Stanislav
    Farsobina, Vera
    Bulatov, Konstantin
    THIRTEENTH INTERNATIONAL CONFERENCE ON MACHINE VISION (ICMV 2020), 2021, 11605
  • [2] Key frame selection to represent a video
    Dufaux, F
    2000 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOL II, PROCEEDINGS, 2000, : 275 - 278
  • [3] On frame selection for video face recognition
    Dhamecha, Tejas I. (tejasd@iiitd.ac.in), 2016, Springer International Publishing
  • [4] Best Frame Selection to Enhance Training Step Efficiency in Video-Based Human Action Recognition
    Gharahbagh, Abdorreza Alavi
    Hajihashemi, Vahid
    Ferreira, Marta Campos
    Machado, Jose J. M.
    Tavares, Joao Manuel R. S.
    APPLIED SCIENCES-BASEL, 2022, 12 (04):
  • [5] Key frame selection from MPEG video data
    Gerek, OM
    Altunbasak, Y
    VISUAL COMMUNICATIONS AND IMAGE PROCESSING '97, PTS 1-2, 1997, 3024 : 920 - 925
  • [6] Optimized Reference Frame Selection for Video Coding by Cloud
    Li, Bin
    Xu, Jizheng
    Li, Houqiang
    Wu, Feng
    2011 IEEE 13TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2011,
  • [7] Frame size selection in video downsizing transcoding application
    Shu, HY
    Chau, LP
    2005 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), VOLS 1-6, CONFERENCE PROCEEDINGS, 2005, : 896 - 899
  • [8] A Dynamic Frame Selection Framework for Fast Video Recognition
    Wu, Zuxuan
    Li, Hengduo
    Xiong, Caiming
    Jiang, Yu-Gang
    Davis, Larry Steven
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (04) : 1699 - 1711
  • [9] Hash-Based Frame Selection for Video Phylogeny
    Costa, Filipe de O.
    Lameri, Silvia
    Bestagini, Paolo
    Dias, Zanoni
    Tubaro, Stefano
    Rocha, Anderson
    2016 8TH IEEE INTERNATIONAL WORKSHOP ON INFORMATION FORENSICS AND SECURITY (WIFS 2016), 2016,
  • [10] Quality Based Frame Selection For Video Face Recognition
    Anantharajah, Kaneswaran
    Denman, Simon
    Sridharan, Sridha
    Fookes, Clinton
    Tjondronegoro, Dian
    6TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING AND COMMUNICATION SYSTEMS (ICSPCS'2012), 2012,