Sparse Representation-Based Multiple Frame Video Super-Resolution

被引:29
|
作者
Dai, Qiqin [1 ]
Yoo, Seunghwan [1 ]
Kappeler, Armin [1 ]
Katsaggelos, Aggelos K. [1 ]
机构
[1] Northwestern Univ, Dept Elect Engn & Comp Sci, Evanston, IL 60208 USA
关键词
Video super-resolution; dictionary learning; sparse coding; optical flow; motion estimation; IMAGE SUPERRESOLUTION; MOTION; RECONSTRUCTION; ALGORITHM;
D O I
10.1109/TIP.2016.2631339
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose two multiple-frame super-resolution (SR) algorithms based on dictionary learning (DL) and motion estimation. First, we adopt the use of video bilevel DL, which has been used for single-frame SR. It is extended to multiple frames by using motion estimation with sub-pixel accuracy. We propose a batch and a temporally recursive multi-frame SR algorithm, which improves over single-frame SR. Finally, we propose a novel DL algorithm utilizing consecutive video frames, rather than still images or individual video frames, which further improves the performance of the video SR algorithms. Extensive experimental comparisons with the state-of-the-art SR algorithms verify the effectiveness of our proposed multiple-frame video SR approach.
引用
收藏
页码:765 / 781
页数:17
相关论文
共 50 条
  • [1] Sparse representation-based MRI super-resolution reconstruction
    Wang, Yun-Heng
    Qiao, Jiaqing
    Li, Jun-Bao
    Fu, Ping
    Chu, Shu-Chuan
    Roddick, John F.
    [J]. MEASUREMENT, 2014, 47 : 946 - 953
  • [2] Understanding Compressive Sensing and Sparse Representation-Based Super-Resolution
    Kulkarni, Naveen
    Nagesh, Pradeep
    Gowda, Rahul
    Li, Baoxin
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2012, 22 (05) : 778 - 789
  • [3] Sparse Representation-based Super-Resolution for Diffusion Weighted Images
    Afzali, Maryam
    Fatemizadeh, Emad
    Soltanian-Zadeh, Hamid
    [J]. 2014 21TH IRANIAN CONFERENCE ON BIOMEDICAL ENGINEERING (ICBME), 2014, : 12 - 16
  • [4] Sparse Representation-based Super-Resolution for Face Recognition At a Distance
    Bilgazyev, E.
    Efraty, B.
    Shah, S. K.
    Kakadiaris, I. A.
    [J]. PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2011, 2011,
  • [5] Sparse Representation-based Dictionary Learning Methods for Hyperspectral Super-Resolution
    Simsek, Murat
    Polat, Ediz
    [J]. 2016 24TH SIGNAL PROCESSING AND COMMUNICATION APPLICATION CONFERENCE (SIU), 2016, : 753 - 756
  • [6] Single frame super-resolution reconstruction based on sparse representation
    Xie, Chao
    Lu, Xiaobo
    Zeng, Weili
    [J]. Journal of Southeast University (English Edition), 2016, 32 (02): : 177 - 182
  • [7] An Efficient Video Super-Resolution Approach based on Sparse Representation
    Toutounchi, Farzad
    Ones, Valia Guerra
    Izquierdo, Ebroul
    [J]. 2017 IEEE 19TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2017,
  • [8] A Single Image Compression Framework Combined with Sparse Representation-Based Super-Resolution
    He Xiaohai
    He Jingbo
    Huang Jianqiu
    Wu Di
    [J]. PROCEEDINGS OF THE 2015 INTERNATIONAL CONFERENCE ON ELECTRONIC SCIENCE AND AUTOMATION CONTROL, 2015, 20 : 292 - 296
  • [9] DICTIONARY-BASED MULTIPLE FRAME VIDEO SUPER-RESOLUTION
    Dai, Qiqin
    Yoo, Seunghwan
    Kappeler, Armin
    Katsaggelos, Aggelos K.
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2015, : 83 - 87
  • [10] Joint Sparse Representation-based Single Image Super-Resolution for Remote Sensing Applications
    Deka, Bhabesh
    Mullah, Helal Uddin
    Barman, Trishna
    Datta, Sumit
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 2352 - 2365