Reproducible Research in Signal Processing

被引:163
|
作者
Vandewalle, Patrick
Kovacevic, Jelena [1 ]
Vetterli, Martin [2 ,3 ,4 ]
机构
[1] Carnegie Mellon Univ, Ctr Bioimage Informat, Pittsburgh, PA 15213 USA
[2] Columbia Univ, New York, NY USA
[3] Univ Calif Berkeley, Berkeley, CA 94720 USA
[4] Ecole Polytech Fed Lausanne, Commun Syst Dept, Lausanne, Switzerland
关键词
Book reviews; Data mining; Databases; MATLAB; Probability density function; Signal processing; Signal processing algorithms;
D O I
10.1109/MSP.2009.932122
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Have you ever tried to reproduce the results presented in a research paper? For many of our current publications, this would unfortunately be a challenging task. For a computational algorithm, details such as the exact data set, initialization or termination procedures, and precise parameter values are often omitted in the publication for various reasons, such as a lack of space, a lack of self-discipline, or an apparent lack of interest to the readers, to name a few. This makes it difficult, if not impossible, for someone else to obtain the same results. In our experience, it is often even worse as even we are not always able to reproduce our own experiments, making it difficult to answer questions from colleagues about details. Following are some examples of e-mails we have received: "I just read your paper X. It is very completely described, however I am confused by Y. Could you provide the implementation code to me for reference if possible?" "Hi! I am also working on a project related to X. I have implemented your algorithm but cannot get the same results as described in your paper. Which values should I use for parameters Y and Z?". © 2009 IEEE.
引用
收藏
页码:37 / 47
页数:11
相关论文
共 50 条
  • [1] Reproducible research in signal processing
    Rupp, Markus
    Gini, Fulvio
    Perez-Neira, Ana
    Pesquet-Popescu, Beatrice
    Pikrakis, Aggelos
    Sankur, Bulent
    Vandewalle, Patrick
    Zoubir, Abdelhak
    [J]. EURASIP JOURNAL ON ADVANCES IN SIGNAL PROCESSING, 2011,
  • [2] Reproducible research in signal processing
    Markus Rupp
    Fulvio Gini
    Ana Pérez-Neira
    Beatrice Pesquet-Popescu
    Aggelos Pikrakis
    Bulent Sankur
    Patrick Vandewalle
    Abdelhak Zoubir
    [J]. EURASIP Journal on Advances in Signal Processing, 2011
  • [3] Experiences with reproducible research in various facets of signal processing research
    Vandewalle, P.
    Barrenetxea, G.
    Jovanovic, I.
    Ridolfi, A.
    Vetterli, M.
    [J]. 2007 IEEE International Conference on Acoustics, Speech, and Signal Processing, Vol IV, Pts 1-3, 2007, : 1253 - 1256
  • [4] HARDWARE AND SOFTWARE FOR REPRODUCIBLE RESEARCH IN AUDIO ARRAY SIGNAL PROCESSING
    Bezzam, Eric
    Scheibler, Robin
    Azcarreta, Juan
    Pan, Hanjie
    Simeoni, Matthieu
    Beuchat, Rene
    Hurley, Paul
    Bruneau, Basile
    Ferry, Corentin
    Kashani, Sepand
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2017, : 6591 - 6592
  • [5] RETRACTED: REPRODUCIBLE RESEARCH IN VARIOUS FACETS OF SIGNAL PROCESSING (Retracted Article)
    Hussain, Dilshad
    Ather, Siddiqui Mohd Shabab
    [J]. 2009 INTERNATIONAL CONFERENCE ON MULTIMEDIA, SIGNAL PROCESSING AND COMMUNICATION TECHNOLOGIES, 2009, : 64 - +
  • [6] Reproducible Data Processing Research for the CABRI RIA experiments Acoustic Emission signal analysis
    Pantera, Laurent
    Traore, Oumar Issiaka
    [J]. 2015 4TH INTERNATIONAL CONFERENCE ON ADVANCEMENTS IN NUCLEAR INSTRUMENTATION MEASUREMENT METHODS AND THEIR APPLICATIONS (ANIMMA), 2015,
  • [7] Open-Source Practices for Music Signal Processing Research Recommendations for transparent, sustainable, and reproducible audio research
    McFee, Brian
    Kim, Jong Wook
    Cartwright, Mark
    Salamon, Justin
    Bittner, Rachel
    Pablo Bello, Juan
    [J]. IEEE SIGNAL PROCESSING MAGAZINE, 2019, 36 (01) : 128 - 137
  • [8] SIGNAL PROCESSING RESEARCH
    SWICK, DA
    [J]. REPORT OF NRL PROGRESS, 1967, (JUN): : 43 - &
  • [9] Models of Architecture: Reproducible Efficiency Evaluation for Signal Processing Systems
    Pelcat, Maxime
    Desnos, Karol
    Maggiani, Luca
    Liu, Yanzhou
    Heulot, Julien
    Nezan, Jean-Francois
    Bhattacharyya, Shuvra S.
    [J]. 2016 IEEE INTERNATIONAL WORKSHOP ON SIGNAL PROCESSING SYSTEMS (SIPS), 2016, : 121 - 126
  • [10] Putting reproducible signal processing into practice:: A case study in watermarking
    Barni, M.
    Perez-Gonzalez, F.
    Comesana, P.
    Bartoli, G.
    [J]. 2007 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOL IV, PTS 1-3, 2007, : 1261 - +