A Fourier dimensionality reduction model for big data interferometric imaging

被引:12
|
作者
Kartik, S. Vijay [1 ]
Carrillo, Rafael E. [1 ]
Thiran, Jean-Philippe [1 ]
Wiaux, Yves [2 ]
机构
[1] Ecole Polytech Fed Lausanne, Signal Proc Lab LTS5, CH-1015 Lausanne, Switzerland
[2] Heriot Watt Univ, Inst Sensors Signals & Syst, Edinburgh EH14 4AS, Midlothian, Scotland
基金
瑞士国家科学基金会; 英国工程与自然科学研究理事会;
关键词
methods: numerical; techniques: image processing; techniques: interferometric; RADIO; DECONVOLUTION; ALGORITHMS; SPARSITY;
D O I
10.1093/mnras/stx531
中图分类号
P1 [天文学];
学科分类号
0704 ;
摘要
Data dimensionality reduction in radio interferometry can provide savings of computational resources for image reconstruction through reduced memory footprints and lighter computations per iteration, which is important for the scalability of imaging methods to the big data setting of the next-generation telescopes. This article sheds new light on dimensionality reduction from the perspective of the compressed sensing theory and studies its interplay with imaging algorithms designed in the context of convex optimization. We propose a post-gridding linear data embedding to the space spanned by the left singular vectors of the measurement operator, providing a dimensionality reduction below image size. This embedding preserves the null space of themeasurement operator and hence its sampling properties are also preserved in light of the compressed sensing theory. We show that this can be approximated by first computing the dirty image and then applying a weighted subsampled discrete Fourier transform to obtain the final reduced data vector. This Fourier dimensionality reduction model ensures a fast implementation of the full measurement operator, essential for any iterative image reconstruction method. The proposed reduction also preserves the independent and identically distributed Gaussian properties of the original measurement noise. For convex optimization-based imaging algorithms, this is key to justify the use of the standard l(2)-norm as the data fidelity term. Our simulations confirm that this dimensionality reduction approach can be leveraged by convex optimization algorithms with no loss in imaging quality relative to reconstructing the image from the complete visibility data set. Reconstruction results in simulation settings with no direction dependent effects or calibration errors show promising performance of the proposed dimensionality reduction. Further tests on real data are planned as an extension of the current work. MATLAB code implementing the proposed reduction method is available on GitHub.
引用
收藏
页码:2382 / 2400
页数:19
相关论文
共 50 条
  • [21] Dimensionality reduction of medical big data using neural-fuzzy classifier
    Ahmad Taher Azar
    Aboul Ella Hassanien
    [J]. Soft Computing, 2015, 19 : 1115 - 1127
  • [22] Dimensionality reduction of medical big data using neural-fuzzy classifier
    Azar, Ahmad Taher
    Hassanien, Aboul Ella
    [J]. SOFT COMPUTING, 2015, 19 (04) : 1115 - 1127
  • [23] Big Data Dimensionality Reduction for Wireless Sensor Networks Using Stacked Autoencoders
    Sirshar, Muneeba
    Saleem, Sajid
    Ilyas, Muhammad U.
    Khan, Muhammad Murtaza
    Alkatheiri, Mohammed Saeed
    Alowibdi, Jalal S.
    [J]. RESEARCH & INNOVATION FORUM 2019: TECHNOLOGY, INNOVATION, EDUCATION, AND THEIR SOCIAL IMPACT, 2019, : 391 - 400
  • [24] Low-Complexity Dimensionality Reduction for Big Data Analytics in the Smart Grid
    Mohajeri, M.
    Ghassemi, A.
    Gulliver, T. Aaron
    [J]. 2020 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2020,
  • [25] Scalable splitting algorithms for big-data interferometric imaging in the SKA era
    Onose, Alexandru
    Carrillo, Rafael E.
    Repetti, Audrey
    McEwen, Jason D.
    Thiran, Jean-Philippe
    Pesquet, Jean-Christophe
    Wiaux, Yves
    [J]. MONTHLY NOTICES OF THE ROYAL ASTRONOMICAL SOCIETY, 2016, 462 (04) : 4314 - 4335
  • [26] Big Data: the curse of dimensionality in modeling
    Bai, Er-wei
    [J]. 2014 33RD CHINESE CONTROL CONFERENCE (CCC), 2014, : 6 - 13
  • [27] Exploiting High Dimensionality in Big Data
    Heckerman, David
    [J]. KDD'19: PROCEEDINGS OF THE 25TH ACM SIGKDD INTERNATIONAL CONFERENCCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2019, : 3172 - 3172
  • [28] DIMENSIONALITY REDUCTION OF BRAIN IMAGING DATA USING GRAPH SIGNAL PROCESSING
    Rui, Liu
    Nejati, Hossein
    Cheung, Ngai-Man
    [J]. 2016 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2016, : 1329 - 1333
  • [29] Dimensionality Reduction of Brain Imaging Data Using Graph Signal Processing
    Dhivya, R.
    Priyadarsini, Uma P. S.
    [J]. RESEARCH JOURNAL OF PHARMACEUTICAL BIOLOGICAL AND CHEMICAL SCIENCES, 2016, 7 : 94 - 103
  • [30] Big data dimensionality reduction techniques in IoT: review, applications and open research challenges
    Ridhima Rani
    Meenu Khurana
    Ajay Kumar
    Neeraj Kumar
    [J]. Cluster Computing, 2022, 25 : 4027 - 4049