A Fourier dimensionality reduction model for big data interferometric imaging

被引:12
|
作者
Kartik, S. Vijay [1 ]
Carrillo, Rafael E. [1 ]
Thiran, Jean-Philippe [1 ]
Wiaux, Yves [2 ]
机构
[1] Ecole Polytech Fed Lausanne, Signal Proc Lab LTS5, CH-1015 Lausanne, Switzerland
[2] Heriot Watt Univ, Inst Sensors Signals & Syst, Edinburgh EH14 4AS, Midlothian, Scotland
基金
瑞士国家科学基金会; 英国工程与自然科学研究理事会;
关键词
methods: numerical; techniques: image processing; techniques: interferometric; RADIO; DECONVOLUTION; ALGORITHMS; SPARSITY;
D O I
10.1093/mnras/stx531
中图分类号
P1 [天文学];
学科分类号
0704 ;
摘要
Data dimensionality reduction in radio interferometry can provide savings of computational resources for image reconstruction through reduced memory footprints and lighter computations per iteration, which is important for the scalability of imaging methods to the big data setting of the next-generation telescopes. This article sheds new light on dimensionality reduction from the perspective of the compressed sensing theory and studies its interplay with imaging algorithms designed in the context of convex optimization. We propose a post-gridding linear data embedding to the space spanned by the left singular vectors of the measurement operator, providing a dimensionality reduction below image size. This embedding preserves the null space of themeasurement operator and hence its sampling properties are also preserved in light of the compressed sensing theory. We show that this can be approximated by first computing the dirty image and then applying a weighted subsampled discrete Fourier transform to obtain the final reduced data vector. This Fourier dimensionality reduction model ensures a fast implementation of the full measurement operator, essential for any iterative image reconstruction method. The proposed reduction also preserves the independent and identically distributed Gaussian properties of the original measurement noise. For convex optimization-based imaging algorithms, this is key to justify the use of the standard l(2)-norm as the data fidelity term. Our simulations confirm that this dimensionality reduction approach can be leveraged by convex optimization algorithms with no loss in imaging quality relative to reconstructing the image from the complete visibility data set. Reconstruction results in simulation settings with no direction dependent effects or calibration errors show promising performance of the proposed dimensionality reduction. Further tests on real data are planned as an extension of the current work. MATLAB code implementing the proposed reduction method is available on GitHub.
引用
收藏
页码:2382 / 2400
页数:19
相关论文
共 50 条
  • [1] Supervised dimensionality reduction for big data
    Vogelstein, Joshua T.
    Bridgeford, Eric W.
    Tang, Minh
    Zheng, Da
    Douville, Christopher
    Burns, Randal
    Maggioni, Mauro
    [J]. NATURE COMMUNICATIONS, 2021, 12 (01)
  • [2] Supervised dimensionality reduction for big data
    Joshua T. Vogelstein
    Eric W. Bridgeford
    Minh Tang
    Da Zheng
    Christopher Douville
    Randal Burns
    Mauro Maggioni
    [J]. Nature Communications, 12
  • [3] Analysis of Dimensionality Reduction Techniques on Big Data
    Reddy, G. Thippa
    Reddy, M. Praveen Kumar
    Lakshmanna, Kuruva
    Kaluri, Rajesh
    Rajput, Dharmendra Singh
    Srivastava, Gautam
    Baker, Thar
    [J]. IEEE ACCESS, 2020, 8 : 54776 - 54788
  • [4] A Holistic Approach for Distributed Dimensionality Reduction of Big Data
    Kuang, Liwei
    Yang, Laurence T.
    Chen, Jinjun
    Hao, Fei
    Luo, Changqing
    [J]. IEEE TRANSACTIONS ON CLOUD COMPUTING, 2018, 6 (02) : 506 - 518
  • [5] Dimensionality Reduction for Noise Filtering of Big Data Sets
    Mahe, E.
    [J]. JOURNAL OF MOLECULAR DIAGNOSTICS, 2020, 22 (11): : S85 - S85
  • [6] Special issue on dimensionality reduction for visual big data
    Pang, Yanwei
    Shao, Ling
    [J]. NEUROCOMPUTING, 2016, 173 : 125 - 126
  • [7] On the Use of Random Discretization and Dimensionality Reduction in Ensembles for Big Data
    Garcia-Gil, Diego
    Ramirez-Gallego, Sergio
    Garcia, Salvador
    Herrera, Francisco
    [J]. HYBRID ARTIFICIAL INTELLIGENT SYSTEMS (HAIS 2018), 2018, 10870 : 15 - 26
  • [8] A New Dimensionality Reduction Approach Applied to the Big Data Visualization
    Lamrini, Mimoun
    Tribak, Hicham
    Chkouri, Mohamed Yassin
    [J]. ADVANCED INTELLIGENT SYSTEMS FOR SUSTAINABLE DEVELOPMENT (AI2SD'2020), VOL 2, 2022, 1418 : 312 - 318
  • [9] A Dimensionality Reduction Algorithm for Unstructured Campus Big Data Fusion
    Wang, Zhenfei
    Wang, Yan
    Zhang, Liying
    Zhang, Chuchu
    Zhang, Xingjin
    [J]. SYMMETRY-BASEL, 2021, 13 (02): : 1 - 18
  • [10] A distributed big data analytics model for people re-identification based dimensionality reduction
    Ez-Zahout A.
    [J]. International Journal of High Performance Systems Architecture, 2021, 10 (02) : 57 - 63