Comprehensive Evaluation of Multispectral Image Registration Strategies in Heterogenous Agriculture Environment

被引:5
|
作者
Rana, Shubham [1 ]
Gerbino, Salvatore [1 ]
Crimaldi, Mariano [2 ]
Cirillo, Valerio [2 ]
Carillo, Petronia [3 ]
Sarghini, Fabrizio [2 ]
Maggio, Albino [2 ]
机构
[1] Univ Campania L Vanvitelli, Dept Engn, Via Roma 29, I-81031 Aversa, Italy
[2] Univ Naples Federico II, Dept Agr Sci, Via Univ 100, I-80055 Naples, Italy
[3] Univ Campania L Vanvitelli, Dept Biol & Pharmaceut Environm Sci & Technol, Via Antonio Vivaldi 43, I-81100 Caserta, Italy
关键词
binary mask; homography matrix; masked pixels; MS (multispectral); SIFT (scale-invariant feature transform); SEGMENTATION; HOMOGRAPHY; ROBUST;
D O I
10.3390/jimaging10030061
中图分类号
TB8 [摄影技术];
学科分类号
0804 ;
摘要
This article is focused on the comprehensive evaluation of alleyways to scale-invariant feature transform (SIFT) and random sample consensus (RANSAC) based multispectral (MS) image registration. In this paper, the idea is to extensively evaluate three such SIFT- and RANSAC-based registration approaches over a heterogenous mix containing Triticum aestivum crop and Raphanus raphanistrum weed. The first method is based on the application of a homography matrix, derived during the registration of MS images on spatial coordinates of individual annotations to achieve spatial realignment. The second method is based on the registration of binary masks derived from the ground truth of individual spectral channels. The third method is based on the registration of only the masked pixels of interest across the respective spectral channels. It was found that the MS image registration technique based on the registration of binary masks derived from the manually segmented images exhibited the highest accuracy, followed by the technique involving registration of masked pixels, and lastly, registration based on the spatial realignment of annotations. Among automatically segmented images, the technique based on the registration of automatically predicted mask instances exhibited higher accuracy than the technique based on the registration of masked pixels. In the ground truth images, the annotations performed through the near-infrared channel were found to have a higher accuracy, followed by green, blue, and red spectral channels. Among the automatically segmented images, the accuracy of the blue channel was observed to exhibit a higher accuracy, followed by the green, near-infrared, and red channels. At the individual instance level, the registration based on binary masks depicted the highest accuracy in the green channel, followed by the method based on the registration of masked pixels in the red channel, and lastly, the method based on the spatial realignment of annotations in the green channel. The instance detection of wild radish with YOLOv8l-seg was observed at a mAP@0.5 of 92.11% and a segmentation accuracy of 98% towards segmenting its binary mask instances.
引用
收藏
页数:25
相关论文
共 50 条
  • [21] Rectified Registration Consistency for Image Registration Evaluation
    Ye, Peng
    Zhao, Zhiyong
    Liu, Fang
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2014, E97D (09): : 2549 - 2551
  • [22] A comprehensive review on remote sensing image registration
    Paul, Sourabh
    Pati, Umesh C.
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2021, 42 (14) : 5400 - 5436
  • [23] Multimodal image registration techniques: a comprehensive survey
    Velesaca, Henry O.
    Bastidas, Gisel
    Rouhani, Mohammad
    Sappa, Angel D.
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (23) : 63919 - 63947
  • [24] A new image similarity measure with reduced sensitivity to interpolation and generalizability to multispectral image registration
    Ardekani, Babak A.
    Bachman, Alvin
    2006 28TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY, VOLS 1-15, 2006, : 1833 - +
  • [25] Evaluation of the deformable image registration algorithm in Velocity image registration software
    Fullarton, R.
    Ghirmay, K.
    Dom, W.
    Crees, L.
    RADIOTHERAPY AND ONCOLOGY, 2020, 152 : S974 - S974
  • [26] Performance evaluation of image registration
    Coutre, SC
    Evens, MW
    Armato, SG
    PROCEEDINGS OF THE 22ND ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY, VOLS 1-4, 2000, 22 : 3140 - 3143
  • [27] Multiple Acess Image Surveillance System in a Heterogenous Network Environment
    Lin, Chung-Hung
    Leu, Jenq-Shiou
    Yu, Min-Chieh
    2013 IEEE 17TH INTERNATIONAL SYMPOSIUM ON CONSUMER ELECTRONICS (ISCE), 2013, : 215 - 216
  • [28] Multispectral Image Registration and Accuracy Analysis of ZY-3 Satellite
    Zhu, Xiaoyong
    Liu, Bin
    Zhang, Guo
    Tang, Xinming
    2012 FIRST INTERNATIONAL CONFERENCE ON AGRO-GEOINFORMATICS (AGRO-GEOINFORMATICS), 2012, : 515 - 519
  • [29] IMPROVING MULTISPECTRAL SATELLITE IMAGE COMPRESSION USING ONBOARD SUBPIXEL REGISTRATION
    Albinet, Mathieu
    Camarero, Roberto
    Isnard, Maxime
    Poulet, Christophe
    Perret, Jokin
    SATELLITE DATA COMPRESSION, COMMUNICATIONS, AND PROCESSING IX, 2013, 8871
  • [30] Evaluation of EHR Access Control in a Heterogenous Test Environment
    Szabó Z.
    Bilicki V.
    Acta Cybernetica, 2021, 25 (02): : 485 - 516