Cherry growth modeling based on Prior Distance Embedding contrastive learning: Pre-training, anomaly detection, semantic segmentation, and temporal modeling

被引:0
|
作者
Xu, Wei [1 ,2 ]
Guo, Ruiya [2 ]
Chen, Pengyu [2 ]
Li, Li [2 ,3 ]
Gu, Maomao [2 ]
Sun, Hao [2 ]
Hu, Lingyan [2 ]
Wang, Zumin [2 ]
Li, Kefeng [1 ]
机构
[1] Macao Polytech Univ, Fac Appl Sci, Macau, Macao, Peoples R China
[2] Dalian Univ, Sch Informat Engn, Dalian, Peoples R China
[3] Shanghai Chenrui Commun Technol Co Ltd, Shanghai, Peoples R China
基金
中国国家自然科学基金;
关键词
Contrastive learning; Priori Distance Embedding (PDE); Plant phenotyping; Deep learning; Plant temporal modeling;
D O I
10.1016/j.compag.2024.108973
中图分类号
S [农业科学];
学科分类号
09 ;
摘要
In current plant phenotyping research, the study of plant time-series images based on deep learning has received widespread attention. While such image data is relatively easy to obtain, the cost of annotation is high. One efficient method for achieving cost-effective training is through contrastive learning. Plant growth is slow, and the changes in image sequences over a period of time are small, with simple semantic information. Previous contrastive pre-training models struggled to effectively distinguish positive samples from the same image with different augmented views and similar negative samples from different images. Therefore, this paper proposes a method called self-supervised contrastive learning method for plant time-series images with a Priori Distance Embedding (PDE). The semantic information in images corresponding to different phenological stages of plants varies. This method transforms this crucial domain knowledge into prior distances for image pairs and conducts contrastive learning pre-training. The learned weights can be transferred to downstream tasks. Building upon this method, experiments were conducted on cherry time-series images to assess the quality of pre-training through a plant phenotyping image semantic segmentation task. To provide a comprehensive example of plant time-series image phenotypic analysis, this paper establishes a cherry growth temporal model, specifically including PDE pre-training, anomaly detection, semantic segmentation, and recording the results from the temporal dimension. The experiments indicate that this self-supervised contrastive learning method can be effectively applied to the pre-training of plant time-series images, demonstrating broad applicability in various computer vision studies related to plant phenotyping.
引用
收藏
页数:18
相关论文
共 3 条
  • [1] W2V-BERT: COMBINING CONTRASTIVE LEARNING AND MASKED LANGUAGE MODELING FOR SELF-SUPERVISED SPEECH PRE-TRAINING
    Chung, Yu-An
    Zhang, Yu
    Han, Wei
    Chiu, Chung-Cheng
    Qin, James
    Pang, Ruoming
    Wu, Yonghui
    2021 IEEE AUTOMATIC SPEECH RECOGNITION AND UNDERSTANDING WORKSHOP (ASRU), 2021, : 244 - 250
  • [2] ClusterE-ZSL: A Novel Cluster-Based Embedding for Enhanced Zero-Shot Learning in Contrastive Pre-Training Cross-Modal Retrieval
    Tariq, Umair
    Hu, Zonghai
    Tasneem, Khawaja Tauseef
    Bin Heyat, Md Belal
    Iqbal, Muhammad Shahid
    Aziz, Kamran
    IEEE ACCESS, 2024, 12 : 162622 - 162637
  • [3] KnowMIM: a Self-supervised Pre-training Framework Based on Knowledge-Guided Masked Image Modeling for Retinal Vessel Segmentation
    Zhu, Jiuyuan
    Chen, Wei
    Li, Chen
    Xun, Tianci
    Tan, Chunjiao
    Zheng, Weiwei
    Xu, Yingqi
    Qiao, Peng
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING-ICANN 2024, PT VIII, 2024, 15023 : 412 - 426