DED-SAM:Adapting Segment Anything Model 2 for Dual Encoder-Decoder Change Detection

被引:1
|
作者
Qiu, Junlong [1 ]
Liu, Wei [1 ]
Zhang, Xin [2 ]
Li, Erzhu [1 ]
Zhang, Lianpeng [1 ]
Li, Xing [1 ]
机构
[1] Jiangsu Normal Univ, Sch Geog Geomat & Planning, Xuzhou 221116, Peoples R China
[2] Chinese Acad Sci, Aerosp Informat Res Inst, Beijing 100094, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Feature extraction; Remote sensing; Decoding; Data models; Visualization; Transformers; Object oriented modeling; Accuracy; Semantics; Semantic segmentation; Change detection; remote sensing; segment anything model; vision foundation model; NETWORK;
D O I
10.1109/JSTARS.2024.3490754
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Change detection has become a crucial topic in the field of remote sensing deep learning due to its extensive application in earth observation. However, real remote sensing images often contain multiple land cover classes with significant intraclass variability and interclass similarity, limiting the performance of change detection in complex scenarios. To address this, we leverage the capabilities of vision foundation models by applying the segment anything model (SAM) to remote sensing change detection, and we name this method dual encoder-decoder SAM (DED-SAM). Specifically, we construct a DED framework, utilizing a small-scale change detection model in both branches to generate mixed prompts including image features, mask prompts, and box prompts. The SAM 2 model is used for fine-grained recognition of dual-temporal images, generating accurate, and stable feature boundaries, which are then used as constraints to generate the final change mask. To validate the effectiveness of DED-SAM across various application scenarios, we conduct quantitative experiments on three public datasets: Levir-CD, SYSU-CD, and CDD, testing its detection capabilities under single change categories, multiple change categories, and seasonal pseudochange interference. The results show that the proposed DED-SAM achieved state-of-the-art F1 scores and IoUs on these three datasets: LEVIR-CD (92.00%, 85.11%), SYSU-CD (84.15%, 72.01%), and CDD (97.72%, 95.47%).
引用
收藏
页码:995 / 1006
页数:12
相关论文
共 50 条
  • [31] Wind turbine frequent principal fault detection based on a self-attentive LSTM encoder-decoder model
    Jiang, Na
    Li, Ning
    PROCEEDINGS OF THE 39TH CHINESE CONTROL CONFERENCE, 2020, : 4171 - 4176
  • [32] A Multi-Scale Contrast Preserving Encoder-Decoder Architecture for Local Change Detection From Thermal Video Scenes
    Panda, Manoj Kumar
    Subudhi, Badri Narayan
    Veerakumar, T.
    Jakhetiya, Vinit
    Bouwmans, Thierry
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2024, 19 : 7968 - 7981
  • [33] SAM-LAD: Segment Anything Model meets zero-shot logic anomaly detection
    Peng, Yun
    Lin, Xiao
    Ma, Nachuan
    Du, Jiayuan
    Liu, Chuangwei
    Liu, Chengju
    Chen, Qijun
    KNOWLEDGE-BASED SYSTEMS, 2025, 314
  • [34] T2S: An Encoder-Decoder Model for Topic-Based Natural Language Generation
    Ou, Wenjie
    Chen, Chaotao
    Ren, Jiangtao
    NATURAL LANGUAGE PROCESSING AND INFORMATION SYSTEMS (NLDB 2018), 2018, 10859 : 143 - 151
  • [35] Automatic 3D Multiple Building Change Detection Model Based on Encoder-Decoder Network Using Highly Unbalanced Remote Sensing Datasets
    Gomroki, Masoomeh
    Hasanlou, Mahdi
    Chanussot, Jocelyn
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 10311 - 10325
  • [36] Unsupervised change detection in PolSAR images using siamese encoder-decoder framework based on graph-context attention network
    Yang, Zhifei
    Wu, Yan
    Li, Ming
    Hu, Xin
    Li, Zhikang
    INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2023, 124
  • [37] Exchanging Dual-Encoder-Decoder: A New Strategy for Change Detection With Semantic Guidance and Spatial Localization
    Zhao, Sijie
    Zhang, Xueliang
    Xiao, Pengfeng
    He, Guangjun
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61 : 1 - 16
  • [38] Development and implementation of real-time anomaly detection on tool wear based on stacked LSTM encoder-decoder model
    Taisuke Oshida
    Tomohiro Murakoshi
    Libo Zhou
    Hirotaka Ojima
    Kazuki Kaneko
    Teppei Onuki
    Jun Shimizu
    The International Journal of Advanced Manufacturing Technology, 2023, 127 : 263 - 278
  • [39] Leveraging Segment Anything Model (SAM) for Weld Defect Detection in Industrial Ultrasonic B-Scan Images
    Naddaf-Sh, Amir-M.
    Baburao, Vinay S.
    Zargarzadeh, Hassan
    SENSORS, 2025, 25 (01)
  • [40] Development and implementation of real-time anomaly detection on tool wear based on stacked LSTM encoder-decoder model
    Oshida, Taisuke
    Murakoshi, Tomohiro
    Zhou, Libo
    Ojima, Hirotaka
    Kaneko, Kazuki
    Onuki, Teppei
    Shimizu, Jun
    INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2023, 127 (1-2): : 263 - 278