Cross-Dataset Adaptation for Instrument Classification in Cataract Surgery Videos

被引:0
|
作者
Paranjape, Jay N. [1 ]
Sikder, Shameema [2 ,3 ]
Patel, Vishal M. [1 ]
Vedula, S. Swaroop [3 ]
机构
[1] Johns Hopkins Univ, Dept Elect & Comp Engn, Baltimore, MD 21218 USA
[2] Johns Hopkins Univ, Wilmer Eye Inst, Baltimore, MD 21218 USA
[3] Johns Hopkins Univ, Malone Ctr Engn Healthcare, Baltimore, MD USA
基金
美国国家卫生研究院;
关键词
Surgical Tool Classification; Unsupervised Domain Adaptation; Cataract Surgery; Surgical Data Science; VISION;
D O I
10.1007/978-3-031-43907-0_70
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Surgical tool presence detection is an important part of the intra-operative and post-operative analysis of a surgery. State-of-the-art models, which perform this task well on a particular dataset, however, perform poorly when tested on another dataset. This occurs due to a significant domain shift between the datasets resulting from the use of different tools, sensors, data resolution etc. In this paper, we highlight this domain shift in the commonly performed cataract surgery and propose a novel end-to-end Unsupervised Domain Adaptation (UDA) method called the Barlow Adaptor that addresses the problem of distribution shift without requiring any labels from another domain. In addition, we introduce a novel loss called the Barlow Feature Alignment Loss (BFAL) which aligns features across different domains while reducing redundancy and the need for higher batch sizes, thus improving cross-dataset performance. The use of BFAL is a novel approach to address the challenge of domain shift in cataract surgery data. Extensive experiments are conducted on two cataract surgery datasets and it is shown that the proposed method outperforms the state-of-the-art UDA methods by 6%. The code can be found at https://github.com/JayParanjape/Barlow- Adaptor.
引用
收藏
页码:739 / 748
页数:10
相关论文
共 50 条
  • [1] Continual Cross-Dataset Adaptation in Road Surface Classification
    Cudrano, Paolo
    Bellusci, Matteo
    Macino, Giuseppe
    Matteucci, Matteo
    [J]. 2023 IEEE 26TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS, ITSC, 2023, : 4278 - 4284
  • [2] Cross-Dataset Validation of Feature Sets in Musical Instrument Classification
    Donnelly, Patrick J.
    Sheppard, John W.
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOP (ICDMW), 2015, : 94 - 101
  • [3] Cross-dataset email classification
    Morales, Valentin
    Gomez, Juan Carlos
    Amerongen, Saskia Van
    [J]. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2020, 39 (02) : 2279 - 2290
  • [4] Cross-Dataset Hyperspectral Image Classification Based on Adversarial Domain Adaptation
    Ma, Xiaorui
    Mou, Xuerong
    Wang, Jie
    Liu, Xiaokai
    Geng, Jie
    Wang, Hongyu
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (05): : 4179 - 4190
  • [5] Evaluating the Generalization Performance of Instrument Classification in Cataract Surgery Videos
    Sokolova, Natalia
    Schoeffmann, Klaus
    Taschwer, Mario
    Putzgruber-Adamitsch, Doris
    El-Shabrawi, Yosuf
    [J]. MULTIMEDIA MODELING (MMM 2020), PT II, 2020, 11962 : 626 - 636
  • [6] Cross-Dataset Adaptation for Visual Question Answering
    Chao, Wei-Lun
    Hu, Hexiang
    Sha, Fei
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 5716 - 5725
  • [7] Continual Contrastive Learning for Cross-Dataset Scene Classification
    Peng, Rui
    Zhao, Wenzhi
    Li, Kaiyuan
    Ji, Fengcheng
    Rong, Caixia
    [J]. REMOTE SENSING, 2022, 14 (20)
  • [8] Domain Adaptation for Cross-Dataset Person Re-Identification
    Genc, Anil
    Ekenel, Hazim Kemal
    [J]. 2018 26TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2018,
  • [9] SIMPLE DOMAIN ADAPTATION FOR CROSS-DATASET ANALYSES OF BRAIN MRI DATA
    Hofer, Christoph
    Kwitt, Roland
    Hoeller, Yvonne
    Trinka, Eugen
    Uhl, Andreas
    [J]. 2017 IEEE 14TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI 2017), 2017, : 441 - 445
  • [10] Cross-dataset Learning for Generalizable Land Use Scene Classification
    Gominski, Dimitri
    Gouet-Brunet, Valerie
    Chen, Liming
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 1381 - 1390