AN INTER-OBSERVER CONSISTENT DEEP ADVERSARIAL TRAINING FOR VISUAL SCANPATH PREDICTION

被引:0
|
作者
Kerkouri, Mohamed Amine [1 ]
Tliba, Marouane [1 ]
Chetouani, Aladine [1 ]
Bruno, Alessandro [2 ]
机构
[1] Univ Orleans, Lab PRISME, Orleans, France
[2] IULM Univ, Milan, Italy
关键词
Visual Attention; scanpath prediction; adversarial training; inter-observer consistency;
D O I
10.1109/ICIP49359.2023.10222686
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The visual scanpath represents the fundamental concept upon which visual attention research is based. As a result, the ability to predict them has emerged as a crucial task in recent years. It is represented as a sequence of points through which the human gaze moves while exploring a scene. In this paper, we propose an inter-observer consistent adversarial training approach for scanpath prediction through a lightweight deep neural network. The proposed method employs a discriminative neural network as a dynamic loss that better models the natural stochastic phenomenon while maintaining consistency between the distributions related to the subjective nature of scanpaths traversed by different observers. The competitiveness of our approach against state-of-the-art methods is shown through a testing phase.
引用
收藏
页码:2595 / 2599
页数:5
相关论文
共 50 条
  • [41] Inter-observer agreement of the FDG PET CT visual Herder score for the assessment of solitary pulmonary nodules
    Ordidge, K.
    Gandy, N.
    Arshad, M.
    Soneji, N.
    Wallitt, K.
    Khan, S.
    Barwick, T.
    EUROPEAN JOURNAL OF NUCLEAR MEDICINE AND MOLECULAR IMAGING, 2019, 46 (SUPPL 1) : S573 - S574
  • [42] ACCURACY AND INTER-OBSERVER AGREEMENT AMONG ENDOSCOPISTS FOR VISUAL IDENTIFICATION OF COLORECTAL POLYPS USING ENDOSCOPY IMAGES
    Khuc, Thi
    Agarwal, Amol
    Li, Feng
    Kantsevoy, Sergey
    Hagan, Matilda
    Harris, Mary
    Zhou, Elinor
    Curtin, Bryan
    Maheshwari, Anurag
    Raina, Amit
    Thuluvath, Paul
    GASTROENTEROLOGY, 2022, 162 (07) : S684 - S684
  • [43] Accuracy and Inter-observer Agreement Among Endoscopists for Visual Identification of Colorectal Polyps Using Endoscopy Images
    Thi Khuc
    Agarwal, Amol
    Li, Feng
    Kantsevoy, Sergey
    Curtin, Bryan
    Hagan, Matilda
    Harris, Mary
    Maheshwari, Anurag
    Raina, Amit
    Zhou, Elinor
    Thuluvath, Paul
    DIGESTIVE DISEASES AND SCIENCES, 2023, 68 (02) : 616 - 622
  • [44] Accuracy and Inter-observer Agreement Among Endoscopists for Visual Identification of Colorectal Polyps Using Endoscopy Images
    Thi Khuc
    Amol Agarwal
    Feng Li
    Sergey Kantsevoy
    Bryan Curtin
    Matilda Hagan
    Mary Harris
    Anurag Maheshwari
    Amit Raina
    Elinor Zhou
    Paul Thuluvath
    Digestive Diseases and Sciences, 2023, 68 : 616 - 622
  • [45] A dedicated BI-RADS training programme: Effect on the inter-observer variation among screening radiologists
    Timmers, J. M. H.
    van Doorne-Nagtegaal, H. J.
    Verbeek, A. L. M.
    den Heeten, G. J.
    Broeders, M. J. M.
    EUROPEAN JOURNAL OF RADIOLOGY, 2012, 81 (09) : 2184 - 2188
  • [46] Mammographic breast density classification using a deep neural network: assessment based on inter-observer variability
    Kaiser, N.
    Fieselmann, A.
    Vesal, S.
    Ravikumar, N.
    Ritschl, L.
    Kappler, S.
    Maier, A.
    MEDICAL IMAGING 2019: IMAGE PERCEPTION, OBSERVER PERFORMANCE, AND TECHNOLOGY ASSESSMENT, 2019, 10952
  • [47] Exploring Inter-Observer Differences in First-Person Object Views using Deep Learning Models
    Bambach, Sven
    Zhang, Zehua
    Crandall, David J.
    Yu, Chen
    2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2017), 2017, : 2773 - 2782
  • [48] Inter-Observer Comparison of Structure (En Face RNFL Grading) to Function (Visual Field Points) in Patients with Glaucoma
    King, Brett
    Alluwimi, Muhammed
    Swanson, William H.
    Malinovsky, Victor
    Grogg, Jane Ann
    Sutton, Bradley
    INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 2015, 56 (07)
  • [49] Training Effect on the Inter-observer Agreement in Endoscopic Diagnosis and Grading of Atrophic Gastritis according to Level of Endoscopic Experience
    Jin, Eun Hyo
    Chung, Su Jin
    Lim, Joo Hyun
    Chung, Goh Eun
    Lee, Changhyun
    Yang, Jong In
    Kim, Joo Sung
    JOURNAL OF KOREAN MEDICAL SCIENCE, 2018, 33 (15)
  • [50] IMPORT-LOW PARTIAL BREAST OUTLINING STUDY: USE OF A TRAINING PROTOCOL TO IMPROVE INTER-OBSERVER CONCORDANCE
    Kirby, A.
    Jena, R.
    Tsang, Y.
    Ciurlionis, L.
    Harris, E.
    Yarnold, J. R.
    Coles, C.
    RADIOTHERAPY AND ONCOLOGY, 2011, 99 : S156 - S156