AN INTER-OBSERVER CONSISTENT DEEP ADVERSARIAL TRAINING FOR VISUAL SCANPATH PREDICTION

被引:0
|
作者
Kerkouri, Mohamed Amine [1 ]
Tliba, Marouane [1 ]
Chetouani, Aladine [1 ]
Bruno, Alessandro [2 ]
机构
[1] Univ Orleans, Lab PRISME, Orleans, France
[2] IULM Univ, Milan, Italy
关键词
Visual Attention; scanpath prediction; adversarial training; inter-observer consistency;
D O I
10.1109/ICIP49359.2023.10222686
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The visual scanpath represents the fundamental concept upon which visual attention research is based. As a result, the ability to predict them has emerged as a crucial task in recent years. It is represented as a sequence of points through which the human gaze moves while exploring a scene. In this paper, we propose an inter-observer consistent adversarial training approach for scanpath prediction through a lightweight deep neural network. The proposed method employs a discriminative neural network as a dynamic loss that better models the natural stochastic phenomenon while maintaining consistency between the distributions related to the subjective nature of scanpaths traversed by different observers. The competitiveness of our approach against state-of-the-art methods is shown through a testing phase.
引用
收藏
页码:2595 / 2599
页数:5
相关论文
共 50 条
  • [1] DEEP LEARNING FOR INTER-OBSERVER CONGRUENCY PREDICTION
    Bruckert, Alexandre
    Lam, Yat Hong
    Christie, Marc
    Le Meur, Olivier
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 3766 - 3770
  • [2] PathGAN: Visual Scanpath Prediction with Generative Adversarial Networks
    Assens, Marc
    Giro-i-Nieto, Xavier
    McGuinness, Kevin
    O'Connor, Noel E.
    COMPUTER VISION - ECCV 2018 WORKSHOPS, PT V, 2019, 11133 : 406 - 422
  • [3] Inter-Observer Visual Congruency in Video-Viewing
    Yue, Jiaomin
    Lu, Qiang
    Zhu, Dandan
    Min, Xiongkuo
    Zhang, Xiao-Ping
    Zhai, Guangtao
    2021 INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2021,
  • [4] Library of plans in radiotherapy of rectal cancer: feasible and inter-observer consistent?
    Van Beek, S.
    Hartgring, L.
    Betgen, A.
    Stam, J.
    Buijs, M.
    Van Triest, B.
    Remeijer, P.
    RADIOTHERAPY AND ONCOLOGY, 2016, 119 : S223 - S223
  • [5] Inter-observer and intra-observer agreement in the interpretation of visual fields in glaucoma
    A J King
    D Farnworth
    J R Thompson
    Eye, 1997, 11 : 687 - 691
  • [6] Inter-observer and intra-observer agreement in the interpretation of visual fields in glaucoma
    King, AJ
    Farnworth, D
    Thompson, JR
    EYE, 1997, 11 (5) : 687 - 691
  • [7] Visual diagnosis of pectus excavatum: An inter-observer and intra-observer agreement analysis
    Daemen, Jean H. T.
    de Loos, Erik R.
    Geraedts, Tessa C. M.
    van Veer, Hans
    Van Huijstee, Pieter Jan
    Elenbaas, Ted W. O.
    Hulsewe, Karel W. E.
    Vissers, Yvonne L. J.
    JOURNAL OF PEDIATRIC SURGERY, 2022, 57 (03) : 526 - 531
  • [8] Inter-observer agreement on visual field progression in glaucoma: A comparison of methods
    Viswanathan, AC
    Crabb, DP
    Westcott, MC
    McNaught, AI
    Fitzke, FW
    Hitchings, RA
    INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 1997, 38 (04) : 2662 - 2662
  • [9] Reducing inter-observer variability in embryo evaluation by means of training courses
    de Assin, Rafael Ruiz
    Clavero, Ana
    Gonzalvo, Maria Carmen
    Rosales, Antonio
    Zamora, Sandra
    Martinez, Luis
    Mozas, Juan
    Castilla, Jose Antonio
    JOURNAL OF ASSISTED REPRODUCTION AND GENETICS, 2011, 28 (11) : 1129 - 1133
  • [10] Effect of training on the inter-observer reliability of lameness scoring in dairy cattle
    March, S.
    Brinkmann, J.
    Winkler, C.
    ANIMAL WELFARE, 2007, 16 (02) : 131 - 133