Multimodal Context-Based Continuous Authentication

被引:0
|
作者
Aathreya, Saandeep [1 ]
Chaudhary, Meghna [1 ]
Neal, Tempestt [1 ]
Canavan, Shaun [1 ]
机构
[1] Univ S Florida, Tampa, FL 33620 USA
基金
美国国家科学基金会;
关键词
EXPRESSION;
D O I
10.1109/IJCB57857.2023.10448626
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present a new multimodal, context-based dataset for continuous authentication. The dataset contains 27 subjects, with an age range of [8, 72], where data has been collected across multiple sessions while the subjects are watching videos meant to elicit an emotional response. Collected data includes accelerometer data, heart rate, electrodermal activity, skin temperature, and face videos. We also propose a baseline approach for fair comparisons when using the proposed dataset. The approach uses a combination of a pretrained backbone network with supervised contrastive loss for face. Time-series features are also extracted, from the physiological signals, which are used for classification. This approach, on the proposed dataset, results in an average accuracy, precision, and recall of 76.59%, 88.90, and 53.25, respectively, on electrical signals, and 90.39%, 98.77, and 75.71, respectively on face videos.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Context-Based Adaptive and Responsive Authentication
    Lenzini, Gabriele
    Hulsebosch, Bob
    [J]. ERCIM NEWS, 2007, (71): : 34 - 35
  • [2] Revisiting Context-Based Authentication in loT
    Miettinen, Markus
    Thien Duc Nguyen
    Sadeghi, Ahmad-Reza
    Asokan, N.
    [J]. 2018 55TH ACM/ESDA/IEEE DESIGN AUTOMATION CONFERENCE (DAC), 2018,
  • [3] Context-based authentication and transport of cultural assets
    Leonardo Mostarda
    Changyu Dong
    Naranker Dulay
    [J]. Personal and Ubiquitous Computing, 2010, 14 : 321 - 334
  • [4] Context-based authentication and transport of cultural assets
    Mostarda, Leonardo
    Dong, Changyu
    Dulay, Naranker
    [J]. PERSONAL AND UBIQUITOUS COMPUTING, 2010, 14 (04) : 321 - 334
  • [5] Context-Based Adaptive Multimodal Fusion Network for Continuous Frame-Level Sentiment Prediction
    Huang, Maochun
    Qing, Chunmei
    Tan, Junpeng
    Xu, Xiangmin
    [J]. IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2023, 31 : 3468 - 3477
  • [6] Context-based multimodal input understanding in conversational systems
    Chai, J
    Pan, SM
    Zhou, MX
    Houck, K
    [J]. FOURTH IEEE INTERNATIONAL CONFERENCE ON MULTIMODAL INTERFACES, PROCEEDINGS, 2002, : 87 - 92
  • [7] Model for adaptable context-based biometric authentication for mobile devices
    Adam Wójtowicz
    Krzysztof Joachimiak
    [J]. Personal and Ubiquitous Computing, 2016, 20 : 195 - 207
  • [8] Model for adaptable context-based biometric authentication for mobile devices
    Wojtowicz, Adam
    Joachimiak, Krzysztof
    [J]. PERSONAL AND UBIQUITOUS COMPUTING, 2016, 20 (02) : 195 - 207
  • [9] Context-Based Method Using Bayesian Network in Multimodal Fission System
    Zaguia, Atef
    Tadj, Chakib
    Ramdane-Cherif, Amar
    [J]. INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE SYSTEMS, 2015, 8 (06) : 1076 - 1090
  • [10] Context-Based Method Using Bayesian Network in Multimodal Fission System
    Atef Zaguia
    Chakib Tadj
    Amar Ramdane-Cherif
    [J]. International Journal of Computational Intelligence Systems, 2015, 8 : 1076 - 1090