Multimodal Co-Presence Detection with Varying Spatio-Temporal Granularity

被引:0
|
作者
Haus, Michael [1 ]
Ding, Aaron Yi [2 ]
Ott, Joerg [1 ]
机构
[1] Tech Univ Munich, Dept Comp Sci, Munich, Germany
[2] Delft Univ Technol, Dept Engn Syst & Serv, Delft, Netherlands
关键词
Co-presence detection; Multimodal sensor dataset; User mobility; Device heterogeneity; Sensor energy use;
D O I
10.1109/percomworkshops48775.2020.9156105
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Pervasive computing environments are characterized by a plethora of sensing and communication-enabled devices that diffuse themselves among different users. Built-in sensors and telecommunication infrastructure allow co-presence detection. In turn, co-presence detection enables context-aware applications, like those for social networking among close-by users, and for modeling human behavior. We aim to support developers building better context-aware applications by a deepened understanding of which set of context information is appropriate for co-presence detection. We have gathered a multimodal dataset for proximity sensing, including several proximity verification sets, like Bluetooth, Wi-Fi, and GSM encounters, to be able to associate sensor's data with a spatial granularity. We show that sensor modalities are suitable to recognize the spatial adjacency of users with different spatio-temporal granularity. We find that individual user mobility has only a minor, negligible effect on co-presence detection. In contrast, the heterogeneity of device's sensor hardware has a major negative impact on co-presence detection. To reveal energy pitfalls with respect to usability, we perform an energy analysis pertaining to the usage stemming from different sensors for co-presence detection.
引用
收藏
页数:7
相关论文
共 50 条
  • [1] Spatio-temporal Multimodal Mean
    Azmat, Shoaib
    Wills, Linda
    Wills, Scott
    [J]. 2014 IEEE SOUTHWEST SYMPOSIUM ON IMAGE ANALYSIS AND INTERPRETATION (SSIAI 2014), 2014, : 81 - 84
  • [2] DepMSTAT: Multimodal Spatio-Temporal Attentional Transformer for Depression Detection
    Tao, Yongfeng
    Yang, Minqiang
    Li, Huiru
    Wu, Yushan
    Hu, Bin
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (07) : 2956 - 2966
  • [3] Spatio-Temporal Multimodal Developmental Learning
    Zhang, Yilu
    Weng, Juyang
    [J]. IEEE TRANSACTIONS ON AUTONOMOUS MENTAL DEVELOPMENT, 2010, 2 (03) : 149 - 166
  • [4] Spatio-temporal Granularity Co-optimization Based Monthly Electricity Consumption Forecasting
    Li, Kangping
    Wang, Yuqing
    Zhang, Ning
    Wang, Fei
    Huang, Chunyi
    [J]. CSEE JOURNAL OF POWER AND ENERGY SYSTEMS, 2023, 9 (05): : 1980 - 1984
  • [5] A multidimensional approach to the representation of the spatio-temporal multi-granularity
    Gascuena, Concepcion M.
    Cuadra, Dolores
    Martinez, Paloma
    [J]. ICEIS 2006: PROCEEDINGS OF THE EIGHTH INTERNATIONAL CONFERENCE ON ENTERPRISE INFORMATIONAL SYSTEMS: DATABASES AND INFORMATION SYSTEMS INTEGRATION, 2006, : 175 - +
  • [6] Time varying spatio-temporal covariance models
    Ip, Ryan H. L.
    Li, W. K.
    [J]. SPATIAL STATISTICS, 2015, 14 : 269 - 285
  • [7] Deconfounded Multimodal Learning for Spatio-temporal Video Grounding
    Wang, Jiawei
    Ma, Zhanchang
    Cao, Da
    Le, Yuquan
    Xiao, Junbin
    Chua, Tat-Seng
    [J]. PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 7521 - 7529
  • [8] Multimodal Spatio-Temporal Prediction with Stochastic Adversarial Networks
    Saxena, Divya
    Cao, Jiannong
    [J]. ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2022, 13 (02)
  • [9] Deep spatio-temporal features for multimodal emotion recognition
    Nguyen, Dung
    Nguyen, Kien
    Sridharan, Sridha
    Ghasemi, Afsane
    Dean, David
    Fookes, Clinton
    [J]. 2017 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2017), 2017, : 1215 - 1223
  • [10] Transformer RGBT Tracking With Spatio-Temporal Multimodal Tokens
    Sun, Dengdi
    Pan, Yajie
    Lu, Andong
    Li, Chenglong
    Luo, Bin
    [J]. IEEE Transactions on Circuits and Systems for Video Technology, 2024, 34 (11) : 12059 - 12072