A Generic Participatory Sensing Framework for Multi-modal Datasets

被引:0
|
作者
Wu, Fang-Jing [1 ]
Luo, Tie [1 ]
机构
[1] ASTAR, Inst Infocomm Res, Singapore, Singapore
关键词
Crowdsourcing; participatory sensing; pervasive computing; incentive mechanism; social network;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Participatory sensing has become a promising data collection approach to crowdsourcing data from multi-modal data sources. This paper proposes a generic participatory sensing framework that consists of a set of well-defined modules in support of diverse use cases. This framework incorporates a concept of "human-as-a-sensor" into participatory sensing and allows the public crowd to contribute human observations as well as sensor measurements from their mobile devices. We specifically address two issues: incentive and extensibility, where the former refers to motivating participants to contribute high-quality data while the latter refers to accommodating heterogeneous and uncertain data sources. To address the incentive issue, we design an incentive engine to attract high-quality contributed data independent of data modalities. This engine works together with a novel social network that we introduce into participatory sensing, where participants are linked together and interact with each other based on data quality and quantity they have contributed. To address the extensibility issue, the proposed framework embodies application-agnostic design and provides an interface to external datasets. To demonstrate and verify this framework, we have developed a prototype mobile application called imReporter, which crowdsources hybrid (image-text) reports from participants in an urban city, and incorporates an external dataset from a public data mall. A pilot study was also carried out with 15 participants for 3 consecutive weeks, and the result confirms that our proposed framework fulfills its design goals.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] GEMINI: A Generic Multi-Modal Natural Interface Framework for Videogames
    Teofilo, Luis Filipe
    Nogueira, Pedro Alves
    Silva, Pedro Brandao
    [J]. ADVANCES IN INFORMATION SYSTEMS AND TECHNOLOGIES, 2013, 206 : 873 - 884
  • [2] MULTI-MODAL REMOTE SENSING DATA FUSION FRAMEWORK
    Ghaffar, M. A. A.
    Vu, T. T.
    Maul, T. H.
    [J]. FOSS4G-EUROPE 2017 - ACADEMIC TRACK, 2017, 42-4 (W2): : 85 - 89
  • [3] CLMTR: a generic framework for contrastive multi-modal trajectory representation learning
    Liang, Anqi
    Yao, Bin
    Xie, Jiong
    Zheng, Wenli
    Shen, Yanyan
    Ge, Qiqi
    [J]. GEOINFORMATICA, 2024,
  • [4] An Efficient Multi-Modal Biometric Sensing and Authentication Framework for Distributed Applications
    Tarannum, Ayesha
    Rahman, Zia Ur
    Rao, L. Koteswara
    Srinivasulu, T.
    Lay-Ekuakille, Aime
    [J]. IEEE SENSORS JOURNAL, 2020, 20 (24) : 15014 - 15025
  • [5] Physical Querying with Multi-Modal Sensing
    Baek, Iljoo
    Stine, Taylor
    Dash, Denver
    Xiao, Fanyi
    Sheikh, Yaser
    Movshovitz-Attias, Yair
    Chen, Mei
    Hebert, Martial
    Kanade, Takeo
    [J]. 2014 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2014, : 183 - 190
  • [6] Multi-modal Sensing for Behaviour Recognition
    Wang, Ziwei
    Liu, Jiajun
    Arablouei, Reza
    Bishop-Hurley, Greg
    Matthews, Melissa
    Borges, Paulo
    [J]. PROCEEDINGS OF THE 2022 THE 28TH ANNUAL INTERNATIONAL CONFERENCE ON MOBILE COMPUTING AND NETWORKING, ACM MOBICOM 2022, 2022, : 900 - 902
  • [7] On the Multi-Modal Sensing of Electrical Arcs
    Vasile, Costin
    Ioana, Cornel
    [J]. 2017 IEEE SENSORS APPLICATIONS SYMPOSIUM (SAS), 2017,
  • [8] Integration of multi-modal datasets to estimate human aging
    Ribeiro, Rogerio
    Moraes, Athos
    Moreno, Marta
    Ferreira, Pedro G.
    [J]. MACHINE LEARNING, 2024, : 7293 - 7317
  • [9] MultiJAF: Multi-modal joint entity alignment framework for multi-modal knowledge graph
    Cheng, Bo
    Zhu, Jia
    Guo, Meimei
    [J]. NEUROCOMPUTING, 2022, 500 : 581 - 591
  • [10] A Wireless Signal Correlation Learning Framework for Accurate and Robust Multi-Modal Sensing
    Liu, Xiulong
    Zhang, Bojun
    Chen, Sheng
    Xie, Xin
    Tong, Xinyu
    Gu, Tao
    Li, Keqiu
    [J]. IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2024, 42 (09) : 2424 - 2439