Intelligent Task Allocation for Mobile Crowdsensing With Graph Attention Network and Deep Reinforcement Learning

被引:11
|
作者
Xu, Chenghao [1 ]
Song, Wei [1 ]
机构
[1] Univ New Brunswick, Fac Comp Sci, Fredericton, NB E3B 5A3, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
Deep learning; NP-hard problem; Crowdsensing; Reinforcement learning; Data collection; Space exploration; Resource management; Mobile crowdsensing; task allocation; deep reinforcement learning; graph embedding; double deep Q-network; optimal stopping;
D O I
10.1109/TNSE.2022.3226422
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Mobile crowdsensing (MCS) leverages crowd intelligence, i.e., smart devices and their owners, to collect data in an intelligent and cost-efficient manner. One of the fundamental research problems in MCS is task allocation, where a group of smart device owners are recruited as workers to reach and sense specified targets. In task allocation, task publishers submit their data collection tasks with the constraints and budgets, while workers report their estimated costs and possible constraints associated with data collection. The task allocation problem aims at allocating tasks to workers to maximize profit from the gap between the compensation to workers and the available budget while satisfying constraints from both sides. As task allocation problems are often NP-hard, heuristic schemes are widely used to obtain time-efficient results. However, the performance of heuristic methods may vary significantly in different environments, especially for NP-hard problems. To address task allocation problems in MCS, in this paper, we integrate a carefully designed graph attention network (GAT) into deep reinforcement learning (DRL) and develop a GAT-based DRL method (GDRL) to solve an NP-hard task allocation problem. Compared with manually crafted heuristics, our approach features the flexibility and self-adaptability of DRL, enabling the solver to interact with and adjust to new environments and generalize its experience to different situations. Extensive numerical results show that our proposed method can achieve significantly better results than the reference schemes in various experiment settings.
引用
收藏
页码:1032 / 1048
页数:17
相关论文
共 50 条
  • [1] Task Allocation for Mobile Crowdsensing with Deep Reinforcement Learning
    Tao, Xi
    Song, Wei
    [J]. 2020 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2020,
  • [2] Deep Reinforcement Learning for Task Allocation in Energy Harvesting Mobile Crowdsensing
    Dongare, Sumedh
    Ortiz, Andrea
    Klein, Anja
    [J]. 2022 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM 2022), 2022, : 269 - 274
  • [3] Privacy-Aware Task Allocation Based on Deep Reinforcement Learning for Mobile Crowdsensing
    Yang, Mingchuan
    Zhu, Jinghua
    Xi, Heran
    Yang, Yue
    [J]. WIRELESS ALGORITHMS, SYSTEMS, AND APPLICATIONS, PT III, 2022, 13473 : 191 - 201
  • [4] Federated Deep Reinforcement Learning for Task Participation in Mobile Crowdsensing
    Dongare, Sumedh
    Ortiz, Andrea
    Klein, Anja
    [J]. IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 4436 - 4441
  • [5] A Semiopportunistic Task Allocation Framework for Mobile Crowdsensing with Deep Learning
    Xie, Zhenzhen
    Hu, Liang
    Huang, Yan
    Pang, Junjie
    [J]. WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2021, 2021
  • [6] Dynamic Task Assignment Framework for Mobile Crowdsensing with Deep Reinforcement Learning
    Fu Y.
    Qi K.
    Shi Y.
    Shen Y.
    Xu L.
    Zhang X.
    [J]. Wireless Communications and Mobile Computing, 2023, 2023
  • [7] An Adaptive Data Uploading Scheme for Mobile Crowdsensing via Deep Reinforcement Learning With Graph Neural Network
    Xu, Chenghao
    Song, Wei
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (18) : 18064 - 18078
  • [8] Near-Optimal Vehicular Crowdsensing Task Allocation Empowered by Deep Reinforcement Learning
    Xiang C.-C.
    Li Y.-Y.
    Feng L.
    Chen C.
    Guo S.-T.
    Yang P.-L.
    [J]. Jisuanji Xuebao/Chinese Journal of Computers, 2022, 45 (05): : 918 - 934
  • [9] Network-Side Task Allocation for Mobile Crowdsensing
    Nakayama, Yu
    [J]. 2020 IEEE 17TH ANNUAL CONSUMER COMMUNICATIONS & NETWORKING CONFERENCE (CCNC 2020), 2020,
  • [10] Intelligent Offloading in Blockchain-Based Mobile Crowdsensing Using Deep Reinforcement Learning
    Chen, Zheyi
    Yu, Zhengxin
    [J]. IEEE COMMUNICATIONS MAGAZINE, 2023, 61 (06) : 118 - 123