Blockchain-Based Distributed Multiagent Reinforcement Learning for Collaborative Multiobject Tracking Framework

被引:16
|
作者
Shen, Jiahao [1 ,2 ]
Sheng, Hao [1 ,2 ]
Wang, Shuai [1 ,2 ]
Cong, Ruixuan [1 ,2 ]
Yang, Da [1 ,2 ]
Zhang, Yang [3 ]
机构
[1] Beihang Univ, Sch Comp Sci & Engn, State Key Lab Virtual Real Technol & Syst, Beijing 100191, Peoples R China
[2] Beihang Univ, Zhongfa Aviat Inst, Key Lab Data Sci & Intelligent Comp, Hangzhou 311115, Peoples R China
[3] Beijing Univ Chem Technol, Coll Informat Sci & Technol, Beijing 100029, Peoples R China
关键词
Computer vision; multi-object tracking; reinforcement learning; blockchain;
D O I
10.1109/TC.2023.3343102
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
With the development of smart cities, video surveillance has become more prevalent in urban areas. The rapid growth of data brings challenges to video processing and analysis. Multi-object tracking (MOT), one of the most fundamental tasks in computer vision, has a wide range of applications and development prospects. MOT aims to locate multiple objects and maintain their unique identities by analyzing the video frame by frame. Most existing MOT frameworks are deployed in centralized systems, which are convenient for management but have problems such as weak algorithm adaptability, limited system scalability, and poor data security. In this paper, we propose a distributed MOT algorithm based on multi-agent reinforcement learning (DMARL-Tracker), which formulates MOT as a Markov decision process (MDP). Each object adjusts its tracking strategy during interactions with the environment. The benchmark results on MOT17 and MOT20 prove that our proposed algorithm achieves state-of-the-art (SOTA) performance. Based on this, we further integrate DMARL-Tracker into the blockchain and propose a blockchain-based collaborative MOT framework. All nodes collaborate and share information through the blockchain, achieving adaptation in different complex scenarios while ensuring data security. The simulation results show that our framework achieves good performance in terms of tracking and resource consumption.
引用
收藏
页码:778 / 788
页数:11
相关论文
共 50 条
  • [1] Blockchain-based collaborative data analysis framework for distributed medical knowledge extraction
    Li, Zhi
    Li, Ming
    Li, Aofei
    Lin, Zhiyu
    COMPUTERS & INDUSTRIAL ENGINEERING, 2024, 190
  • [2] Distributed Multi-Agent Reinforcement Learning for Collaborative Path Planning and Scheduling in Blockchain-Based Cognitive Internet of Vehicles
    Chang, Huigang
    Liu, Yiming
    Sheng, Zhengguo
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (05) : 6301 - 6317
  • [3] Distributed Value Function Approximation for Collaborative Multiagent Reinforcement Learning
    Stankovic, Milos S.
    Beko, Marko
    Stankovic, Srdjan S.
    IEEE TRANSACTIONS ON CONTROL OF NETWORK SYSTEMS, 2021, 8 (03): : 1270 - 1280
  • [4] Multiobject Tracking in Videos Based on LSTM and Deep Reinforcement Learning
    Jiang, Ming-xin
    Deng, Chao
    Pan, Zhi-geng
    Wang, Lan-fang
    Sun, Xing
    COMPLEXITY, 2018,
  • [5] A Blockchain-Based Collaborative Intrusion Detection Systems Framework
    Alharbi, Shatha
    Alghazzawi, Daniyal
    Hakeem, Abeer
    Mohaisen, Linda
    Cheng, Li
    Attiah, Afraa
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (15): : 25481 - 25493
  • [6] Blockchain-Based Distributed Renewable Energy Management Framework
    Alsunaidi, Shikah J.
    Khan, Fakhri Alam
    IEEE ACCESS, 2022, 10 : 81888 - 81898
  • [7] HBFL: A hierarchical blockchain-based federated learning framework for collaborative IoT intrusion detection
    Sarhan, Mohanad
    Lo, Wai Weng
    Layeghy, Siamak
    Portmann, Marius
    COMPUTERS & ELECTRICAL ENGINEERING, 2022, 103
  • [8] A Blockchain-Based Framework for Distributed Agile Software Development
    Farooq, Muhammad Shoaib
    Kalim, Zareen
    Qureshi, Junaid Nasir
    Rasheed, Saim
    Abid, Adnan
    IEEE ACCESS, 2022, 10 : 17977 - 17995
  • [9] A blockchain-based decentralized machine learning framework for collaborative intrusion detection within UAVs
    Khan, Ammar Ahmed
    Khan, Muhammad Mubashir
    Khan, Kashif Mehboob
    Arshad, Junaid
    Ahmad, Farhan
    COMPUTER NETWORKS, 2021, 196
  • [10] Blockchain-based crowdsourced deep reinforcement learning as a service
    Alagha, Ahmed
    Otrok, Hadi
    Singh, Shakti
    Mizouni, Rabeb
    Bentahar, Jamal
    INFORMATION SCIENCES, 2024, 679