Blockchain-Based Distributed Multiagent Reinforcement Learning for Collaborative Multiobject Tracking Framework

被引:16
|
作者
Shen, Jiahao [1 ,2 ]
Sheng, Hao [1 ,2 ]
Wang, Shuai [1 ,2 ]
Cong, Ruixuan [1 ,2 ]
Yang, Da [1 ,2 ]
Zhang, Yang [3 ]
机构
[1] Beihang Univ, Sch Comp Sci & Engn, State Key Lab Virtual Real Technol & Syst, Beijing 100191, Peoples R China
[2] Beihang Univ, Zhongfa Aviat Inst, Key Lab Data Sci & Intelligent Comp, Hangzhou 311115, Peoples R China
[3] Beijing Univ Chem Technol, Coll Informat Sci & Technol, Beijing 100029, Peoples R China
关键词
Computer vision; multi-object tracking; reinforcement learning; blockchain;
D O I
10.1109/TC.2023.3343102
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
With the development of smart cities, video surveillance has become more prevalent in urban areas. The rapid growth of data brings challenges to video processing and analysis. Multi-object tracking (MOT), one of the most fundamental tasks in computer vision, has a wide range of applications and development prospects. MOT aims to locate multiple objects and maintain their unique identities by analyzing the video frame by frame. Most existing MOT frameworks are deployed in centralized systems, which are convenient for management but have problems such as weak algorithm adaptability, limited system scalability, and poor data security. In this paper, we propose a distributed MOT algorithm based on multi-agent reinforcement learning (DMARL-Tracker), which formulates MOT as a Markov decision process (MDP). Each object adjusts its tracking strategy during interactions with the environment. The benchmark results on MOT17 and MOT20 prove that our proposed algorithm achieves state-of-the-art (SOTA) performance. Based on this, we further integrate DMARL-Tracker into the blockchain and propose a blockchain-based collaborative MOT framework. All nodes collaborate and share information through the blockchain, achieving adaptation in different complex scenarios while ensuring data security. The simulation results show that our framework achieves good performance in terms of tracking and resource consumption.
引用
收藏
页码:778 / 788
页数:11
相关论文
共 50 条
  • [31] Collaborative multiagent reinforcement learning by payoff propagation
    Kok, Jelle R.
    Vlassis, Nikos
    JOURNAL OF MACHINE LEARNING RESEARCH, 2006, 7 : 1789 - 1828
  • [32] SecureRx: A blockchain-based framework for an electronic prescription system with opioids tracking
    Alnafrani, May
    Acharya, Subrata
    HEALTH POLICY AND TECHNOLOGY, 2021, 10 (02)
  • [33] A semi-autonomous distributed blockchain-based framework for UAVs system
    Ge, Chunpeng
    Ma, Xinshu
    Liu, Zhe
    JOURNAL OF SYSTEMS ARCHITECTURE, 2020, 107
  • [34] DMap: A Distributed Blockchain-based Framework for Online Mapping in Smart City
    MohammadZadeh, Fatemeh
    Mirghasemi, Seyed Ali
    Dorri, Ali
    Ahmadifar, HamidReza
    2019 9TH INTERNATIONAL CONFERENCE ON COMPUTER AND KNOWLEDGE ENGINEERING (ICCKE 2019), 2019, : 397 - 402
  • [35] Blockchain Oracles: A Framework for Blockchain-Based Applications
    Mammadzada, Kamran
    Iqbal, Mubashar
    Milani, Fredrik
    Garcia-Banuelos, Luciano
    Matulevicius, Raimundas
    BUSINESS PROCESS MANAGEMENT: BLOCKCHAIN AND ROBOTIC PROCESS AUTOMATION FORUM, BPM 2020 BLOCKCHAIN AND RPA FORUM, 2020, 393 : 19 - 34
  • [36] FalconDB: Blockchain-based Collaborative Database
    Peng, Yanqing
    Du, Min
    Li, Feifei
    Cheng, Raymond
    Song, Dawn
    SIGMOD'20: PROCEEDINGS OF THE 2020 ACM SIGMOD INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA, 2020, : 637 - 652
  • [37] A semi-autonomous distributed blockchain-based framework for UAVs system
    Ge, Chunpeng
    Ma, Xinshu
    Liu, Zhe
    Journal of Systems Architecture, 2020, 107
  • [38] Blockchain-Based Crowdsourcing Framework with Distributed Task Assignment and Solution Verification
    Li, Shasha
    Bai, Xiaodong
    Wei, Songjie
    SECURITY AND COMMUNICATION NETWORKS, 2022, 2022
  • [39] BCAFL: A Blockchain-Based Framework for Asynchronous Federated Learning Protection
    Yun, Jian
    Lu, Yusheng
    Liu, Xinyu
    ELECTRONICS, 2023, 12 (20)
  • [40] A Blockchain-Based Machine Learning Framework for Edge Services in IIoT
    Tian, Youliang
    Li, Ta
    Xiong, Jinbo
    Bhuiyan, Md Zakirul Alam
    Ma, Jianfeng
    Peng, Changgen
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2022, 18 (03) : 1918 - 1929