Large-Scale Bandwidth and Power Optimization for Multi-Modal Edge Intelligence Autonomous Driving

被引:4
|
作者
Li, Xinrao [1 ]
Zhang, Tong [2 ]
Wang, Shuai [3 ]
Zhu, Guangxu [4 ]
Wang, Rui [1 ]
Chang, Tsung-Hui [4 ,5 ]
机构
[1] Southern Univ Sci & Technol, Dept Elect & Elect Engn, Shenzhen 518055, Peoples R China
[2] Jinan Univ, Coll Informat Sci & Technol, Guangzhou 510632, Peoples R China
[3] Chinese Acad Sci, Shenzhen Inst Adv Technol, Shenzhen 518055, Peoples R China
[4] Shenzhen Res Inst Big Data, Shenzhen 518172, Peoples R China
[5] Chinese Univ Hong Kong Shenzhen, Sch Sci & Engn, Shenzhen 518172, Peoples R China
基金
中国国家自然科学基金;
关键词
Training; Resource management; Autonomous vehicles; Bandwidth; Servers; Task analysis; Optimization; Autonomous driving; edge intelligence; large-scale optimization;
D O I
10.1109/LWC.2023.3262573
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Edge intelligence autonomous driving (EIAD) offers computing resources in autonomous vehicles for training deep neural networks. However, wireless channels between the edge server and the autonomous vehicles are time-varying due to the high-mobility of vehicles. Moreover, the required number of training samples for different data modalities, e.g., images, point-clouds, is diverse. Consequently, when collecting these datasets from vehicles to the edge server, the associated bandwidth and power allocation across all data frames is a large-scale multi-modal optimization problem. This letter proposes a highly computationally efficient algorithm that directly maximizes the quality of training (QoT). The key ingredients include a data-driven model for quantifying the priority of data modality and two first-order methods termed accelerated gradient projection and dual decomposition for low-complexity resource allocation. Finally, high-fidelity simulations in Car Learning to Act (CARLA) show that the proposed algorithm reduces the perception error by 3% and the computation time by 98%.
引用
收藏
页码:1096 / 1100
页数:5
相关论文
共 50 条
  • [21] A Discrete-Time Model for Large-Scale Multi-Modal Transport Networks
    Pasquale, C.
    Siri, E.
    Sacone, S.
    Siri, S.
    IFAC PAPERSONLINE, 2021, 54 (02): : 7 - 12
  • [22] High-Order Correlation Embedding for Large-Scale Multi-modal Hashing
    An, Junfeng
    Li, Yingjian
    Zhang, Zheng
    Chen, Yongyong
    Lu, Guangming
    WEB AND BIG DATA, PT II, APWEB-WAIM 2022, 2023, 13422 : 175 - 182
  • [23] Retrieval From and Understanding of Large-Scale Multi-modal Medical Datasets: A Review
    Mueller, Henning
    Unay, Devrim
    IEEE TRANSACTIONS ON MULTIMEDIA, 2017, 19 (09) : 2093 - 2104
  • [24] Large-scale Multi-modal Pre-trained Models: A Comprehensive Survey
    Xiao Wang
    Guangyao Chen
    Guangwu Qian
    Pengcheng Gao
    Xiao-Yong Wei
    Yaowei Wang
    Yonghong Tian
    Wen Gao
    Machine Intelligence Research, 2023, 20 : 447 - 482
  • [25] A Hierarchical Framwork with Improved Loss for Large-scale Multi-modal Video Identification
    Zhang, Shichuan
    Tang, Zengming
    Pan, Hao
    Wei, Xinyu
    Huang, Jun
    PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19), 2019, : 2539 - 2542
  • [26] Fast Discrete Collaborative Multi-Modal Hashing for Large-Scale Multimedia Retrieval
    Zheng, Chaoqun
    Zhu, Lei
    Lu, Xu
    Li, Jingjing
    Cheng, Zhiyong
    Zhang, Hanwang
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2020, 32 (11) : 2171 - 2184
  • [27] A Dataset and Benchmark for Large-scale Multi-modal Face Anti-spoofing
    Zhang, Shifeng
    Wang, Xiaobo
    Liu, Ajian
    Zhao, Chenxu
    Wan, Jun
    Escalera, Sergio
    Shi, Hailin
    Wang, Zezheng
    Li, Stan Z.
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 919 - 928
  • [28] Large-scale Multi-modal Pre-trained Models: A Comprehensive Survey
    Wang, Xiao
    Chen, Guangyao
    Qian, Guangwu
    Gao, Pengcheng
    Wei, Xiao-Yong
    Wang, Yaowei
    Tian, Yonghong
    Gao, Wen
    MACHINE INTELLIGENCE RESEARCH, 2023, 20 (04) : 447 - 482
  • [29] A Modeling Framework for Passengers and Freight in Large-Scale Multi-Modal Transport Networks
    Pasquale, C.
    Siri, E.
    Sacone, S.
    Siri, S.
    2021 29TH MEDITERRANEAN CONFERENCE ON CONTROL AND AUTOMATION (MED), 2021, : 681 - 686
  • [30] Multi-modal policy fusion for end-to-end autonomous driving
    Huang, Zhenbo
    Sun, Shiliang
    Zhao, Jing
    Mao, Liang
    INFORMATION FUSION, 2023, 98