Distributed Task-Oriented Communication Networks with Multimodal Semantic Relay and Edge Intelligence

被引:1
|
作者
Guo, Jie [1 ]
Chen, Hao [2 ]
Song, Bin [3 ]
Chi, Yuhao [1 ]
Yuen, Chau [4 ]
Yu, Fei Richard [5 ]
Li, Geoffrey Ye [6 ]
Niyato, Dusit [7 ]
机构
[1] Xidian Univ, Xian, Peoples R China
[2] Xidian Univ, Hangzhou Inst Technol, Xian, Peoples R China
[3] Xidian Univ, Informat & Telecommun Engn, Xian, Peoples R China
[4] Nanyang Technol Univ, Singapore, Singapore
[5] Carleton Univ, Ottawa, ON, Canada
[6] Imperial Coll London, London, England
[7] Nanyang Technol Univ, Sch Comp Sci & Engn, Singapore, Singapore
基金
中国国家自然科学基金;
关键词
Semantics; Task analysis; Relays; Feature extraction; Servers; Correlation; Wireless communication;
D O I
10.1109/MCOM.001.2300155
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this article, we present a novel framework, named distributed task-oriented communication networks (DTCN), based on recent advances in multimodal semantic transmission and edge intelligence. In DTCN, the multimodal knowledge of semantic relays and the adaptive adjustment capability of edge intelligence can be integrated to improve task performance. Specifically, we propose the key techniques in the framework, such as semantic alignment and complement, a semantic relay scheme for deep joint source-channel relay coding, and collaborative device-server optimization and inference. Furthermore, a multimodal classification task is used as an example to demonstrate the benefits of the proposed DTCN over existing methods. Numerical results validate that DTCN can significantly improve the accuracy of classification tasks, even in harsh communication scenarios (e.g., low signal-to-noise regime), thanks to multimodal semantic relay and edge intelligence.
引用
收藏
页码:82 / 89
页数:8
相关论文
共 50 条
  • [1] Intelligent task-oriented semantic communication method in artificial intelligence of things
    Liu, Chuanhong
    Guo, Caili
    Yang, Yang
    Feng, Chunyan
    Sun, Qizheng
    Chen, Jiujiu
    [J]. Tongxin Xuebao/Journal on Communications, 2021, 42 (11): : 97 - 108
  • [2] Task-Oriented Semantic Communication Based on Semantic Triplets
    Liu, Chuanhong
    Guo, Caili
    Wang, Siyi
    Li, Yuze
    Hu, Dingxin
    [J]. 2023 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE, WCNC, 2023,
  • [3] Task-Oriented Multimodal Communication Based on Cloud-Edge-UAV Collaboration
    Ren, Chao
    Gong, Chao
    Liu, Luchuan
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (01): : 125 - 136
  • [4] Task-Oriented Semantic Communication with Foundation Models
    Chen Mingkai
    Liu Minghao
    Zhang Zhe
    Xu Zhiping
    Wang Lei
    [J]. ChinaCommunications., 2024, 21 (07) - 77
  • [5] Task-Oriented Semantic Communication with Foundation Models
    Chen, Mingkai
    Liu, Minghao
    Zhe, Zhang
    Xu, Zhiping
    Lei, Wang
    [J]. CHINA COMMUNICATIONS, 2024, 21 (07) : 65 - 77
  • [6] Task-Oriented Communication for Edge Video Analytics
    Shao, Jiawei
    Zhang, Xinjie
    Zhang, Jun
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (05) : 4141 - 4154
  • [7] Task-Oriented Communication for Multidevice Cooperative Edge Inference
    Shao, Jiawei
    Mao, Yuyi
    Zhang, Jun
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2023, 22 (01) : 73 - 87
  • [8] Toward Ambient Intelligence: Federated Edge Learning With Task-Oriented Sensing, Computation, and Communication Integration
    Liu, Peixi
    Zhu, Guangxu
    Wang, Shuai
    Jiang, Wei
    Luo, Wu
    Poor, H. Vincent
    Cui, Shuguang
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2023, 17 (01) : 158 - 172
  • [9] Toward Intelligent Resource Allocation on Task-Oriented Semantic Communication
    Zhang, Haijun
    Wang, Hongyu
    Li, Yabo
    Long, Keping
    Leung, Victor C. M.
    [J]. IEEE WIRELESS COMMUNICATIONS, 2023, 30 (03) : 70 - 77
  • [10] Task-Oriented and Semantic-Aware Heterogeneous Networks for Artificial Intelligence of Things: Performance Analysis and Optimization
    Xu, Xiaodong
    Xu, Bingxuan
    Han, Shujun
    Dong, Chen
    Xiong, Huachao
    Meng, Rui
    Zhang, Ping
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (01) : 228 - 242