Semantic-driven Performance Optimization for UAV Based Object Detection

被引:0
|
作者
Guo, Jiaxin [1 ]
Zhu, Kun [1 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Coll Comp Sci & Technol, Nanjing, Peoples R China
关键词
Semantic communication; UAV; object detection; trajectory design; power allocation; hierarchical deep reinforcement learning; SURVEILLANCE;
D O I
10.1109/iThings-GreenCom-CPSCom-SmartData-Cybermatics60724.2023.00082
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Unmanned aerial vehicles (UAVs) often need to capture and transmit videos to accomplish intelligent tasks. Minimizing the channel pressure from video transmission while ensuring task quality is a crucial challenge. Semantic communication is envisioned as a new paradigm for future intelligent task-oriented applications in 6G networks. However, the existing semantic communication frameworks require devices independently performing numerous computations to extract semantic features, which is unbearable for energy-limited UAVs. In this paper, we propose an efficient semantic communication framework for the object detection. Our proposed framework is able to address this issue by compressing transmitted data and offloading complex computational tasks to an adjoining edge server. This offloading strategy significantly reduces the computational loads for the UAVs. To measure the performance of the proposed framework, we propose a new semantic metric named quantity of detected objects (QoDO), which jointly considers the impact of video acquisition and transmission processes on the number of targets detected. Subsequently, we propose a semantic driven optimization scheme for UAV trajectory design and power allocation. To solve this problem, a hierarchical deep reinforcement learning algorithm based on two Deep Deterministic Policy Gradient (DDPG) networks (H2DDPG) is proposed. Simulation results show that the proposed framework and scheme achieve a steady improvement in the total QoDO compared to the existing schemes that without considering semantics. The proposed semantic driven optimization method is practical in solving performance bottlenecks for intelligent task-oriented communication systems.
引用
收藏
页码:383 / 389
页数:7
相关论文
共 50 条
  • [1] Semantic-driven bitrate optimization algorithm
    Chen Feng
    Huang Faren
    Chen Pingping
    Chen Yanying
    [J]. The Journal of China Universities of Posts and Telecommunications., 2024, 31 (06) - 87
  • [2] Event Detection Based on Hierarchical Latent Semantic-Driven Network
    Xiao, Mengnan
    He, Ruifang
    Ma, Jinsong
    [J]. Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2024, 61 (01): : 184 - 195
  • [3] Semantic-driven performance evaluation - Extended abstract
    Nottegar, C
    Priami, C
    Degano, P
    [J]. FUNDAMENTAL APPROACHES TO SOFTWARE ENGINEERING, 1999, 1577 : 204 - 218
  • [4] SREDet: Semantic-Driven Rotational Feature Enhancement for Oriented Object Detection in Remote Sensing Images
    Zhang, Zehao
    Wang, Chenhan
    Zhang, Huayu
    Qi, Dacheng
    Liu, Qingyi
    Wang, Yufeng
    Ding, Wenrui
    [J]. REMOTE SENSING, 2024, 16 (13)
  • [5] Semantic-driven multi-camera pedestrian detection
    Lopez-Cifuentes, Alejandro
    Escudero-Vinolo, Marcos
    Bescos, Jesus
    Carballeira, Pablo
    [J]. KNOWLEDGE AND INFORMATION SYSTEMS, 2022, 64 (05) : 1211 - 1237
  • [6] Semantic-driven multi-camera pedestrian detection
    Alejandro López-Cifuentes
    Marcos Escudero-Viñolo
    Jesús Bescós
    Pablo Carballeira
    [J]. Knowledge and Information Systems, 2022, 64 : 1211 - 1237
  • [7] Semantic-Driven Face Hallucination Based on Residual Network
    Yu, Xiaoyuan
    Zhang, Langwen
    Xie, Wei
    [J]. IEEE Transactions on Biometrics, Behavior, and Identity Science, 2021, 3 (02): : 214 - 228
  • [8] Semantic-Driven Information Recommendation System
    Huang, Zhenhua
    Fang, Qiang
    [J]. SENSORS, MEASUREMENT AND INTELLIGENT MATERIALS II, PTS 1 AND 2, 2014, 475-476 : 1226 - 1229
  • [9] A semantic-driven approach for Industry 4.0
    Cho, Sangje
    May, Gokan
    Kiritsis, Dimitris
    [J]. 2019 15TH INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING IN SENSOR SYSTEMS (DCOSS), 2019, : 347 - 354
  • [10] Research on Semantic-driven Intelligent Color Design based on DNN
    Gou, Bingchen
    Zhou, Ye
    Yu, Suihuai
    Wang, Weiwei
    [J]. FUTURE INFORMATION TECHNOLOGY, 2011, 13 : 218 - 222