Wireless Image Retrieval at the Edge

被引:140
|
作者
Jankowski, Mikolaj [1 ]
Gunduz, Deniz [1 ]
Mikolajczyk, Krystian [1 ]
机构
[1] Imperial Coll London, Dept Elect & Elect Engn, London SW7 2BU, England
基金
英国工程与自然科学研究理事会; 欧洲研究理事会;
关键词
Image edge detection; Servers; Task analysis; Wireless communication; Performance evaluation; Image coding; Feature extraction; Deep learning; Internet of Things; image retrieval; joint source-channel coding; person re-identification; NETWORK;
D O I
10.1109/JSAC.2020.3036955
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
We study the image retrieval problem at the wireless edge, where an edge device captures an image, which is then used to retrieve similar images from an edge server. These can be images of the same person or a vehicle taken from other cameras at different times and locations. Our goal is to maximize the accuracy of the retrieval task under power and bandwidth constraints over the wireless link. Due to the stringent delay constraint of the underlying application, sending the whole image at a sufficient quality is not possible. We propose two alternative schemes based on digital and analog communications, respectively. In the digital approach, we first propose a deep neural network (DNN) aided retrieval-oriented image compression scheme, whose output bit sequence is transmitted over the channel using conventional channel codes. In the analog joint source and channel coding (JSCC) approach, the feature vectors are directly mapped into channel symbols. We evaluate both schemes on image based re-identification (re-ID) tasks under different channel conditions, including both static and fading channels. We show that the JSCC scheme significantly increases the end-to-end accuracy, speeds up the encoding process, and provides graceful degradation with channel conditions. The proposed architecture is evaluated through extensive simulations on different datasets and channel conditions, as well as through ablation studies.
引用
收藏
页码:89 / 100
页数:12
相关论文
共 50 条
  • [1] Image retrieval based on edge representation
    Abdel-Mottaleb, M
    2000 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOL III, PROCEEDINGS, 2000, : 734 - 737
  • [2] Edge color histogram for image retrieval
    Shim, SO
    Choi, TS
    2002 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOL III, PROCEEDINGS, 2002, : 957 - 960
  • [3] Edge detection techniques in image retrieval: The semantic meaning of edge
    Amato, A
    Di Lecce, V
    PROCEEDINGS EC-VIP-MC 2003, VOLS 1 AND 2, 2003, : 143 - 148
  • [4] Edge Orientation Spatiogram for Silhouette Image Retrieval
    Yu, Yan
    Wang, Tianjiang
    Liu, Yanli
    6TH INTERNATIONAL CONFERENCE ON DIGITAL IMAGE PROCESSING (ICDIP 2014), 2014, 9159
  • [5] Image Retrieval Based on Edge Detection and Histogram
    Dong, Wei
    Tang, Yandong
    MECHATRONICS AND APPLIED MECHANICS, PTS 1 AND 2, 2012, 157-158 : 1038 - 1041
  • [6] Image retrieval based on the directional edge similarity
    Shanbehzadeh, J
    Mahmoudi, F
    Sarafzadeh, A
    Moghadam, AME
    MULTIMEDIA STORAGE AND ARCHIVING SYSTEMS IV, 1999, 3846 : 267 - 271
  • [7] Deep Semantic Coding for Wireless Image Retrieval
    Wang, Ying
    Qi, Chenhao
    2022 IEEE 96TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2022-FALL), 2022,
  • [8] Color image retrieval using edge and edge-spatial features
    黄朝兵
    刘泉
    Chinese Optics Letters, 2006, (08) : 457 - 459
  • [9] Remote Sensing Image Retrieval Based on Edge Graph and Edge Direction
    Liu, Guangshe
    Li, Jufang
    PROCEEDINGS OF INTERNATIONAL CONFERENCE ON RESOURCE ENVIRONMENT AND INFORMATION TECHNOLOGY IN 2010 (REIT' 2010), 2010, : 604 - 607
  • [10] Modified angular radial partitioning for edge image description in image retrieval
    An, S. Y.
    Lee, L. K.
    Oh, S. Y.
    ELECTRONICS LETTERS, 2012, 48 (10) : 563 - 564