Wireless Image Retrieval at the Edge

被引:140
|
作者
Jankowski, Mikolaj [1 ]
Gunduz, Deniz [1 ]
Mikolajczyk, Krystian [1 ]
机构
[1] Imperial Coll London, Dept Elect & Elect Engn, London SW7 2BU, England
基金
英国工程与自然科学研究理事会; 欧洲研究理事会;
关键词
Image edge detection; Servers; Task analysis; Wireless communication; Performance evaluation; Image coding; Feature extraction; Deep learning; Internet of Things; image retrieval; joint source-channel coding; person re-identification; NETWORK;
D O I
10.1109/JSAC.2020.3036955
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
We study the image retrieval problem at the wireless edge, where an edge device captures an image, which is then used to retrieve similar images from an edge server. These can be images of the same person or a vehicle taken from other cameras at different times and locations. Our goal is to maximize the accuracy of the retrieval task under power and bandwidth constraints over the wireless link. Due to the stringent delay constraint of the underlying application, sending the whole image at a sufficient quality is not possible. We propose two alternative schemes based on digital and analog communications, respectively. In the digital approach, we first propose a deep neural network (DNN) aided retrieval-oriented image compression scheme, whose output bit sequence is transmitted over the channel using conventional channel codes. In the analog joint source and channel coding (JSCC) approach, the feature vectors are directly mapped into channel symbols. We evaluate both schemes on image based re-identification (re-ID) tasks under different channel conditions, including both static and fading channels. We show that the JSCC scheme significantly increases the end-to-end accuracy, speeds up the encoding process, and provides graceful degradation with channel conditions. The proposed architecture is evaluated through extensive simulations on different datasets and channel conditions, as well as through ablation studies.
引用
收藏
页码:89 / 100
页数:12
相关论文
共 50 条
  • [21] Image retrieval based on shape similarity by edge orientation autocorrelogram
    Mahmoudi, F
    Shanbehzadeh, J
    Eftekhari-Moghadam, AM
    Soltanian-Zadeh, H
    PATTERN RECOGNITION, 2003, 36 (08) : 1725 - 1736
  • [22] Local Maximum Edge Cooccurance Patterns for Image Indexing and Retrieval
    Kaur, Harpreet
    Dhir, Vijay
    2016 INTERNATIONAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (ICONSIP), 2016,
  • [23] Color and neighbor edge directional difference feature for image retrieval
    黄朝兵
    余胜生
    周敬利
    鲁宏伟
    ChineseOpticsLetters, 2005, (02) : 66 - 68
  • [24] Image retrieval based on multi-scale edge model
    Bao, P
    Hang, XJ
    IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, VOL I AND II, PROCEEDINGS, 2002, : A417 - A420
  • [25] Image Retrieval Based on Improved Canny Edge Detection Algorithm
    Dong, Yubing
    Li, Mingjing
    Li, Jie
    PROCEEDINGS 2013 INTERNATIONAL CONFERENCE ON MECHATRONIC SCIENCES, ELECTRIC ENGINEERING AND COMPUTER (MEC), 2013, : 1453 - 1457
  • [26] Image Retrieval Based on HSV Feature and Edge Direction Feature
    Dong, Yanxue
    PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON ADVANCES IN MECHANICAL ENGINEERING AND INDUSTRIAL INFORMATICS, 2015, 15 : 1002 - 1007
  • [27] A concept based approach for image retrieval with edge description templates
    Choi, JH
    Park, SJ
    6TH WORLD MULTICONFERENCE ON SYSTEMICS, CYBERNETICS AND INFORMATICS, VOL IX, PROCEEDINGS: IMAGE, ACOUSTIC, SPEECH AND SIGNAL PROCESSING II, 2002, : 51 - 56
  • [28] Powerful Descriptor for Image Retrieval Based on Angle Edge and Histograms
    Yasmin, Mussarat
    Sharif, Muhammad
    Irum, Isma
    Mohsin, Sajjad
    JOURNAL OF APPLIED RESEARCH AND TECHNOLOGY, 2013, 11 : 727 - 732
  • [29] Color and edge refinement method for content based image retrieval
    Park, T
    Chang, MY
    Park, J
    ADVANCES IN VISUAL COMPUTING, PROCEEDINGS, 2005, 3804 : 690 - 695
  • [30] Texture Image Retrieval Using Local Binary Edge Patterns
    Abdesselam, Abdelhamid
    DIGITAL INFORMATION AND COMMUNICATION TECHNOLOGY AND ITS APPLICATIONS, PT I, 2011, 166 : 219 - 230