Wireless Image Retrieval at the Edge

被引:140
|
作者
Jankowski, Mikolaj [1 ]
Gunduz, Deniz [1 ]
Mikolajczyk, Krystian [1 ]
机构
[1] Imperial Coll London, Dept Elect & Elect Engn, London SW7 2BU, England
基金
英国工程与自然科学研究理事会; 欧洲研究理事会;
关键词
Image edge detection; Servers; Task analysis; Wireless communication; Performance evaluation; Image coding; Feature extraction; Deep learning; Internet of Things; image retrieval; joint source-channel coding; person re-identification; NETWORK;
D O I
10.1109/JSAC.2020.3036955
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
We study the image retrieval problem at the wireless edge, where an edge device captures an image, which is then used to retrieve similar images from an edge server. These can be images of the same person or a vehicle taken from other cameras at different times and locations. Our goal is to maximize the accuracy of the retrieval task under power and bandwidth constraints over the wireless link. Due to the stringent delay constraint of the underlying application, sending the whole image at a sufficient quality is not possible. We propose two alternative schemes based on digital and analog communications, respectively. In the digital approach, we first propose a deep neural network (DNN) aided retrieval-oriented image compression scheme, whose output bit sequence is transmitted over the channel using conventional channel codes. In the analog joint source and channel coding (JSCC) approach, the feature vectors are directly mapped into channel symbols. We evaluate both schemes on image based re-identification (re-ID) tasks under different channel conditions, including both static and fading channels. We show that the JSCC scheme significantly increases the end-to-end accuracy, speeds up the encoding process, and provides graceful degradation with channel conditions. The proposed architecture is evaluated through extensive simulations on different datasets and channel conditions, as well as through ablation studies.
引用
收藏
页码:89 / 100
页数:12
相关论文
共 50 条
  • [31] Edge detector: towards the solid ground of an image retrieval system
    Lapanja, I
    Mraz, M
    Zimic, N
    Virant, J
    INTELLIGENT INFORMATION SYSTEMS, (IIS'97) PROCEEDINGS, 1997, : 371 - 375
  • [32] Color image retrieval using compressed chromaticity and color edge information
    Lee, HY
    Kim, HS
    Lee, HK
    Ha, YH
    STORAGE AND RETRIEVAL FOR MEDIA DATABASES 2001, 2001, 4315 : 490 - 498
  • [33] Color sectors and edge features for content-based image retrieval
    Li, Taijun
    Wu, Qiuli
    Yi, Jiafu
    Chang, Cheng
    FOURTH INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS AND KNOWLEDGE DISCOVERY, VOL 3, PROCEEDINGS, 2007, : 234 - 238
  • [34] Directional Line Edge Binary Pattern for Texture Image Indexing and Retrieval
    Samanta, Sibendu
    Maheshwari, R. P.
    Tripathy, Manoj
    PROCEEDINGS OF THE 2012 INTERNATIONAL CONFERENCE ON ADVANCES IN COMPUTING, COMMUNICATIONS AND INFORMATICS (ICACCI'12), 2012, : 745 - 750
  • [35] On the use of edge orientation and distance for content-based image retrieval
    Lin, HJ
    Kao, YT
    Liang, FM
    Liu, TW
    Pai, YC
    PROCEEDINGS OF THE 2005 INTERNATIONAL CONFERENCE ON NEURAL NETWORKS AND BRAIN, VOLS 1-3, 2005, : 1150 - 1155
  • [36] Algorithm for Image Retrieval Based on Edge Gradient Orientation Statistical Code
    Zeng, Jiexian
    Zhao, Yonggang
    Li, Weiye
    Fu, Xiang
    SCIENTIFIC WORLD JOURNAL, 2014,
  • [37] Local Gabor maximum edge position octal patterns for image retrieval
    Vipparthi, Santosh Kumar
    Murala, Subrahmanyam
    Nagar, S. K.
    Gonde, Anil Balaji
    NEUROCOMPUTING, 2015, 167 : 336 - 345
  • [38] An efficient framework for image retrieval using color, texture and edge features
    Pavithra, L. K.
    Sharmila, T. Sree
    COMPUTERS & ELECTRICAL ENGINEERING, 2018, 70 : 580 - 593
  • [39] Query-by-Sketch Image Retrieval Using Edge Relation Histogram
    Kumagai, Yoshiki
    Ohashi, Gosuke
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2013, E96D (02): : 340 - 348
  • [40] Texture-Based Image Retrieval by Edge Detection Matching GLCM
    Zhang, Jing
    Li, Gui-li
    He, Seok-wun
    HPCC 2008: 10TH IEEE INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS, PROCEEDINGS, 2008, : 782 - +