Heterogeneous Feature Fusion Approach for Multi-Modal Indoor Localization

被引:0
|
作者
Zhou, Junyi [1 ]
Huang, Kaixuan [1 ]
Tang, Siyu [1 ]
Zhang, Shunqing [1 ]
机构
[1] Shanghai Univ, Sch Commun & Informat Engn, Shanghai 200444, Peoples R China
基金
中国国家自然科学基金;
关键词
indoor localization; multi-modal fingerprint; channel exchange network; heterogeneous data alignment; multi-modal fusion;
D O I
10.1109/WCNC57260.2024.10570513
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
The demand for high-precision localization continues to grow rapidly with the development of information technology. Localization techniques based on wireless signals and visible light images have become the mainstream approach for achieving accurate and precise localization. However, directly utilizing multi-modal data for localization often overlooks the complex relationships between different modalities, particularly in terms of spatial and temporal features at varying scales. In this paper, we present a novel high-precision indoor localization method that effectively aligns the spatiotemporal dimensions of different modalities and extracts features efficiently using a shared neural network. To further enhance the extraction of relevant features from the multi-modal data, we propose a fusion network based on multi-modal channels that effectively minimize disparities, thereby significantly improving localization accuracy. Through extensive verification using a prototype system, our proposed solution demonstrates outstanding localization accuracy, achieving an average localization error of only 0.22m.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] MULTI-MODAL RECURRENT FUSION FOR INDOOR LOCALIZATION
    Yu, Jianyuan
    Wang, Pu
    Koike-Akino, Toshiaki
    Orlik, Philip, V
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 5083 - 5087
  • [2] Hybrid Cascaded and Feature-Level Fusion Scheme for Multi-Modal Indoor Localization
    Tang, Siyu
    Huang, Kaixuan
    Zhang, Shunqing
    [J]. 2023 IEEE 97TH VEHICULAR TECHNOLOGY CONFERENCE, VTC2023-SPRING, 2023,
  • [3] Robust indoor localization based on multi-modal information fusion and multi-scale sequential feature extraction
    Wang, Qinghu
    Jia, Jie
    Chen, Jian
    Deng, Yansha
    Wang, Xingwei
    Aghvami, Abdol Hamid
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2024, 155 : 164 - 178
  • [4] Discriminative Multi-modal Feature Fusion for RGBD Indoor Scene Recognition
    Zhu, Hongyuan
    Weibel, Jean-Baptiste
    Lu, Shijian
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 2969 - 2976
  • [5] Multi-modal Action Segmentation in the Kitchen with a Feature Fusion Approach
    Kogure, Shunsuke
    Aoki, Yoshimitsu
    [J]. FIFTEENTH INTERNATIONAL CONFERENCE ON QUALITY CONTROL BY ARTIFICIAL VISION, 2021, 11794
  • [6] Indoor Human/Robot Localization using Robust Multi-modal Data Fusion
    Amri, Mohamed-Hedi
    Becis, Yasmina
    Aubry, Didier
    Ramdani, Nacim
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2015, : 3456 - 3463
  • [7] Multi-Modal Probabilistic Indoor Localization on a Smartphone
    Dumbgen, Frederike
    Oeschger, Cynthia
    Kolundzija, Mihailo
    Scholefield, Adam
    Girardin, Emmanuel
    Leuenberger, Johan
    Ayer, Serge
    [J]. 2019 INTERNATIONAL CONFERENCE ON INDOOR POSITIONING AND INDOOR NAVIGATION (IPIN), 2019,
  • [8] Indoor Localization via Multi-Modal Sensing on Smartphones
    Xu, Han
    Yang, Zheng
    Zhou, Zimu
    Shangguan, Longfei
    Yi, Ke
    Liu, Yunhao
    [J]. UBICOMP'16: PROCEEDINGS OF THE 2016 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING, 2016, : 208 - 219
  • [9] Multi-modal feature fusion for geographic image annotation
    Li, Ke
    Zou, Changqing
    Bu, Shuhui
    Liang, Yun
    Zhang, Jian
    Gong, Minglun
    [J]. PATTERN RECOGNITION, 2018, 73 : 1 - 14
  • [10] Adaptive Feature Fusion for Multi-modal Entity Alignment
    Guo, Hao
    Li, Xin-Yi
    Tang, Jiu-Yang
    Guo, Yan-Ming
    Zhao, Xiang
    [J]. Zidonghua Xuebao/Acta Automatica Sinica, 2024, 50 (04): : 758 - 770