Design and implementation of a fast integration method for multi-source data in high-speed network

被引:0
|
作者
Ma, Lei [1 ]
Zhang, Yanning [1 ]
Garcia-Diaz, Vicente [2 ]
机构
[1] Beijing Polytech, Sch Telecommun Engn, Beijing, Peoples R China
[2] Univ Oviedo, Dept Comp Sci, Oviedo, Spain
关键词
Distributed system; data acquisition; high-speed network; multi-source data integration; nonlinear filtering; heterogeneous assimilation;
D O I
10.3233/JHS-222047
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The data collected by the distributed high-speed network has multiple sources. Therefore, in order to realize the rapid integration of multi-source data, this paper designs a rapid data integration method based on the characteristics of the distributed high-speed network. First, we use linear regression analysis to build a distributed perceptual data model, so that network nodes can only transmit the parameter information of the regression model, so as to simplify the data collection. Then, a dead band amplitude limiting nonlinear link is added at the high frequency channel side to filter and assimilate the data. Finally, the data feature vectors are extracted as the training samples of the neural network to obtain the mapping relationship between different feature vectors, and then the decision level data integration is achieved by training the neural network. The experimental results show that this method can accurately collect high-speed network data, and the data collection deviation is always less than 5 mu rad; This method has good filtering effect on data and can eliminate the interference of burr signal; The convergence speed of this method is fast, and the data assimilation can be completed within 0.4 s, which is conducive to improving the speed of data integration; With the increase of network size, the average traffic load of this method increases less.
引用
收藏
页码:251 / 263
页数:13
相关论文
共 50 条
  • [11] High-speed highway road network short-term traffic flow parameters based on multi-source data fusion prediction
    Gao H.-L.
    Xu Y.-B.
    Liu K.
    Li C.-Y.
    Lu X.-Y.
    Jilin Daxue Xuebao (Gongxueban)/Journal of Jilin University (Engineering and Technology Edition), 2024, 54 (01): : 155 - 161
  • [12] Model of high-speed railway noise prediction based on multi-source mode
    Ju L.
    Ge J.
    Guo Y.
    Tongji Daxue Xuebao/Journal of Tongji University, 2017, 45 (01): : 58 - 63
  • [13] High-speed train small-amplitude hunting recognition based on multi-source discrepancy adversarial network
    Liu, Xin
    Ning, Jing
    Wang, Zixuan
    Hong, Zixuan
    Zhang, Bing
    Chen, Chunjun
    Journal of Railway Science and Engineering, 2024, 21 (09) : 3469 - 3480
  • [14] Design and Implementation of A High-Speed Sonar Data Transmission System
    Lin, Tingting
    Nie, Xingyang
    Xu, Wen
    OCEANS, 2012 - YEOSU, 2012,
  • [15] Design and implementation of a modular high-speed data transmission system
    Xing, Yang
    Wu, Qiong-zhi
    Yang, Xin-ran
    Su, Fu-shun
    PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON COMPUTER, NETWORKS AND COMMUNICATION ENGINEERING (ICCNCE 2013), 2013, 30 : 509 - 511
  • [16] Design and implementation of a high-speed RFID data filtering engine
    Park, Hyunsung
    Kim, Jongdeok
    EMERGING DIRECTIONS IN EMBEDDED AND UBIQUITOUS COMPUTING, 2006, 4097 : 423 - 434
  • [17] Data Integration Method of Multi-source Feedback Evaluation for Remote Teaching Quality
    Lili Chen
    Mohamed Baza
    Hani Alshahrani
    Mobile Networks and Applications, 2023, 28 : 924 - 934
  • [18] Design and implementation of a new synchronization method for high-speed cell-based network interfaces
    Maniatopoulos, A
    Antonakopoulos, T
    Makios, V
    INTERNATIONAL CONFERENCE ON COMPUTER DESIGN - VLSI IN COMPUTERS AND PROCESSORS, PROCEEDINGS, 1996, : 158 - 164
  • [19] A fast linkage detection scheme for multi-source information integration
    Aizawa, A
    Oyama, K
    INTERNATIONAL WORKSHOP ON CHALLENGES IN WEB INFORMATION RETRIEVAL AND INTEGRATION, PROCEEDINGS, 2005, : 30 - 39
  • [20] An Integration Model of Multi-Source Heterogeneous Audit Data
    Li Chunqiang
    Chai Weiyan
    Chen Linan
    PROCEEDINGS OF THE 2015 INTERNATIONAL CONFERENCE ON ELECTRONIC SCIENCE AND AUTOMATION CONTROL, 2015, 20 : 262 - 266