Exploiting the Self-Attention Mechanism in Gas Sensor Array (GSA) Data With Neural Networks

被引:2
|
作者
Wang, Ningning [1 ]
Li, Silong [1 ]
Ye, Terry Tao [1 ]
机构
[1] Southern Univ Sci & Technol, Dept Elect & Elect Engn, Shenzhen 518055, Peoples R China
关键词
Sensors; Sensor arrays; Gases; Gas detectors; Quantization (signal); Feature extraction; Sensor phenomena and characterization; Gas classification; gas sensor array (GSA); long short-term memory (LSTM); self-attention mechanism; MACHINE OLFACTION; DISCRIMINATION;
D O I
10.1109/JSEN.2023.3240470
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Gas sensor array (GSA) data is a sequential series of values that represents the temporal conditions of the existence/absence/mixture of gases and exhibits similarities to the textual stream of natural languages that represents semantic information. We speculate and subsequently prove that there also exist self-attention mechanisms in GSA data that can be exploited for gas classification and recognition. We first convert GSA data into a 1-D token series (called WORDs in this work) through sampling and quantization of the sensor values and then use an enhanced long short-term memory (LSTM) revision network, called LSTM-attention, to extract the self-attention mechanism in the GSA data. We demonstrate that LSTM-attention achieves a much better performance (99.6%) than CNN-based networks as well as other GSA data process techniques on UCI dynamic gases dataset. We also find out that the self-attention mechanism varies with different sampling and quantization levels during data acquisition.
引用
收藏
页码:5988 / 5996
页数:9
相关论文
共 50 条
  • [1] EPILEPTIC SPIKE DETECTION BY RECURRENT NEURAL NETWORKS WITH SELF-ATTENTION MECHANISM
    Fukumori, Kosuke
    Yoshida, Noboru
    Sugano, Hidenori
    Nakajima, Madoka
    Tanaka, Toshihisa
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 1406 - 1410
  • [2] Convolutional Recurrent Neural Networks with a Self-Attention Mechanism for Personnel Performance Prediction
    Xue, Xia
    Feng, Jun
    Gao, Yi
    Liu, Meng
    Zhang, Wenyu
    Sun, Xia
    Zhao, Aiqi
    Guo, Shouxi
    ENTROPY, 2019, 21 (12)
  • [3] Enhancing Multimodal Patterns in Neuroimaging by Siamese Neural Networks with Self-Attention Mechanism
    Arco, Juan E.
    Ortiz, Andres
    Gallego-Molina, Nicolas J.
    Gorriz, Juan M.
    Ramirez, Javier
    INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 2023, 33 (04)
  • [4] Multi-Sensor Data Fusion Method Based on Self-Attention Mechanism
    Lin, Xuezhu
    Chao, Shihan
    Yan, Dongming
    Guo, Lili
    Liu, Yue
    Li, Lijuan
    APPLIED SCIENCES-BASEL, 2023, 13 (21):
  • [5] Continuous Self-Attention Models with Neural ODE Networks
    Zhang, Jing
    Zhang, Peng
    Kong, Baiwen
    Wei, Junqiu
    Jiang, Xin
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 14393 - 14401
  • [6] Quantum self-attention neural networks for text classification
    Li, Guangxi
    Zhao, Xuanqiang
    Wang, Xin
    SCIENCE CHINA-INFORMATION SCIENCES, 2024, 67 (04)
  • [7] Quantum self-attention neural networks for text classification
    Guangxi LI
    Xuanqiang ZHAO
    Xin WANG
    Science China(Information Sciences), 2024, 67 (04) : 301 - 313
  • [8] Detecting phishing websites through improving convolutional neural networks with Self-Attention mechanism
    Said, Yahia
    Alsheikhy, Ahmed A.
    Lahza, Husam
    Shawly, Tawfeeq
    AIN SHAMS ENGINEERING JOURNAL, 2024, 15 (04)
  • [9] Combining Contextual Information by Self-attention Mechanism in Convolutional Neural Networks for Text Classification
    Wu, Xin
    Cai, Yi
    Li, Qing
    Xu, Jingyun
    Leung, Ho-fung
    WEB INFORMATION SYSTEMS ENGINEERING, WISE 2018, PT I, 2018, 11233 : 453 - 467
  • [10] Automatic Food Recognition Using Deep Convolutional Neural Networks with Self-attention Mechanism
    Rahib Abiyev
    Joseph Adepoju
    Human-Centric Intelligent Systems, 2024, 4 (1): : 171 - 186