Deep Learning Model for House Price Prediction Using Heterogeneous Data Analysis Along With Joint Self-Attention Mechanism

被引:35
|
作者
Wang, Pei-Ying [1 ]
Chen, Chiao-Ting [2 ]
Su, Jain-Wun [1 ]
Wang, Ting-Yun [1 ]
Huang, Szu-Hao [3 ]
机构
[1] Natl Chiao Tung Univ, Inst Informat Management, Hsinchu 30010, Taiwan
[2] Natl Yang Ming Chiao Tung Univ, Dept Comp Sci, Hsinchu 30010, Taiwan
[3] Natl Yang Ming Chiao Tung Univ, Dept Informat Management & Finance, Hsinchu 30010, Taiwan
关键词
Hidden Markov models; Predictive models; Autoregressive processes; Biological system modeling; Satellites; Data models; Feature extraction; House price prediction; heterogeneous data; Google satellite map; spatial transformer network; joint self-attention mechanism;
D O I
10.1109/ACCESS.2021.3071306
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
House price prediction is a popular topic, and research teams are increasingly performing related studies by using deep learning or machine learning models. However, because some studies have not considered comprehensive information that affects house prices, prediction results are not always sufficiently precise. Therefore, we propose an end to end joint self-attention model for house prediction. In this model, we import data on public facilities such as parks, schools, and mass rapid transit stations to represent the availability of amenities, and we use satellite maps to analyze the environment surrounding houses. We adopt attention mechanisms, which are widely used in image, speech, and translation tasks, to identify crucial features that are considered by prospective house buyers. The model can automatically assign weights when given transaction data. Our proposed model differs from self-attention models because it considers the interaction between two different features to learn the complicated relationship between features in order to increase prediction precision. We conduct experiments to demonstrate the performance of the model. Experimental data include actual selling prices in real estate transaction data for the period from 2017 to 2018, public facility data acquired from the Taipei and New Taipei governments, and satellite maps crawled using the Google Maps application programming interface. We utilize these datasets to train our proposed and compare its performance with that of other machine learning-based models such as Extreme Gradient Boosting and Light Gradient Boosted Machine, deep learning, and several attention models. The experimental results indicate that the proposed model achieves a low prediction error and outperforms the other models. To the best of our knowledge, we are the first research to incorporate attention mechanism and STN network to conduct house price prediction.
引用
收藏
页码:55244 / 55259
页数:16
相关论文
共 50 条
  • [31] Deep Learning Based on Hierarchical Self-Attention for Finance Distress Prediction Incorporating Text
    Ruan, Sumei
    Sun, Xusheng
    Yao, Ruanxingchen
    Li, Wei
    COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2021, 2021
  • [32] Lithium Ion Battery Health Prediction via Variable Mode Decomposition and Deep Learning Network With Self-Attention Mechanism
    Ge, Yang
    Zhang, Fusheng
    Ren, Yong
    FRONTIERS IN ENERGY RESEARCH, 2022, 10
  • [33] Deep Learning-Based Identification of Maize Leaf Diseases Is Improved by an Attention Mechanism: Self-Attention
    Qian, Xiufeng
    Zhang, Chengqi
    Chen, Li
    Li, Ke
    FRONTIERS IN PLANT SCIENCE, 2022, 13
  • [34] Effective Construction of a Reflection Angle Prediction Model for Reflectarrays Using the Hadamard Product Self-Attention Mechanism
    Lin, Yi-Le
    Chen, You-Cheng
    Liu, Alan
    2022 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (SSCI), 2022, : 1298 - 1303
  • [35] Learning model combining convolutional deep neural network with a self-attention mechanism for AC optimal power flow
    Tran, Quan
    Mitra, Joydeep
    Nguyen, Nga
    ELECTRIC POWER SYSTEMS RESEARCH, 2024, 231
  • [36] Deep Clustering Efficient Learning Network for Motion Recognition Based on Self-Attention Mechanism
    Ru, Tielin
    Zhu, Ziheng
    APPLIED SCIENCES-BASEL, 2023, 13 (05):
  • [37] Intelligent identification of cracks on concrete surface combining self-attention mechanism and deep learning
    Tursenhali, Hanat
    Lin, Hang
    Journal of Railway Science and Engineering, 2021, 18 (04) : 844 - 852
  • [38] A fault diagnosis algorithm for analog circuits based on self-attention mechanism deep learning
    Yang D.
    Wei J.
    Lin X.
    Liu M.
    Lu S.
    Yi Qi Yi Biao Xue Bao/Chinese Journal of Scientific Instrument, 2023, 44 (03): : 128 - 136
  • [39] Script event prediction method based on self-attention mechanism and graph representation learning
    Hu, Meng
    Bai, Lu
    Yang, Mei
    2022 IEEE 6TH ADVANCED INFORMATION TECHNOLOGY, ELECTRONIC AND AUTOMATION CONTROL CONFERENCE (IAEAC), 2022, : 722 - 726
  • [40] RETRACTED: A Deep Learning Approach for a Source Code Detection Model Using Self-Attention (Retracted Article)
    Meng, Yao
    Liu, Long
    COMPLEXITY, 2020, 2020