Deep Learning Model for House Price Prediction Using Heterogeneous Data Analysis Along With Joint Self-Attention Mechanism

被引:35
|
作者
Wang, Pei-Ying [1 ]
Chen, Chiao-Ting [2 ]
Su, Jain-Wun [1 ]
Wang, Ting-Yun [1 ]
Huang, Szu-Hao [3 ]
机构
[1] Natl Chiao Tung Univ, Inst Informat Management, Hsinchu 30010, Taiwan
[2] Natl Yang Ming Chiao Tung Univ, Dept Comp Sci, Hsinchu 30010, Taiwan
[3] Natl Yang Ming Chiao Tung Univ, Dept Informat Management & Finance, Hsinchu 30010, Taiwan
关键词
Hidden Markov models; Predictive models; Autoregressive processes; Biological system modeling; Satellites; Data models; Feature extraction; House price prediction; heterogeneous data; Google satellite map; spatial transformer network; joint self-attention mechanism;
D O I
10.1109/ACCESS.2021.3071306
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
House price prediction is a popular topic, and research teams are increasingly performing related studies by using deep learning or machine learning models. However, because some studies have not considered comprehensive information that affects house prices, prediction results are not always sufficiently precise. Therefore, we propose an end to end joint self-attention model for house prediction. In this model, we import data on public facilities such as parks, schools, and mass rapid transit stations to represent the availability of amenities, and we use satellite maps to analyze the environment surrounding houses. We adopt attention mechanisms, which are widely used in image, speech, and translation tasks, to identify crucial features that are considered by prospective house buyers. The model can automatically assign weights when given transaction data. Our proposed model differs from self-attention models because it considers the interaction between two different features to learn the complicated relationship between features in order to increase prediction precision. We conduct experiments to demonstrate the performance of the model. Experimental data include actual selling prices in real estate transaction data for the period from 2017 to 2018, public facility data acquired from the Taipei and New Taipei governments, and satellite maps crawled using the Google Maps application programming interface. We utilize these datasets to train our proposed and compare its performance with that of other machine learning-based models such as Extreme Gradient Boosting and Light Gradient Boosted Machine, deep learning, and several attention models. The experimental results indicate that the proposed model achieves a low prediction error and outperforms the other models. To the best of our knowledge, we are the first research to incorporate attention mechanism and STN network to conduct house price prediction.
引用
收藏
页码:55244 / 55259
页数:16
相关论文
共 50 条
  • [41] Reconstructing computational spectra using deep learning’s self-attention method
    Wu, Hao
    Wu, Hui
    Su, Xinyu
    Wu, Jingjun
    Liu, Shuangli
    Optica Applicata, 2024, 54 (03) : 383 - 394
  • [42] Deep Learning Approach to Impact Classification in Sensorized Panels Using Self-Attention
    Karmakov, Stefan
    Aliabadi, M. H. Ferri
    SENSORS, 2022, 22 (12)
  • [43] Bridge progressive damage detection using unsupervised learning and self-attention mechanism
    Teng, Shuai
    Liu, Airong
    Chen, Bingcong
    Wang, Jialin
    Fu, Jiyang
    ENGINEERING STRUCTURES, 2024, 301
  • [44] A Joint Learning Model to Extract Entities and Relations for Chinese Literature Based on Self-Attention
    Liang, Li-Xin
    Lin, Lin
    Lin, E.
    Wen, Wu-Shao
    Huang, Guo-Yan
    MATHEMATICS, 2022, 10 (13)
  • [45] DenoiseNet: Deep Generator and Discriminator Learning Network With Self-Attention Applied to Ocean Data
    Mao, Mingqiu
    Wang, Huajun
    Nie, Peng
    Xiao, Shipeng
    Wu, Ruijie
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [46] Gridding and filtering method of gravity and magnetic data based on self-attention deep learning
    Ma G.
    Wang Z.
    Li L.
    Shiyou Diqiu Wuli Kantan/Oil Geophysical Prospecting, 2022, 57 (01): : 34 - 42
  • [47] Pedestrian Trajectory Prediction Model Based on Self-Attention Mechanism and Group Behavior Characteristics
    Zhou Y.
    Wu H.
    Cheng H.
    Zheng J.
    Li X.
    Wuhan Daxue Xuebao (Xinxi Kexue Ban)/Geomatics and Information Science of Wuhan University, 2020, 45 (12): : 1989 - 1996
  • [48] Evaluation of Transformer model and Self-Attention mechanism in the Yangtze River basin runoff prediction
    Wei, Xikun
    Wang, Guojie
    Schmalz, Britta
    Hagan, Daniel Fiifi Tawia
    Duan, Zheng
    JOURNAL OF HYDROLOGY-REGIONAL STUDIES, 2023, 47
  • [49] An Efficient Link Prediction Model in Dynamic Heterogeneous Information Networks Based on Multiple Self-attention
    Ruan, Beibei
    Zhu, Cui
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT III, 2021, 12817 : 62 - 74
  • [50] Deep Bug Triage Model Based on Multi-head Self-attention Mechanism
    Yu, Xu
    Wan, Fayang
    Tang, Bin
    Zhan, Dingjia
    Peng, Qinglong
    Yu, Miao
    Wang, Zhaozhe
    Cui, Shuang
    COMPUTER SUPPORTED COOPERATIVE WORK AND SOCIAL COMPUTING, CHINESECSCW 2021, PT II, 2022, 1492 : 107 - 119