Deep Learning Model for House Price Prediction Using Heterogeneous Data Analysis Along With Joint Self-Attention Mechanism

被引:35
|
作者
Wang, Pei-Ying [1 ]
Chen, Chiao-Ting [2 ]
Su, Jain-Wun [1 ]
Wang, Ting-Yun [1 ]
Huang, Szu-Hao [3 ]
机构
[1] Natl Chiao Tung Univ, Inst Informat Management, Hsinchu 30010, Taiwan
[2] Natl Yang Ming Chiao Tung Univ, Dept Comp Sci, Hsinchu 30010, Taiwan
[3] Natl Yang Ming Chiao Tung Univ, Dept Informat Management & Finance, Hsinchu 30010, Taiwan
关键词
Hidden Markov models; Predictive models; Autoregressive processes; Biological system modeling; Satellites; Data models; Feature extraction; House price prediction; heterogeneous data; Google satellite map; spatial transformer network; joint self-attention mechanism;
D O I
10.1109/ACCESS.2021.3071306
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
House price prediction is a popular topic, and research teams are increasingly performing related studies by using deep learning or machine learning models. However, because some studies have not considered comprehensive information that affects house prices, prediction results are not always sufficiently precise. Therefore, we propose an end to end joint self-attention model for house prediction. In this model, we import data on public facilities such as parks, schools, and mass rapid transit stations to represent the availability of amenities, and we use satellite maps to analyze the environment surrounding houses. We adopt attention mechanisms, which are widely used in image, speech, and translation tasks, to identify crucial features that are considered by prospective house buyers. The model can automatically assign weights when given transaction data. Our proposed model differs from self-attention models because it considers the interaction between two different features to learn the complicated relationship between features in order to increase prediction precision. We conduct experiments to demonstrate the performance of the model. Experimental data include actual selling prices in real estate transaction data for the period from 2017 to 2018, public facility data acquired from the Taipei and New Taipei governments, and satellite maps crawled using the Google Maps application programming interface. We utilize these datasets to train our proposed and compare its performance with that of other machine learning-based models such as Extreme Gradient Boosting and Light Gradient Boosted Machine, deep learning, and several attention models. The experimental results indicate that the proposed model achieves a low prediction error and outperforms the other models. To the best of our knowledge, we are the first research to incorporate attention mechanism and STN network to conduct house price prediction.
引用
收藏
页码:55244 / 55259
页数:16
相关论文
共 50 条
  • [1] Magnetotelluric Data Inversion Based on Deep Learning With the Self-Attention Mechanism
    Xu, Kaijun
    Liang, Shuyuan
    Lu, Yan
    Hu, Zuzhi
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [2] High-Fidelity Permeability and Porosity Prediction Using Deep Learning With the Self-Attention Mechanism
    Yang, Liuqing
    Wang, Shoudong
    Chen, Xiaohong
    Chen, Wei
    Saad, Omar M.
    Zhou, Xu
    Nam Pham
    Geng, Zhicheng
    Fomel, Sergey
    Chen, Yangkang
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (07) : 3429 - 3443
  • [3] Missing well logs prediction using deep learning integrated neural network with the self-attention mechanism
    Wang, Jun
    Cao, Junxing
    Fu, Jingcheng
    Xu, Hanqing
    ENERGY, 2022, 261
  • [4] A Deep Learning Model with a Self-Attention Mechanism for Leg Joint Angle Estimation across Varied Locomotion Modes
    Ding, Guanlin
    Georgilas, Ioannis
    Plummer, Andrew
    SENSORS, 2024, 24 (01)
  • [5] Traffic Flow Prediction with Heterogeneous Spatiotemporal Data Based on a Hybrid Deep Learning Model Using Attention-Mechanism
    Wang, Jing-Doo
    Susanto, Chayadi Oktomy Noto
    CMES-COMPUTER MODELING IN ENGINEERING & SCIENCES, 2024, 140 (02): : 1711 - 1728
  • [6] A Cross-Project Defect Prediction Model Based on Deep Learning With Self-Attention
    Wen, Wanzhi
    Zhang, Ruinian
    Wang, Chuyue
    Shen, Chenqiang
    Yu, Meng
    Zhang, Suchuan
    Gao, Xinxin
    IEEE ACCESS, 2022, 10 : 110385 - 110401
  • [7] A deep learning sequence model based on self-attention and convolution for wind power prediction
    Liu, Chien-Liang
    Chang, Tzu-Yu
    Yang, Jie-Si
    Huang, Kai-Bin
    RENEWABLE ENERGY, 2023, 219
  • [8] Precious Metal Price Prediction Based on Deep Regularization Self-Attention Regression
    Zhou, Junhao
    He, Zhanhong
    Song, Ya Nan
    Wang, Hao
    Yang, Xiaoping
    Lian, Wenjuan
    Dai, Hong-Ning
    IEEE ACCESS, 2020, 8 : 2178 - 2187
  • [9] A prediction model of student performance based on self-attention mechanism
    Yan Chen
    Ganglin Wei
    Jiaxin Liu
    Yunwei Chen
    Qinghua Zheng
    Feng Tian
    Haiping Zhu
    Qianying Wang
    Yaqiang Wu
    Knowledge and Information Systems, 2023, 65 : 733 - 758
  • [10] A prediction model of student performance based on self-attention mechanism
    Chen, Yan
    Wei, Ganglin
    Liu, Jiaxin
    Chen, Yunwei
    Zheng, Qinghua
    Tian, Feng
    Zhu, Haiping
    Wang, Qianying
    Wu, Yaqiang
    KNOWLEDGE AND INFORMATION SYSTEMS, 2023, 65 (02) : 733 - 758