From Tweets to Energy Trends (TwEn): An exploratory framework for machine learning-based forecasting of urban-scale energy behavior leveraging social media data

Understanding energy behavior is crucial in addressing climate change, yet the accuracy of energy predictions is often limited by reliance on oversimplified occupancy data. This study develops an exploratory framework, from Tweets to Energy Trends (TwEn), leveraging machine learning and geo-tagged social media data to investigate the social dynamics of urban energy behavior. TwEn explores the relationship between social media interactions, specifically the frequency of tweets using data from the X Platform, and energy use patterns on an hourly basis. Employing various machine learning models, including artificial neural networks (ANN), decision tree (DTREE), random forest (RDF), and gradient boosting machine (GBM), the study evaluates their efficiency in both static and time-series forecasting of energy use trends and investigates the capability of social media data in predicting urban energy patterns. In addition, the study carries out a series of sensitivity analyses to provide an examination of the data and models. Furthermore, comprehensive data acquisition methods are developed and implemented. Tested on New York City using actual hourly electricity consumption data, the framework demonstrates significant predictive power of tweet frequency on urban electricity use. The framework also exhibits significant seasonality in X data, identifying patterns and trends that can inform time series urban building energy models (UBEM). The results offer new insights into the determinants of urban energy behavior and provide crucial perspectives for augmenting UBEMs, ensuring they are closely aligned with the complex social dynamics of contemporary urban environments. By integrating both digital and physical data, this study sheds light on urban energy behavior, supporting the formulation of effective and sustainable energy policies for urban futures.