PromptCast: A New Prompt-Based Learning Paradigm for Time Series Forecasting

被引:12
|
作者
Xue, Hao [1 ]
Salim, Flora D. [1 ]
机构
[1] Univ New South Wales, Sch Comp Sci & Engn, Sydney, NSW 2052, Australia
关键词
Forecasting; Predictive models; Task analysis; Time series analysis; Numerical models; Natural languages; Benchmark testing; Time series forecasting; natural language generation; dataset and benchmark;
D O I
10.1109/TKDE.2023.3342137
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents a new perspective on time series forecasting. In existing time series forecasting methods, the models take a sequence of numerical values as input and yield numerical values as output. The existing SOTA models are largely based on the Transformer architecture, modified with multiple encoding mechanisms to incorporate the context and semantics around the historical data. Inspired by the successes of pre-trained language foundation models, we pose a question about whether these models can also be adapted to solve time-series forecasting. Thus, we propose a new forecasting paradigm: prompt-based time series forecasting (PromptCast). In this novel task, the numerical input and output are transformed into prompts and the forecasting task is framed in a sentence-to-sentence manner, making it possible to directly apply language models for forecasting purposes. To support and facilitate the research of this task, we also present a large-scale dataset (PISA) that includes three real-world forecasting scenarios. We evaluate different SOTA numerical-based forecasting methods and language generation models. The benchmark results with various forecasting settings demonstrate the proposed PromptCast with language generation models is a promising research direction. Additionally, in comparison to conventional numerical-based forecasting, PromptCast shows a much better generalization ability under the zero-shot setting.
引用
收藏
页码:6851 / 6864
页数:14
相关论文
共 50 条
  • [1] GPT4MTS: Prompt-Based Large Language Model for Multimodal Time-Series Forecasting
    Jia, Furong
    Wang, Kevin
    Zheng, Yixiang
    Cao, Defu
    Liu, Yan
    THIRTY-EIGTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 21, 2024, : 23343 - 23351
  • [2] Prompt-Based Learning for Unpaired Image Captioning
    Zhu, Peipei
    Wang, Xiao
    Zhu, Lin
    Sun, Zhenglong
    Zheng, Wei-Shi
    Wang, Yaowei
    Chen, Changwen
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 379 - 393
  • [3] Prompt-based Learning for Text Readability Assessment
    Lee, Bruce W.
    Lee, Jason Hyung-Jong
    17TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EACL 2023, 2023, : 1819 - 1824
  • [4] RCS-Prompt: Learning Prompt to Rearrange Class Space for Prompt-Based Continual Learning
    Yang, Longrong
    Zhao, Hanbin
    Yu, Yunlong
    Zeng, Xiaodong
    Li, Xi
    COMPUTER VISION - ECCV 2024, PT XLVII, 2025, 15105 : 1 - 20
  • [5] Collaborative Pseudo Labeling for Prompt-Based Learning
    Chien, Jen-Tzung
    Chen, Chien-Ching
    2023 ASIA PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE, APSIPA ASC, 2023, : 51 - 56
  • [6] Introducing Language Guidance in Prompt-based Continual Learning
    Khan, Muhammad Gul Zain Ali
    Naeem, Muhammad Ferjad
    Van Gool, Luc
    Stricker, Didier
    Tombari, Federico
    Afzal, Muhammad Zeshan
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 11429 - 11439
  • [7] One-Stage Prompt-Based Continual Learning
    Kim, Youngeun
    Li, Yuhang
    Panda, Priyadarshini
    COMPUTER VISION - ECCV 2024, PT XIII, 2025, 15071 : 163 - 179
  • [8] Prompt-Based Event Temporal Relation Extraction with Contrastive Learning
    Chen, You
    Wang, Tao
    Cheng, Lianglun
    Chen, Chong
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT IV, ICIC 2024, 2024, 14865 : 186 - 198
  • [9] Log Parsing with Prompt-based Few-shot Learning
    Le, Van-Hoang
    Zhang, Hongyu
    2023 IEEE/ACM 45TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING, ICSE, 2023, : 2438 - 2449
  • [10] Multi-Mask Label Mapping for Prompt-Based Learning
    Qi, Jirui
    Zhang, Richong
    Kim, Jaein
    Chen, Junfan
    Qin, Wenyi
    Mao, Yongyi
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 11, 2023, : 13465 - 13473