Online Updating Algorithms of Statistical Methods for Big Data

被引:0
|
作者
Li, Yihao [1 ]
Wang, Jin [2 ,3 ]
机构
[1] Huazhong Univ Sci & Technol, Dept Math, Wuhan, Hubei, Peoples R China
[2] Valdosta State Univ, Dept Math, Valdosta, GA USA
[3] Valdosta State Univ, Data Sci Lab, Valdosta, GA USA
关键词
Online Algorithm; Big Data; Linear Regression; Skewness; Kurtosis; Sample Moment;
D O I
10.1145/3366650.3366667
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we discuss online updating algorithms for Big Data. One of the main challenges of Big Data is the limitation of data storage. In the Big Data stream environment, online computation sometimes requires fast updates without the use of historical data. The focus of this research is on efficient online update algorithms for basic statistical computations, including mean, variance, covariance, skewness, kurtosis, confidence interval, test statistic, and linear regression. We demonstrate the implementation of R Language through a linear regress example.
引用
收藏
页码:81 / 85
页数:5
相关论文
共 50 条
  • [41] Statistical learning and big data applications
    Witte, Harald
    Blatter, Tobias U. U.
    Nagabhushana, Priyanka
    Schaer, David
    Ackermann, James
    Cadamuro, Janne
    Leichtle, Alexander B. B.
    JOURNAL OF LABORATORY MEDICINE, 2023, 47 (04) : 181 - 186
  • [42] Statistical analysis of big data on pharmacogenomics
    Fan, Jianqing
    Liu, Han
    ADVANCED DRUG DELIVERY REVIEWS, 2013, 65 (07) : 987 - 1000
  • [43] TO QUESTION OF THE STATISTICAL ANALYSIS OF BIG DATA
    Lemeshko, B. Yu
    Lemeshko, S. B.
    Semenova, M. A.
    VESTNIK TOMSKOGO GOSUDARSTVENNOGO UNIVERSITETA-UPRAVLENIE VYCHISLITELNAJA TEHNIKA I INFORMATIKA-TOMSK STATE UNIVERSITY JOURNAL OF CONTROL AND COMPUTER SCIENCE, 2018, (44): : 40 - 49
  • [44] Statistical learning for big dependent data
    Dolores Ugarte, Maria
    JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES A-STATISTICS IN SOCIETY, 2022, 185 (03) : 1460 - 1460
  • [45] Statistical model selection with "Big Data"
    Doornik, Jurgen A.
    Hendry, David F.
    COGENT ECONOMICS & FINANCE, 2015, 3 (01):
  • [46] Big data: Some statistical issues
    Cox, D. R.
    Kartsonaki, Christiana
    Keogh, Ruth H.
    STATISTICS & PROBABILITY LETTERS, 2018, 136 : 111 - 115
  • [47] Statistical science in the world of big data
    Reid, Nancy
    STATISTICS & PROBABILITY LETTERS, 2018, 136 : 42 - 45
  • [48] Statistical Modelling for Big and Little Data
    Henderson, Robin
    DEVELOPMENTS IN STATISTICAL MODELLING, IWSM 2024, 2024, : 246 - 254
  • [49] Bayesian model updating with summarized statistical and reliability data
    VanDerHorn, Eric
    Mahadevan, Sankaran
    RELIABILITY ENGINEERING & SYSTEM SAFETY, 2018, 172 : 12 - 24
  • [50] Big data for online learning systems
    Dahdouh, Karim
    Dakkak, Ahmed
    Oughdir, Lahcen
    Messaoudi, Faycal
    EDUCATION AND INFORMATION TECHNOLOGIES, 2018, 23 (06) : 2783 - 2800