Testing Homogeneity Of A Large Data Set By Bootstrapping

被引:0
|
作者
Morimune, K. [1 ]
Hoshino, Y. [1 ]
机构
[1] Kyoto Univ, Grad Sch Econ, Sakyo Ku, Kyoto 6068501, Japan
关键词
Wu-Hausman test; Micro data; Bootstrapping; Sub-sample;
D O I
暂无
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
It is not rare to analyze large data sets these days. Large data is usually of census type and is called the micro data in econometrics. The basic method of analysis is to estimate a single regression equation with common coefficients over the whole data. The same applies to other method of estimation such as the discrete choice models, Tobit models, and so on. Heterogeneity in the data is usually adjusted by the dummy variables. Dummy variables represent socioeconomic differences among individuals in the sample. Including the coefficients of dummy variables, only one equation is estimated for the whole large sample, and it is usually not preferred to divide the whole sample into sub-samples. Data is said to be homogenous in this paper if a single equation is fit to the whole data, and it explains socioeconomic properties of the data well. We may estimate an equation in each sub-population if the whole population is divided into known sub-populations. It is assumed that the coefficients are different from one sub-population to another in this case. Data is said to be heterogeneous in our paper. The analysis of variance is applied if sub-populations are known and sub-sample is collected from each sub-population. In this paper, a test is proposed to find if the data is homogenous or not. Our test uses the full sample of size N and randomly chosen sub-samples of size n. They are randomly chosen since sub-populations are unknown. A regression equation with common coefficients over the whole sample such as y(ik) - x'(ik)beta(0) + u(ik) is assumed under the null hypothesis. A regression equation with variable coefficients y(ik) = x'(ik) (beta(0) + n/N beta(k)) + u(ik) is assumed under the alternative hypothesis. This alternative hypothesis states that the deviation from a common regression is small when the size n of randomly chosen sub-samples is small compared with N. This reflects our intuition that it is too restrictive to fit one regression equation with common coefficients to a large sample. It may be impossible to avoid specification errors in this estimation. However, specification errors may be negligible if a regression equation is fit to a small sub-sample. For a given sub-sample of size n, the Wu-Hausman statistic W H = (b(s) - b(f))'(V(b(s)) - V(b(f)))(-1)(b(s) - b(f)) is used for the test where b(f) and b(s) are the full sample and the sub-sample least squares estimator, respectively. It is asymptotically distributed as X(2) (K) under the null hypothesis where K is the number of coefficients. The sub-sample of size n is repeatedly and randomly taken from the full sample of size N for Ns times, and the test statistic is calculated for Ns times accordingly. Since n is arbitrary, various values of n are chosen in the test starting from 5% to more than one third of the full sample. An alternative WH test statistic uses the bootstrapping estimators of the coefficients and the variance covariance matrices. The sub-sample test statistics can be correlated with each other since the sub-samples are randomly chosen from the full sample and can be overlapped. Critical values of the test statistics are calculated by simulations. An example follows.
引用
收藏
页码:914 / 919
页数:6
相关论文
共 50 条
  • [21] Analyzing evaluation data: Modelling and testing for homogeneity
    D'Elia, Angela
    Piccolo, Domenico
    DATA ANALYSIS, CLASSIFICATION AND THE FORWARD SEARCH, 2006, : 299 - +
  • [22] Testing slope homogeneity in large panels with serial correlation
    Blomquist, Johan
    Westerlund, Joakim
    ECONOMICS LETTERS, 2013, 121 (03) : 374 - 378
  • [23] Bootstrapping and hypothesis testing in non-stationary panel data
    Emerson, J
    Kao, C
    APPLIED ECONOMICS LETTERS, 2005, 12 (05) : 313 - 318
  • [24] Probabilistic neural network with homogeneity testing in recognition of discrete patterns set
    Savchenko, A. V.
    NEURAL NETWORKS, 2013, 46 : 227 - 241
  • [25] Testing the homogeneity of proportions for combined unilateral and bilateral data
    Ma, Chang-Xing
    Wang, Kejia
    JOURNAL OF BIOPHARMACEUTICAL STATISTICS, 2021, 31 (05) : 686 - 704
  • [26] METHODS FOR TESTING CONSISTENCY AND HOMOGENEITY OF THE HYDROLOGICAL PROCESSES DATA
    Jovanovski, Vlatko
    Krstev, Aleksandar
    Jovanovska, Verica Atanasova
    11TH INTERNATIONAL MULTIDISCIPLINARY SCIENTIFIC GEOCONFERENCE (SGEM 2011), VOL II, 2011, : 621 - +
  • [27] On testing homogeneity of two covariance matrices with nonnormal data
    Shen, Jieqiong
    Li, Junyan
    SECOND INTERNATIONAL CONFERENCE ON PHYSICS, MATHEMATICS AND STATISTICS, 2019, 1324
  • [28] Procedures for testing the homogeneity of relative difference in sparse data
    Lui, KJ
    STATISTICS IN MEDICINE, 2006, 25 (04) : 685 - 697
  • [29] Testing the homogeneity of risk differences with sparse count data
    Park, Junyong
    Gauran, Iris Ivy
    STATISTICS, 2019, 53 (06) : 1306 - 1328
  • [30] Bootstrapping the visuospatial bootstrapping effect and testing its spatialisation
    Guida, Alessandro
    Maherault, Mathilde
    MEMORY, 2021, 29 (04) : 456 - 470