Comparison of Methods for Testing the Hypothesis of Independence of Random Variables Based on a Nonparametric Classifier and Pearson's Chi-Squared Test

被引:0
|
作者
Lapko, A. V. [1 ,2 ]
Lapko, V. A. [1 ,2 ]
Bakhtina, A. V. [2 ]
机构
[1] Russian Acad Sci, Inst Computat Modelling, Siberian Branch, Krasnoyarsk 660036, Russia
[2] Reshetnev Siberian State Univ Sci & Technol, Krasnoyarsk 660037, Russia
关键词
testing the hypothesis of independence of random variables; two-dimensional random variables; nonparametric pattern recognition algorithm; kernel probability density estimate; Pearson's chi-squared test; ambiguous functional dependences; BANDWIDTH SELECTION; CROSS-VALIDATION; DENSITY;
D O I
10.3103/S8756699023050047
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
A technique for testing the hypothesis about the independence of random variables, based on a nonparametric pattern recognition algorithm, is used in the analysis of ambiguous dependencies. The pattern recognition algorithm meets the maximum likelihood criterion. The assessment of distribution laws in classes is carried out using initial statistical data under the assumption of independence and dependence of the random variables being compared. To estimate probability densities in classes, nonparametric Rosenblatt-Parzen statistics are used. The blurring coefficients of kernel functions in nonparametric estimates of probability densities in classes are determined from the condition of the minimum of their standard deviations. Under these conditions, estimates of the probabilities of pattern recognition errors in classes are calculated. Based on their minimum value, a decision is made on the independence or dependence of random variables. The hypothesis about a significant difference in the probabilities of pattern recognition errors in classes is tested. The use of the proposed technique allows us to bypass the problem of decomposing the range of values of random variables into intervals, which is characteristic of the Pearson criterion. The effectiveness of the proposed method is compared with the Pearson criterion. The results of computational experiments using the studied criteria in the analysis of ambiguous dependencies between random variables are presented.
引用
收藏
页码:551 / 560
页数:10
相关论文
共 27 条
  • [1] Comparison of Methods for Testing the Hypothesis of Independence of Random Variables Based on a Nonparametric Classifier and Pearson’s Chi-Squared Test
    A. V. Lapko
    V. A. Lapko
    A. V. Bakhtina
    Optoelectronics, Instrumentation and Data Processing, 2023, 59 : 551 - 560
  • [2] Pearson's chi-squared test
    Lydersen, Stian
    Fagerland, Morten Wang
    Laake, Petter
    TIDSSKRIFT FOR DEN NORSKE LAEGEFORENING, 2019, 139 (12) : 1183 - 1183
  • [3] PEARSON CHI-SQUARED TEST OF FIT WITH RANDOM INTERVALS
    DAHIYA, RC
    GURLAND, J
    BIOMETRIKA, 1972, 59 (01) : 147 - 153
  • [4] Decompositions of Pearson's chi-squared test
    Boero, G
    Smith, J
    Wallis, KF
    JOURNAL OF ECONOMETRICS, 2004, 123 (01) : 189 - 193
  • [5] Chi-Squared Test for Hypothesis Testing of Homogeneity
    Ermakov M.S.
    Journal of Mathematical Sciences, 2023, 273 (5) : 763 - 777
  • [6] USP: an independence test that improves on Pearson's chi-squared and the G-test
    Berrett, Thomas B.
    Samworth, Richard J.
    PROCEEDINGS OF THE ROYAL SOCIETY A-MATHEMATICAL PHYSICAL AND ENGINEERING SCIENCES, 2021, 477 (2256):
  • [7] A Bayesian chi-squared test for hypothesis testing
    Li, Yong
    Liu, Xiao-Bin
    Yu, Jun
    JOURNAL OF ECONOMETRICS, 2015, 189 (01) : 54 - 69
  • [8] Comparison of the Methodology for Hypothesis Testing of the Independence of Two-Dimensional Random Variables Based on a Nonparametric Classifier
    Lapko, A. V.
    Lapko, V. A.
    Bakhtina, A. V.
    SCIENTIFIC AND TECHNICAL INFORMATION PROCESSING, 2023, 50 (06) : 572 - 581
  • [9] Comparison of the Methodology for Hypothesis Testing of the Independence of Two-Dimensional Random Variables Based on a Nonparametric Classifier
    A. V. Lapko
    V. A. Lapko
    A. V. Bakhtina
    Scientific and Technical Information Processing, 2023, 50 : 572 - 581
  • [10] Differentially Private Chi-Squared Hypothesis Testing: Goodness of Fit and Independence Testing
    Gaboardi, Marco
    Lim, Hyun Woo
    Rogers, Ryan
    Vadhan, Salil P.
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 48, 2016, 48