A nearest-neighbor approach to estimating divergence between continuous random vectors

被引:40
|
作者
Wang, Qing [1 ]
Kulkarni, Sanjeev R. [1 ]
Verdu, Sergio [1 ]
机构
[1] Princeton Univ, Dept Elect Engn, Princeton, NJ 08544 USA
基金
美国国家科学基金会;
关键词
D O I
10.1109/ISIT.2006.261842
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
A method for divergence estimation between multidimensional distributions based on nearest neighbor distances is proposed. Given i.i.d. samples, both the bias and the variance of this estimator are proven to vanish as sample sizes go to infinity. In experiments on high-dimensional data, the nearest neighbor approach generally exhibits faster convergence compared to previous algorithms based on partitioning.
引用
收藏
页码:242 / +
页数:3
相关论文
共 50 条
  • [1] Steganographic Applications of the Nearest-Neighbor Approach to Kullback-Leibler Divergence Estimation
    Korzhik, Valery
    Fedyanin, Ivan
    2015 THIRD INTERNATIONAL CONFERENCE ON DIGITAL INFORMATION, NETWORKING, AND WIRELESS COMMUNICATIONS (DINWC), 2015, : 133 - 138
  • [2] Nearest-neighbor directed random hyperbolic graphs
    Kasyanov, I. A.
    van der Hoorn, P.
    Krioukov, D.
    Tamm, M., V
    PHYSICAL REVIEW E, 2023, 108 (05)
  • [3] A nearest-neighbor divide-and-conquer approach for adaptive random testing
    Huang, Rubing
    Sun, Weifeng
    Chen, Haibo
    Cui, Chenhui
    Yang, Ning
    SCIENCE OF COMPUTER PROGRAMMING, 2022, 215
  • [4] A nearest-neighbor divide-and-conquer approach for adaptive random testing
    Huang, Rubing
    Sun, Weifeng
    Chen, Haibo
    Cui, Chenhui
    Yang, Ning
    Science of Computer Programming, 2022, 215
  • [5] Continuous nearest-neighbor queries with location uncertainty
    Sistla, A. Prasad
    Wolfson, Ouri
    Xu, Bo
    VLDB JOURNAL, 2015, 24 (01): : 25 - 50
  • [6] A SIMPLE APPROACH TO THE NEAREST-NEIGHBOR PROBLEM
    ABEL, DJ
    SMITH, JL
    AUSTRALIAN COMPUTER JOURNAL, 1984, 16 (04): : 140 - 146
  • [7] Continuous nearest-neighbor queries with location uncertainty
    A. Prasad Sistla
    Ouri Wolfson
    Bo Xu
    The VLDB Journal, 2015, 24 : 25 - 50
  • [8] Continuous Nearest-Neighbor Search in the Presence of Obstacles
    Gao, Yunjun
    Zheng, Baihua
    Chen, Gang
    Chen, Chun
    Li, Qing
    ACM TRANSACTIONS ON DATABASE SYSTEMS, 2011, 36 (02):
  • [9] A PROBABILISTIC FILTER PROTOCOL FOR CONTINUOUS NEAREST-NEIGHBOR QUERY
    Zhu, Jianpeng
    Jin, Jian
    Wang, Ying
    2009 IEEE YOUTH CONFERENCE ON INFORMATION, COMPUTING AND TELECOMMUNICATION, PROCEEDINGS, 2009, : 399 - +
  • [10] ESTIMATING INTERACTIONS IN BINARY LATTICE DATA WITH NEAREST-NEIGHBOR PROPERTY
    JANZURA, M
    KYBERNETIKA, 1987, 23 (02) : 136 - 142