Fast tree aggregation for consensus hierarchical clustering

被引:10
|
作者
Hulot, Audrey [1 ,2 ,3 ]
Chiquet, Julien [2 ]
Jaffrezic, Florence [1 ]
Rigaill, Guillem [4 ,5 ,6 ]
机构
[1] Univ Paris Saclay, AgroParisTech, INRAE, GABI, F-78350 Jouy En Josas, France
[2] Univ Paris Saclay, AgroParisTech, INRAE, UMR MIA Paris, F-75005 Paris, France
[3] Univ Paris Saclay, UVSQ, INSERM, Infect & Inflammat, F-78180 Montigny Le Bretonneux, France
[4] Univ Evry, Univ Paris Saclay, CNRS, INRAE,Inst Plant Sci Paris Saclay IPS2, F-91405 Orsay, France
[5] Univ Paris, INRAE, CNRS, Inst Plant Sci Paris Saclay IPS2, F-91405 Orsay, France
[6] Univ Evry, Univ Paris Saclay, CNRS, Lab Math & Modelisat Evry, F-91037 Evry, France
关键词
Hierarchical clustering; Data integration; Unsupervised learning; Consensus clustering; Omics; ALGORITHMS; DISCOVERY;
D O I
10.1186/s12859-020-3453-6
中图分类号
Q5 [生物化学];
学科分类号
071010 ; 081704 ;
摘要
Background: In unsupervised learning and clustering, data integration from different sources and types is a difficult question discussed in several research areas. For instance in omics analysis, dozen of clustering methods have been developed in the past decade. When a single source of data is at play, hierarchical clustering (HC) is extremely popular, as a tree structure is highly interpretable and arguably more informative than just a partition of the data. However, applying blindly HC to multiple sources of data raises computational and interpretation issues. Results: We propose mergeTrees, a method that aggregates a set of trees with the same leaves to create a consensus tree. In our consensus tree, a cluster at height h contains the individuals that are in the same cluster for all the trees at height h. The method is exact and proven to be O(nq log(n)), n being the individuals and q being the number of trees to aggregate. Our implementation is extremely effective on simulations, allowing us to process many large trees at a time. We also rely on mergeTrees to perform the cluster analysis of two real-omics data sets, introducing a spectral variant as an efficient and robust by-product. Conclusions: Our tree aggregation method can be used in conjunction with hierarchical clustering to perform efficient cluster analysis. This approach was found to be robust to the absence of clustering information in some of the data sets as well as an increased variability within true clusters. The method is implemented in R/C++ and available as an R package named mergeTrees, which makes it easy to integrate in existing or new pipelines in several research areas.
引用
收藏
页数:12
相关论文
共 50 条
  • [41] Aggregation of Individual Feature Based Similarities and Application to Hierarchical Clustering
    Zhou, Ning
    Xie, Bojun
    Wang, Tao
    IAEDS15: INTERNATIONAL CONFERENCE IN APPLIED ENGINEERING AND MANAGEMENT, 2015, 46 : 217 - 222
  • [42] Unsupervised Rank Aggregation using Hierarchical User Similarity Clustering
    Dutta, Sourav
    THIRTEENTH SCANDINAVIAN CONFERENCE ON ARTIFICIAL INTELLIGENCE (SCAI 2015), 2015, 278 : 37 - 47
  • [43] Bloom filters for data aggregation and discovery: a hierarchical clustering approach
    Hebden, P
    Pearce, AR
    PROCEEDINGS OF THE 2005 INTELLIGENT SENSORS, SENSOR NETWORKS & INFORMATION PROCESSING CONFERENCE, 2005, : 175 - 180
  • [44] Aggregation Scheme with Secure Hierarchical Clustering for Wireless Sensor Networks
    Su, Tung-Shih
    Huang, Mei-Wen
    Li, Wei-Shou
    Hsieh, Wen-Shyong
    INTERNATIONAL JOURNAL OF DISTRIBUTED SENSOR NETWORKS, 2012,
  • [45] Fast approximate hierarchical clustering using similarity heuristics
    Meelis Kull
    Jaak Vilo
    BioData Mining, 1
  • [46] Quality Preserved Data Summarization for Fast Hierarchical Clustering
    Zhang, Yiqun
    Cheung, Yiu-ming
    Liu, Yang
    2016 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2016, : 4139 - 4146
  • [47] Fast Hierarchical Graph Clustering in Linear-Time
    Rossi, Ryan A.
    Ahmed, Nesreen K.
    Koh, Eunyee
    Kim, Sungchul
    WWW'20: COMPANION PROCEEDINGS OF THE WEB CONFERENCE 2020, 2020, : 10 - 12
  • [48] Fast Hierarchical Clustering Based on Compressed Data and OPTICS
    Breunig, Markus M.
    Kriegel, Hans-Peter
    Sander, Joerg
    LECTURE NOTES IN COMPUTER SCIENCE <D>, 2000, 1910 : 232 - 242
  • [49] Fast R Functions for Robust Correlations and Hierarchical Clustering
    Langfelder, Peter
    Horvath, Steve
    JOURNAL OF STATISTICAL SOFTWARE, 2012, 46 (11): : 1 - 17
  • [50] Fast approximate hierarchical clustering using similarity heuristics
    Kull, Meelis
    Vilo, Jaak
    BIODATA MINING, 2008, 1 (1)