Fast tree aggregation for consensus hierarchical clustering

被引:10
|
作者
Hulot, Audrey [1 ,2 ,3 ]
Chiquet, Julien [2 ]
Jaffrezic, Florence [1 ]
Rigaill, Guillem [4 ,5 ,6 ]
机构
[1] Univ Paris Saclay, AgroParisTech, INRAE, GABI, F-78350 Jouy En Josas, France
[2] Univ Paris Saclay, AgroParisTech, INRAE, UMR MIA Paris, F-75005 Paris, France
[3] Univ Paris Saclay, UVSQ, INSERM, Infect & Inflammat, F-78180 Montigny Le Bretonneux, France
[4] Univ Evry, Univ Paris Saclay, CNRS, INRAE,Inst Plant Sci Paris Saclay IPS2, F-91405 Orsay, France
[5] Univ Paris, INRAE, CNRS, Inst Plant Sci Paris Saclay IPS2, F-91405 Orsay, France
[6] Univ Evry, Univ Paris Saclay, CNRS, Lab Math & Modelisat Evry, F-91037 Evry, France
关键词
Hierarchical clustering; Data integration; Unsupervised learning; Consensus clustering; Omics; ALGORITHMS; DISCOVERY;
D O I
10.1186/s12859-020-3453-6
中图分类号
Q5 [生物化学];
学科分类号
071010 ; 081704 ;
摘要
Background: In unsupervised learning and clustering, data integration from different sources and types is a difficult question discussed in several research areas. For instance in omics analysis, dozen of clustering methods have been developed in the past decade. When a single source of data is at play, hierarchical clustering (HC) is extremely popular, as a tree structure is highly interpretable and arguably more informative than just a partition of the data. However, applying blindly HC to multiple sources of data raises computational and interpretation issues. Results: We propose mergeTrees, a method that aggregates a set of trees with the same leaves to create a consensus tree. In our consensus tree, a cluster at height h contains the individuals that are in the same cluster for all the trees at height h. The method is exact and proven to be O(nq log(n)), n being the individuals and q being the number of trees to aggregate. Our implementation is extremely effective on simulations, allowing us to process many large trees at a time. We also rely on mergeTrees to perform the cluster analysis of two real-omics data sets, introducing a spectral variant as an efficient and robust by-product. Conclusions: Our tree aggregation method can be used in conjunction with hierarchical clustering to perform efficient cluster analysis. This approach was found to be robust to the absence of clustering information in some of the data sets as well as an increased variability within true clusters. The method is implemented in R/C++ and available as an R package named mergeTrees, which makes it easy to integrate in existing or new pipelines in several research areas.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Fast tree aggregation for consensus hierarchical clustering
    Audrey Hulot
    Julien Chiquet
    Florence Jaffrézic
    Guillem Rigaill
    BMC Bioinformatics, 21
  • [2] A Fast Quartet tree heuristic for hierarchical clustering
    Cilibrasi, Rudi L.
    Vitanyi, Paul M. B.
    PATTERN RECOGNITION, 2011, 44 (03) : 662 - 677
  • [3] Hierarchical soft clustering tree for fast approximate search of binary codes
    Choi, S.
    Lee, S.
    Yang, H. S.
    ELECTRONICS LETTERS, 2015, 51 (24) : 1992 - 1993
  • [4] A Fast Quad-Tree Based Two Dimensional Hierarchical Clustering
    Rajadurai, Priscilla
    Sankaranarayanan, Swamynathan
    BIOINFORMATICS AND BIOLOGY INSIGHTS, 2012, 6 : 265 - 274
  • [5] Hierarchical Clustering and Tree Stability
    Saunders, Amanda
    Ashlock, Daniel
    Houghten, Sheridan
    2018 IEEE CONFERENCE ON COMPUTATIONAL INTELLIGENCE IN BIOINFORMATICS AND COMPUTATIONAL BIOLOGY (CIBCB), 2018, : 138 - 145
  • [6] Fast Parallel Algorithms for Euclidean Minimum Spanning Tree and Hierarchical Spatial Clustering
    Wang, Yiqiu
    Yu, Shangdi
    Gu, Yan
    Shun, Julian
    SIGMOD '21: PROCEEDINGS OF THE 2021 INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA, 2021, : 1982 - 1995
  • [7] Improving Consensus Hierarchical Clustering Framework
    Biswas, Ashis Kumer
    Zhang, Baoju
    Wu, Xiaoyong
    Gao, Jean X.
    PROCEEDINGS OF THE 2015 INTERNATIONAL CONFERENCE ON COMMUNICATIONS, SIGNAL PROCESSING, AND SYSTEMS, 2016, 386 : 781 - 791
  • [8] Hierarchical Clustering and Consensus in Trust Networks
    Segarra, Santiago
    Ribeiro, Alejandro
    2013 IEEE 5TH INTERNATIONAL WORKSHOP ON COMPUTATIONAL ADVANCES IN MULTI-SENSOR ADAPTIVE PROCESSING (CAMSAP 2013), 2013, : 85 - 88
  • [9] Hierarchical tree clustering of fuzzy number
    Yazdi, Hadi Sadoghi
    GhasemiGol, Mohammad
    Effati, Sohrab
    Jiriani, Azam
    Monsefi, Reza
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2014, 26 (02) : 541 - 550
  • [10] Scalable Hierarchical Clustering with Tree Grafting
    Monath, Nicholas
    Kobren, Ari
    Krishnamurthy, Akshay
    Glass, Michael R.
    McCallum, Andrew
    KDD'19: PROCEEDINGS OF THE 25TH ACM SIGKDD INTERNATIONAL CONFERENCCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2019, : 1438 - 1448