Fast tree aggregation for consensus hierarchical clustering

被引:10
|
作者
Hulot, Audrey [1 ,2 ,3 ]
Chiquet, Julien [2 ]
Jaffrezic, Florence [1 ]
Rigaill, Guillem [4 ,5 ,6 ]
机构
[1] Univ Paris Saclay, AgroParisTech, INRAE, GABI, F-78350 Jouy En Josas, France
[2] Univ Paris Saclay, AgroParisTech, INRAE, UMR MIA Paris, F-75005 Paris, France
[3] Univ Paris Saclay, UVSQ, INSERM, Infect & Inflammat, F-78180 Montigny Le Bretonneux, France
[4] Univ Evry, Univ Paris Saclay, CNRS, INRAE,Inst Plant Sci Paris Saclay IPS2, F-91405 Orsay, France
[5] Univ Paris, INRAE, CNRS, Inst Plant Sci Paris Saclay IPS2, F-91405 Orsay, France
[6] Univ Evry, Univ Paris Saclay, CNRS, Lab Math & Modelisat Evry, F-91037 Evry, France
关键词
Hierarchical clustering; Data integration; Unsupervised learning; Consensus clustering; Omics; ALGORITHMS; DISCOVERY;
D O I
10.1186/s12859-020-3453-6
中图分类号
Q5 [生物化学];
学科分类号
071010 ; 081704 ;
摘要
Background: In unsupervised learning and clustering, data integration from different sources and types is a difficult question discussed in several research areas. For instance in omics analysis, dozen of clustering methods have been developed in the past decade. When a single source of data is at play, hierarchical clustering (HC) is extremely popular, as a tree structure is highly interpretable and arguably more informative than just a partition of the data. However, applying blindly HC to multiple sources of data raises computational and interpretation issues. Results: We propose mergeTrees, a method that aggregates a set of trees with the same leaves to create a consensus tree. In our consensus tree, a cluster at height h contains the individuals that are in the same cluster for all the trees at height h. The method is exact and proven to be O(nq log(n)), n being the individuals and q being the number of trees to aggregate. Our implementation is extremely effective on simulations, allowing us to process many large trees at a time. We also rely on mergeTrees to perform the cluster analysis of two real-omics data sets, introducing a spectral variant as an efficient and robust by-product. Conclusions: Our tree aggregation method can be used in conjunction with hierarchical clustering to perform efficient cluster analysis. This approach was found to be robust to the absence of clustering information in some of the data sets as well as an increased variability within true clusters. The method is implemented in R/C++ and available as an R package named mergeTrees, which makes it easy to integrate in existing or new pipelines in several research areas.
引用
收藏
页数:12
相关论文
共 50 条
  • [21] Fitting tree metrics: Hierarchical clustering and phylogeny
    Ailon, N
    Charikar, M
    46TH ANNUAL IEEE SYMPOSIUM ON FOUNDATIONS OF COMPUTER SCIENCE, PROCEEDINGS, 2005, : 73 - 82
  • [22] HIERARCHICAL CLUSTERING USING MINIMUM SPANNING TREE
    ROHLF, FJ
    COMPUTER JOURNAL, 1973, 16 (01): : 93 - 95
  • [23] Hierarchical Aggregation Approach for Distributed clustering of spatial datasets
    Bendechache, Malika
    Le-Khac, Nhien-An
    Kechadi, M-Tahar
    2016 IEEE 16TH INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOPS (ICDMW), 2016, : 1098 - 1103
  • [24] Fast hierarchical clustering based on compressed data
    Rendon, E
    Barandela, R
    16TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOL II, PROCEEDINGS, 2002, : 216 - 219
  • [25] Fast Hierarchical Clustering from the Baire Distance
    Contreras, Pedro
    Murtagh, Fionn
    CLASSIFICATION AS A TOOL FOR RESEARCH, 2010, : 235 - 243
  • [26] Hierarchical clustering algorithm for fast image retrieval
    Krishnamachari, S
    Abdel-Mottaleb, M
    STORAGE AND RETRIEVAL FOR IMAGE AND VIDEO DATABASES VII, 1998, 3656 : 427 - 435
  • [27] Efficient dynamic traffic navigation with hierarchical aggregation tree
    Bai, Y
    Guo, YY
    Meng, XF
    Wan, T
    Zeitouni, K
    FRONTIERS OF WWW RESEARCH AND DEVELOPMENT - APWEB 2006, PROCEEDINGS, 2006, 3841 : 751 - 758
  • [28] Best Effort Hierarchical Aggregation Tree for IPTV Signaling
    Burget, Radim
    Muller, Jakub
    Komosny, Dan
    INTERNATIONAL JOURNAL OF COMPUTER SCIENCE AND NETWORK SECURITY, 2008, 8 (11): : 364 - 368
  • [29] Interpretable hierarchical clustering by constructing an unsupervised decision tree
    Basak, J
    Krishnapuram, R
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2005, 17 (01) : 121 - 132
  • [30] Hierarchical nearest neighbor descent, in-tree, and clustering
    Qiu, Teng
    Li, Yongjie
    PATTERN RECOGNITION, 2023, 137