DPCF: A framework for imputing missing values and clustering data in drug discovery process

被引:1
|
作者
Bhagat, Hutashan Vishal [1 ]
Singh, Manminder [1 ]
机构
[1] Sant Longowal Inst Engn & Technol, Longowal, Punjab, India
关键词
Data missingness; Imputation; High dimensional datasets; Data clustering; Z_score; Data partitioning algorithms; Unsupervised datasets; Cluster validation index; K-MEANS; ALGORITHM; VALIDATION; PARTITION; NUMBER; FIND;
D O I
10.1016/j.chemolab.2022.104686
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The advent of modern Internet of Things (IoT) architectures has led to ease in data collection and availability. The data generated from such architectures are of large volume and dimensionality. As a result, data missingness and data labeling are the commonly occurring problems in the data collection process when data volume is too large. Data clustering is a commonly used unsupervised pattern classification technique that helps in identifying the hidden structure of the datasets and clusters or groups similar data items together. In context to chemo-metrics, clustering techniques play a significant role in identifying the structure-property relationships and structure-activity relationships among different compounds in drug discovery process. The quantitative structure-property relationships (QSPR) are based on the similar property principle which states that if the com-pounds are clustered together based on structural descriptors, the compounds within the same cluster will have similar properties. The quantitative structure-activity relationships (QSAR) help in determining the empirical relationships between chemical structure and biological activity of a set of identical compounds. Hence, a variety of compounds can be divided into homogeneous subsets using cluster analysis. The effectiveness of any clustering algorithm mostly depends on how efficiently the initial cluster centers are identified. Traditional techniques that mostly rely on the random selection of initial cluster centers and different parameter settings may result in distinct clusters for the same dataset. Moreover, if the initial cluster centers selected are outliers then the clusters formed are of poor quality. The quality of each cluster can be determined by using distinct cluster validation indices (CVIs). This paper aims to solve the problems of data missingness as well as data labeling for unsuper-vised datasets. In continuation to the previous study where the NMVI (Nullify the Missing Values before Imputation) technique efficiently imputes the missing values in different datasets, in this paper the proposed DPCF (Data Partitioning-based Clustering Framework) framework utilize the NMVI technique to impute the missing values and a novel Z-Clust clustering algorithm is proposed that efficiently clusters the unlabeled data samples. The integration of the NMVI technique and Z-Clust clustering technique in the proposed framework makes it well suited for the analysis of unsupervised datasets having missing values. The performance evaluation of the proposed Z-Clust clustering technique is done by using five standard CVIs and the results are compared with the existing clustering techniques. The experimental results depict that the proposed Z-Clust clustering technique shows better cluster formation as compared to the existing clustering techniques. Henceforth, the proposed DPCF framework is well suited for the analysis of datasets without labels and having missing values.
引用
收藏
页数:16
相关论文
共 50 条
  • [21] Clustering mixed numerical and categorical data with missing values
    Dinh, Duy-Tai
    Huynh, Van-Nam
    Sriboonchitta, Songsak
    INFORMATION SCIENCES, 2021, 571 : 418 - 442
  • [22] ROUGH FUZZY SUBSPACE CLUSTERING FOR DATA WITH MISSING VALUES
    Siminski, Krzysztof
    COMPUTING AND INFORMATICS, 2014, 33 (01) : 131 - 153
  • [23] Treatment of missing values in process data analysis
    Imtiaz, S. A.
    Shah, S. L.
    CANADIAN JOURNAL OF CHEMICAL ENGINEERING, 2008, 86 (05): : 838 - 858
  • [24] A Novel Method for Imputing Missing Values in Ship Static Data Based on Generative Adversarial Networks
    Gao, Junbo
    Cai, Ze
    Sun, Wei
    Jiao, Yingqi
    JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2023, 11 (04)
  • [25] Verification of Improving a Clustering Algorithm for Microarray Data with Missing Values
    Kim, SuYoung
    KOREAN JOURNAL OF APPLIED STATISTICS, 2011, 24 (02) : 315 - 321
  • [26] Compressive Sensing and Hierarchical Clustering for Microarray Data with Missing Values
    Ciaramellila, Angelo
    Nardone, Davide
    Staiano, Antonino
    COMPUTATIONAL INTELLIGENCE METHODS FOR BIOINFORMATICS AND BIOSTATISTICS, CIBB 2018, 2020, 11925 : 3 - 10
  • [27] Clustering of Chemical Data Sets for Drug Discovery
    Malhat, Mohamed G.
    Mousa, Hamdy M.
    El-Sisi, Ashraf B.
    2014 9TH INTERNATIONAL CONFERENCE ON INFORMATICS AND SYSTEMS (INFOS), 2014,
  • [28] Discovery of Association Rules from Data including Missing Values
    Sakurai, Shigeaki
    Mori, Kouichirou
    Orihara, Ryohei
    CISIS: 2009 INTERNATIONAL CONFERENCE ON COMPLEX, INTELLIGENT AND SOFTWARE INTENSIVE SYSTEMS, VOLS 1 AND 2, 2009, : 67 - 74
  • [29] A matrix completion-based multiview learning method for imputing missing values in buoy monitoring data
    Qin, Mengjiao
    Du, Zhenhong
    Zhang, Feng
    Liu, Renyi
    INFORMATION SCIENCES, 2019, 487 : 18 - 30
  • [30] Making the most of missing values: Object clustering with partial data in astronomy
    Wagstaff, KL
    Laidler, VG
    ASTRONOMICAL DATA ANALYSIS SOFTWARE AND SYSTEMS XIV, PROCEEDINGS, 2005, 347 : 172 - 176