DPCF: A framework for imputing missing values and clustering data in drug discovery process

被引:1
|
作者
Bhagat, Hutashan Vishal [1 ]
Singh, Manminder [1 ]
机构
[1] Sant Longowal Inst Engn & Technol, Longowal, Punjab, India
关键词
Data missingness; Imputation; High dimensional datasets; Data clustering; Z_score; Data partitioning algorithms; Unsupervised datasets; Cluster validation index; K-MEANS; ALGORITHM; VALIDATION; PARTITION; NUMBER; FIND;
D O I
10.1016/j.chemolab.2022.104686
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The advent of modern Internet of Things (IoT) architectures has led to ease in data collection and availability. The data generated from such architectures are of large volume and dimensionality. As a result, data missingness and data labeling are the commonly occurring problems in the data collection process when data volume is too large. Data clustering is a commonly used unsupervised pattern classification technique that helps in identifying the hidden structure of the datasets and clusters or groups similar data items together. In context to chemo-metrics, clustering techniques play a significant role in identifying the structure-property relationships and structure-activity relationships among different compounds in drug discovery process. The quantitative structure-property relationships (QSPR) are based on the similar property principle which states that if the com-pounds are clustered together based on structural descriptors, the compounds within the same cluster will have similar properties. The quantitative structure-activity relationships (QSAR) help in determining the empirical relationships between chemical structure and biological activity of a set of identical compounds. Hence, a variety of compounds can be divided into homogeneous subsets using cluster analysis. The effectiveness of any clustering algorithm mostly depends on how efficiently the initial cluster centers are identified. Traditional techniques that mostly rely on the random selection of initial cluster centers and different parameter settings may result in distinct clusters for the same dataset. Moreover, if the initial cluster centers selected are outliers then the clusters formed are of poor quality. The quality of each cluster can be determined by using distinct cluster validation indices (CVIs). This paper aims to solve the problems of data missingness as well as data labeling for unsuper-vised datasets. In continuation to the previous study where the NMVI (Nullify the Missing Values before Imputation) technique efficiently imputes the missing values in different datasets, in this paper the proposed DPCF (Data Partitioning-based Clustering Framework) framework utilize the NMVI technique to impute the missing values and a novel Z-Clust clustering algorithm is proposed that efficiently clusters the unlabeled data samples. The integration of the NMVI technique and Z-Clust clustering technique in the proposed framework makes it well suited for the analysis of unsupervised datasets having missing values. The performance evaluation of the proposed Z-Clust clustering technique is done by using five standard CVIs and the results are compared with the existing clustering techniques. The experimental results depict that the proposed Z-Clust clustering technique shows better cluster formation as compared to the existing clustering techniques. Henceforth, the proposed DPCF framework is well suited for the analysis of datasets without labels and having missing values.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] A Matrix Completion Method for Imputing Missing Values of Process Data
    Zhang, Xinyu
    Sun, Xiaoyan
    Xia, Li
    Tao, Shaohui
    Xiang, Shuguang
    PROCESSES, 2024, 12 (04)
  • [2] Imputing missing values for genetic interaction data
    Wang, Yishu
    Wang, Lin
    Yang, Dejie
    Deng, Minghua
    METHODS, 2014, 67 (03) : 269 - 277
  • [3] Imputing Missing Values for Mixed Numeric and Categorical Attributes Based on Incomplete Data Hierarchical Clustering
    Feng, Xiaodong
    Wu, Sen
    Liu, Yanchi
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, 2011, 7091 : 414 - 424
  • [4] Imputing Missing Values in Microarray Data with Ontology Information
    Yang, Andy C.
    Hsu, Hui-Huang
    Lu, Ming-Da
    2010 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE WORKSHOPS (BIBMW), 2010, : 535 - 540
  • [5] Imputing Missing Values from Low Quality Data by NIP Tooly
    Martinez, Raquel
    Cadenas, Jose M.
    Carmen Garrido, M.
    Martinez, Alejandro
    2013 IEEE INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS (FUZZ - IEEE 2013), 2013,
  • [6] Novel Methods for Imputing Missing Values in Water Level Monitoring Data
    Thakolpat Khampuengson
    Wenjia Wang
    Water Resources Management, 2023, 37 : 851 - 878
  • [7] Novel Methods for Imputing Missing Values in Water Level Monitoring Data
    Khampuengson, Thakolpat
    Wang, Wenjia
    WATER RESOURCES MANAGEMENT, 2023, 37 (02) : 851 - 878
  • [8] Multiply imputing missing values arising by design in transplant survival data
    Pankhurst, Laura
    Mitra, Robin
    Kimber, Alan
    Collett, Dave
    BIOMETRICAL JOURNAL, 2020, 62 (05) : 1192 - 1207
  • [9] Imputing missing values in unevenly spaced clinical time series data to build an effective temporal classification framework
    Nancy, Jane Y.
    Khanna, Nehemiah H.
    Arputharaj, Kannan
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2017, 112 : 63 - 79
  • [10] Kernel weighted least square approach for imputing missing values of metabolomics data
    Nishith Kumar
    Md. Aminul Hoque
    Masahiro Sugimoto
    Scientific Reports, 11