Using an out-of-core technique for clustering large data sets

被引:1
|
作者
Masciari, E [1 ]
Pizzuti, C [1 ]
Raimondo, G [1 ]
Talia, D [1 ]
机构
[1] Univ Calabria, DEIS, I-87036 Arcavacata Di Rende, Italy
关键词
D O I
10.1109/DEXA.2001.953053
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Data mining algorithms generally deal with very large data sets that do not fit in main memory. Therefore, techniques that manage huge data sets need to be developed. Any algorithm that is proposed for mining data should have to account for out-of-core data structures. However, most of the existing algorithms haven't yet addressed this issue. In this paper we describe the implementation of an out-of-core technique for the data analysis of very large data sets with the sequential and parallel version of the clustering algorithm AutoClass. We discuss the out-of-core technique and show performance results in terms of execution time and speed zip.
引用
收藏
页码:133 / 137
页数:3
相关论文
共 50 条
  • [1] Out-of-Core Assessment of Clustering Tendency for Large Data Sets
    Pakhira, Malay K.
    2010 IEEE 2ND INTERNATIONAL ADVANCE COMPUTING CONFERENCE, 2010, : 29 - 33
  • [2] OMR: Out-of-Core MapReduce for Large Data Sets
    Kaur, Gurneet
    Vora, Keval
    Koduru, Sai Charan
    Gupta, Rajiv
    PROCEEDINGS OF THE 2018 ACM SIGPLAN INTERNATIONAL SYMPOSIUM ON MEMORY MANAGEMENT (ISMM'18), 2018, : 71 - 83
  • [3] OMR: Out-of-Core MapReduce for Large Data Sets
    Kaur, Gurneet
    Vora, Keval
    Koduru, Sai Charan
    Gupta, Rajiv
    ACM SIGPLAN NOTICES, 2018, 53 (05) : 71 - 83
  • [4] An efficient out-of-core volume ray casting method for the visualization of large medical data sets
    Xue, Jian
    Tian, Jie
    Chen, Jian
    Dai, Yakang
    MEDICAL IMAGING 2007: VISUALIZATION AND IMAGE-GUIDED PROCEDURES, PTS 1 AND 2, 2007, 6509
  • [5] Out-of-core clustering of volumetric datasets
    Granberg C.J.
    Li L.
    J Zhejiang Univ: Sci, 2006, 7 (1134-1140): : 1134 - 1140
  • [6] Out-of-core clustering of volumetric datasets
    GRANBERG Carl J.
    Journal of Zhejiang University-Science A(Applied Physics & Engineering), 2006, (07) : 1134 - 1140
  • [7] A grain generation method for large die data using the out-of-core method
    Tang, Cam Nguyen
    Uzuyama, Daijiro
    Miura, Kenjiro T.
    Usuki, Shin
    Kikuta, Mamoru
    Computer-Aided Design and Applications, 2012, 9 (06): : 915 - 923
  • [8] Out-of-Core Surface Reconstruction from Large Point Sets for Infrastructure Inspection
    Xu, Chen
    Frechet, Simon
    Laurendeau, Denis
    Miralles, Francois
    2015 12TH CONFERENCE ON COMPUTER AND ROBOT VISION CRV 2015, 2015, : 313 - 317
  • [9] Large out-of-core tetrahedral meshing
    Alleaume, Aurelien
    Francez, Laurent
    Loriot, Alark
    Maman, Nathan
    PROCEEDINGS OF THE 16TH INTERNATIONAL MESHING ROUNDTABLE, 2008, : 461 - +
  • [10] Interactive out-of-core isosurface visualisation in time-varying data sets
    Vrolijk, B
    Post, FH
    COMPUTERS & GRAPHICS-UK, 2006, 30 (02): : 265 - 276