Using an out-of-core technique for clustering large data sets

被引:1
|
作者
Masciari, E [1 ]
Pizzuti, C [1 ]
Raimondo, G [1 ]
Talia, D [1 ]
机构
[1] Univ Calabria, DEIS, I-87036 Arcavacata Di Rende, Italy
关键词
D O I
10.1109/DEXA.2001.953053
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Data mining algorithms generally deal with very large data sets that do not fit in main memory. Therefore, techniques that manage huge data sets need to be developed. Any algorithm that is proposed for mining data should have to account for out-of-core data structures. However, most of the existing algorithms haven't yet addressed this issue. In this paper we describe the implementation of an out-of-core technique for the data analysis of very large data sets with the sequential and parallel version of the clustering algorithm AutoClass. We discuss the out-of-core technique and show performance results in terms of execution time and speed zip.
引用
收藏
页码:133 / 137
页数:3
相关论文
共 50 条
  • [21] Image-mapped data clustering: An efficient technique for clustering large data sets
    Al-Omari, Faruq
    Al-Fayoumi, Nabeel
    Al-Jarrah, Mohammad
    INTELLIGENT DATA ANALYSIS, 2008, 12 (06) : 573 - 586
  • [22] Adaptive out-of-core simplification of large point clouds
    Du, Xiaohui
    Yin, Baocai
    Kong, Dehui
    2007 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, VOLS 1-5, 2007, : 1439 - 1442
  • [23] GO: Out-Of-Core Partitioning of Large Irregular Graphs
    Kaur, Gurneet
    Gupta, Rajiv
    2021 IEEE INTERNATIONAL CONFERENCE ON NETWORKING, ARCHITECTURE AND STORAGE (NAS), 2021, : 9 - 18
  • [24] Spatial prefetching for out-of-core visualization of multidimensional data
    Lipsa, Dan R.
    Rhodes, Philip J.
    Bergeron, R. Daniel
    Sparr, Ted M.
    VISUALIZATION AND DATA ANALYSIS 2007, 2007, 6495
  • [25] Fast and exact out-of-core and distributed k-means clustering
    Jin, Ruoming
    Goswami, Anjan
    Agrawal, Gagan
    KNOWLEDGE AND INFORMATION SYSTEMS, 2006, 10 (01) : 17 - 40
  • [26] Fast and exact out-of-core and distributed k-means clustering
    Ruoming Jin
    Anjan Goswami
    Gagan Agrawal
    Knowledge and Information Systems, 2006, 10 : 17 - 40
  • [27] Parallel In-Core and Out-of-Core Solution of Electrically Large Problems Using the RWG Basis Functions
    Zhang, Yu
    Taylor, Mary
    Sarkar, Tapan K.
    De, Arijit
    Yuan, Mengtao
    Moon, Hongsik
    Liang, Changhong
    IEEE ANTENNAS AND PROPAGATION MAGAZINE, 2008, 50 (05) : 84 - 94
  • [28] Out-of-core Extraction of Curve Skeletons for Large Volumetric Models
    Chu, Yiyao
    Wang, Wencheng
    COMPUTER GRAPHICS FORUM, 2022, 41 (07) : 1 - 12
  • [29] Feature sensitive out-of-core chartification of large polygonal meshes
    Choe, Sungyul
    Ahn, Minsu
    Lee, Seungyong
    ADVANCES IN COMPUTER GRAPHICS, PROCEEDINGS, 2006, 4035 : 518 - 529
  • [30] Interactive Visualization of Large Point Clouds Using an Autotuning Multiresolution Out-Of-Core Strategy
    Teijeiro, Diego
    Amor, Margarita
    Doallo, Ramon
    Deibe, David
    COMPUTER JOURNAL, 2023, 66 (07): : 1802 - 1816