Using an out-of-core technique for clustering large data sets

被引：1

作者：

Masciari, E ^{[1
]}

Pizzuti, C ^{[1
]}

Raimondo, G ^{[1
]}

Talia, D ^{[1
]}

机构：

[1] Univ Calabria, DEIS, I-87036 Arcavacata Di Rende, Italy

来源：

12TH INTERNATIONAL WORKSHOP ON DATABASE AND EXPERT SYSTEMS APPLICATIONS, PROCEEDINGS | 2001年

关键词：

D O I：

10.1109/DEXA.2001.953053

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

Data mining algorithms generally deal with very large data sets that do not fit in main memory. Therefore, techniques that manage huge data sets need to be developed. Any algorithm that is proposed for mining data should have to account for out-of-core data structures. However, most of the existing algorithms haven't yet addressed this issue. In this paper we describe the implementation of an out-of-core technique for the data analysis of very large data sets with the sequential and parallel version of the clustering algorithm AutoClass. We discuss the out-of-core technique and show performance results in terms of execution time and speed zip.

引用

页码：133 / 137

页数：3

共 50 条

[31] Big Data Analytics Performance for Large Out-Of-Core Matrix Solvers on Advanced Hybrid Architectures
Rao, Raghavendra Shruti
Halem, Milton
Dorband, John
INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE, ICCS 2015 COMPUTATIONAL SCIENCE AT THE GATES OF NATURE, 2015, 51 : 2774 - 2778
[32] GAMER with out-of-core computation
Schive, Hsi-Yu
Tsai, Yu-Chih
Chiueh, Tzihong
COMPUTATIONAL STAR FORMATION, 2011, (270): : 401 - 405
[33] Out-of-core mls reconstruction
Fiorin, Valentino
Cignoni, Paolo
Scopigno, Roberto
PROCEEDINGS OF THE NINTH IASTED INTERNATIONAL CONFERENCE ON COMPUTER GRAPHICS AND IMAGING, 2007, : 27 - 34
[34] A Cholesky out-of-core factorization
Castellanos, J. A.
Larrazabal, G.
MATHEMATICAL AND COMPUTER MODELLING, 2013, 57 (9-10) : 2207 - 2222
[35] Active Flash: Out-of-core Data Analytics on Flash Storage
Boboila, Simona
Kim, Youngjae
Vazhkudai, Sudharshan S.
Desnoyers, Peter
Shipman, Galen M.
2012 IEEE 28TH SYMPOSIUM ON MASS STORAGE SYSTEMS AND TECHNOLOGIES (MSST), 2012,
[36] Data locality optimization for synthesis of efficient out-of-core algorithms
Krishnan, S
Krishnamoorthy, S
Baumgartner, G
Cociorva, D
Lam, CC
Sadayappan, P
Ramanujam, J
Bernholdt, DE
Choppella, V
HIGH PERFORMANCE COMPUTING - HIPC 2003, 2003, 2913 : 406 - 417
[37] Interactive out-of-core visualization of multiresolution time series data
Bergeron, R. Daniel
Foulks, Andrew
NUMERICAL MODELING OF SPACE PLASMA FLOWS: ASTRONUM-2006, 2006, 359 : 285 - +
[38] Out-of-core Data Management for Path Tracing on Hybrid Resources
Budge, Brian
Bernardin, Tony
Stuart, Jeff A.
Sengupta, Shubhabrata
Joy, Kenneth I.
Owens, John D.
COMPUTER GRAPHICS FORUM, 2009, 28 (02) : 385 - 396
[39] Very large electronic structure calculations using an out-of-core filter-diagonalization method
Toledo, S
Rabani, E
JOURNAL OF COMPUTATIONAL PHYSICS, 2002, 180 (01) : 256 - 269
[40] IN-CORE/OUT-OF-CORE METHOD FOR SOLVING LARGE SCALE ASSIGNMENT PROBLEMS.
Derigs, U.
Metz, A.
1600, (30):

← 1 2 3 4 5 →