Efficient Astronomical Data Classification on Large-Scale Distributed Systems

被引:0
|
作者
Tang, Cheng-Hsien [1 ]
Wang, Min-Feng [1 ]
Wang, Wei-Jen [1 ]
Tsai, Meng-Feng [1 ]
Urata, Yuji [2 ]
Ngeow, Chow-Choong [2 ]
Lee, Induk [2 ]
Huang, Kuiyun [3 ]
Chen, Wen-Ping [2 ]
机构
[1] Natl Cent Univ, Dept Comp Sci & Informat Engn, Chungli, Taiwan
[2] Natl Ctr Univ, Astron Inst, Taoyuan, Taiwan
[3] Acad Sinica Inst Astron & Astro, Taipei, Taiwan
关键词
Classification; Support Vector Machine; Distributed System; Data Center;
D O I
暂无
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Classification of different kinds of space objects plays an important role in many astronomy areas. Nowadays the classification process can possibly involve a huge amount of data. It could take a long time for processing and demand many resources for computation and storage. In addition, it may also take much effort to train a qualified expert who needs to have both the astronomy domain knowledge and the capability to manipulate the data. This research intends to provide an efficient, scalable classification system for astronomy research. We implement a dynamic classification framework and system using support; vector machines (SVMs). The proposed system is based on a large-scale, distributed storage environment, on which scientists can design their analysis processes in a more abstract manner, instead of an awkward and time-consuming approach which searches and collects related subset of data from the huge data set. The experimental results confirm that our system is scalable and efficient.
引用
收藏
页码:430 / +
页数:2
相关论文
共 50 条
  • [1] An efficient replicated data access approach for large-scale distributed systems
    Deris, MM
    Abawajy, JH
    Suzuri, HM
    [J]. 2004 IEEE INTERNATIONAL SYMPOSIUM ON CLUSTER COMPUTING AND THE GRID - CCGRID 2004, 2004, : 588 - 594
  • [2] An efficient replicated data access approach for large-scale distributed systems
    Deris, Mustafa Mat
    Abawajy, Jemal H.
    Mamat, Ali
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2008, 24 (01): : 1 - 9
  • [3] Efficient Distributed Test Architectures for Large-Scale Systems
    de Almeida, Eduardo Cunha
    Marynowski, Joao Eugenio
    Sunye, Gerson
    Le Traon, Yves
    Valduriez, Patrick
    [J]. TESTING SOFTWARE AND SYSTEMS, 2010, 6435 : 174 - +
  • [4] A Fast Distributed Classification Algorithm for Large-scale Imbalanced Data
    Wang, Huihui
    Gao, Yang
    Shi, Yinghuan
    Wang, Hao
    [J]. 2016 IEEE 16TH INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2016, : 1251 - 1256
  • [5] Resource Allocation for Energy Efficient Large-Scale Distributed Systems
    Lee, Young Choon
    Zomaya, Albert Y.
    [J]. INFORMATION SYSTEMS, TECHNOLOGY AND MANAGEMENT, PROCEEDINGS, 2010, 54 : 16 - 19
  • [6] Resource allocation for energy efficient large-scale distributed systems
    Lee, Young Choon
    Zomaya, Albert Y.
    [J]. Communications in Computer and Information Science, 2010, 54 : 16 - 19
  • [7] A Data Storage Approach for Large-Scale Distributed Medical Systems
    de Macedo, Douglas D. J.
    von Wangenheim, Aldo
    Dantas, Mario A. R.
    [J]. 2015 9TH INTERNATIONAL CONFERENCE ON COMPLEX, INTELLIGENT, AND SOFTWARE INTENSIVE SYSTEMS CISIS 2015, 2015, : 486 - 490
  • [8] An Efficient Distributed Algorithm for Resource Allocation in Large-Scale Coupled Systems
    Niu, Di
    Li, Baochun
    [J]. 2013 PROCEEDINGS IEEE INFOCOM, 2013, : 1501 - 1509
  • [9] AstroServ: A Distributed Database for Serving Large-Scale Full Life-Cycle Astronomical Data
    Yang, Chen
    Meng, Xiaofeng
    Due, Zhihui
    Qiu, JiaMing
    Liang, Kenan
    Du, Yongjie
    Duan, Zhiqiang
    Ma, Xiaobin
    Fang, Zhijian
    [J]. BIG SCIENTIFIC DATA MANAGEMENT, 2019, 11473 : 44 - 55
  • [10] Data and information architectures for large-scale distributed data intensive information systems
    Kerschberg, L
    Gomaa, H
    Menasce, D
    Yoon, JP
    [J]. EIGHTH INTERNATIONAL CONFERENCE ON SCIENTIFIC AND STATISTICAL DATABASE SYSTEMS, PROCEEDINGS, 1996, : 226 - 233