Data Mining In Massive Spectral Data

被引:0
|
作者
Wang, Wenyu [1 ,2 ]
Wang, Xinjun [1 ]
Jiang, Bin [2 ]
Pan, Jingchang [2 ]
机构
[1] Shandong Univ, Sch Comp Sci & Technol, Jinan 250101, Shandong, Peoples R China
[2] Shandong Univ, Sch Mech Elect & Informat Engn, Weihai 264209, Peoples R China
基金
中国国家自然科学基金;
关键词
PCA; LOF; Data mining; SVM;
D O I
暂无
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
with the astronomical spectra data grows rapidly, it becomes impossible for astronomers to read all the data manually, especially for some sky survey telescopes like SLOAN which will yield immense amounts of data every observational night. Automated astronomical data analysis software and system will be very necessary and useful. In this paper, a data mining application based on PCA (Principal Component Analysis) and LOF (Local Outlier Factor) is explored. Massive spectral data are clustered after dimension reduction by PCA and singular spectra candidates can be found out automatically. Some rare celestial body candidates are found out in massive spectra data that proves out method is feasible.
引用
收藏
页码:2357 / 2363
页数:7
相关论文
共 50 条
  • [41] Research on the Massive Redundant Data Mining Algorithm based on Kernel Clustering and Data Cleaning Technology
    Mao, YaoFeng
    2015 2ND INTERNATIONAL SYMPOSIUM ON ENGINEERING TECHNOLOGY, EDUCATION AND MANAGEMENT (ISETEM 2015), 2015, : 112 - 117
  • [42] Real-time data mining of massive data streams from synoptic sky surveys
    Djorgovski, S. G.
    Graham, M. J.
    Donalek, C.
    Mahabal, A. A.
    Drake, A. J.
    Turmon, M.
    Fuchs, T.
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2016, 59 : 95 - 104
  • [43] Dialectical analysis of spectral data of patients with hepatocellular jaundice through data mining techniques
    Yao Hai-Ying
    Zhu Hui-Shao
    Li Bin
    Liang Chun-Yan
    Zhao Wen-Guang
    Chen Zhao-Xi
    Zhang Yu-Bo
    2013 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE (BIBM), 2013,
  • [44] Local PurTree Spectral Clustering for Massive Customer Transaction Data
    Chen, Xiaojun
    Peng, Si
    Huang, Joshua Zhexue
    Nie, Feiping
    Ming, Yong
    IEEE INTELLIGENT SYSTEMS, 2017, 32 (02) : 37 - 44
  • [45] DATA MINING DATA MINING CONCEPTS AND TECHNIQUES
    Agarwal, Shivam
    2013 INTERNATIONAL CONFERENCE ON MACHINE INTELLIGENCE AND RESEARCH ADVANCEMENT (ICMIRA 2013), 2013, : 203 - 207
  • [46] Rational partitioning of spectral feature space for effective clustering of massive spectral image data
    Ito, Yusei
    Takeichi, Yasuo
    Hino, Hideitsu
    Ono, Kanta
    SCIENTIFIC REPORTS, 2024, 14 (01):
  • [47] An efficient data processing framework for mining the massive trajectory of moving objects
    Zhou, Yuanchun
    Zhang, Yang
    Ge, Yong
    Xue, Zhenghua
    Fu, Yanjie
    Guo, Danhuai
    Shao, Jing
    Zhu, Tiangang
    Wang, Xuezhi
    Li, Jianhui
    COMPUTERS ENVIRONMENT AND URBAN SYSTEMS, 2017, 61 : 129 - 140
  • [48] Research on Parallel Mining Method of Massive Image Data Based on AI
    Jia, Shuang-cheng
    Yang, Feng-ping
    ADVANCED HYBRID INFORMATION PROCESSING, ADHIP 2019, PT II, 2019, 302 : 118 - 127
  • [49] Data-mining massive real-time data in a power plant: challenges, problems and solutions
    陈坚红
    任浩仁
    盛德仁
    李蔚
    Journal of Zhejiang University Science, 2002, (05) : 39 - 43
  • [50] Design of Reliable Mining Algorithm for Massive Moving Image Data Trajectory
    Zeng, Youmei
    Run, Bo
    Djenouri, Youcef
    IEEE ACCESS, 2024, 12 : 29373 - 29384