Data Mining In Massive Spectral Data

被引:0
|
作者
Wang, Wenyu [1 ,2 ]
Wang, Xinjun [1 ]
Jiang, Bin [2 ]
Pan, Jingchang [2 ]
机构
[1] Shandong Univ, Sch Comp Sci & Technol, Jinan 250101, Shandong, Peoples R China
[2] Shandong Univ, Sch Mech Elect & Informat Engn, Weihai 264209, Peoples R China
基金
中国国家自然科学基金;
关键词
PCA; LOF; Data mining; SVM;
D O I
暂无
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
with the astronomical spectra data grows rapidly, it becomes impossible for astronomers to read all the data manually, especially for some sky survey telescopes like SLOAN which will yield immense amounts of data every observational night. Automated astronomical data analysis software and system will be very necessary and useful. In this paper, a data mining application based on PCA (Principal Component Analysis) and LOF (Local Outlier Factor) is explored. Massive spectral data are clustered after dimension reduction by PCA and singular spectra candidates can be found out automatically. Some rare celestial body candidates are found out in massive spectra data that proves out method is feasible.
引用
收藏
页码:2357 / 2363
页数:7
相关论文
共 50 条
  • [31] Data-mining massive time series astronomical data: challenges, problems and solutions
    Ng, MK
    Huang, Z
    INFORMATION AND SOFTWARE TECHNOLOGY, 1999, 41 (09) : 545 - 556
  • [32] An Efficient Framework of Data Mining and its Analytics on Massive Streams of Big Data Repositories
    Disha, D. N.
    Sowmya, B. J.
    Chetan
    Seema, S.
    PROCEEDINGS OF 2016 IEEE INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING, VLSI, ELECTRICAL CIRCUITS AND ROBOTICS (DISCOVER), 2016, : 195 - 200
  • [33] Research on the Opinion Mining System for Massive Social Media Data
    Zhao, Lijun
    Ren, Yingjie
    Wang, Ju
    Meng, Lingsheng
    Zou, Cunlu
    NATURAL LANGUAGE PROCESSING AND CHINESE COMPUTING, NLPCC 2013, 2013, 400 : 424 - 431
  • [34] City Security Level Mining Based on Massive Criminal Data
    Zhu, Sihan
    Wang, Jingyuan
    Wang, Haoji
    Wang, Yao
    2017 IEEE 2ND ADVANCED INFORMATION TECHNOLOGY, ELECTRONIC AND AUTOMATION CONTROL CONFERENCE (IAEAC), 2017, : 751 - 755
  • [35] Application of machine learning in astronomical spectral data mining
    Ting Zhang
    Hailong Zhang
    Yazhou Zhang
    Xu Du
    Wenna Cai
    Han Wu
    Yuyue Jiao
    Wanqiong Wang
    Jie Wang
    Xinchen Ye
    Jia Li
    Astronomical Techniques and Instruments, 2025, 2 (02) : 73 - 87
  • [36] Social Intimacy Based IoT Services Mining of Massive Data
    Zhou, Anni
    Feng, Yinan
    Zhou, Pan
    Xu, Jie
    2017 17TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOPS (ICDMW 2017), 2017, : 641 - 648
  • [37] Mining truck platooning patterns through massive trajectory data
    Ma, Xiaolei
    Huo, Enze
    Yu, Haiyang
    Li, Honghai
    KNOWLEDGE-BASED SYSTEMS, 2021, 221
  • [38] Behavioral Data Mining and Network Analysis in Massive Online Games
    Ahmad, Muhammad Aurangzeb
    Srivastava, Jaideep
    WSDM'14: PROCEEDINGS OF THE 7TH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING, 2014, : 673 - 673
  • [39] A Novel Lightweight Middleware for Distributed Massive PMU Data Mining
    Yi, Jianbo
    Dong, Binbin
    Huang, Qi
    PROCEEDINGS OF THE 2017 2ND INTERNATIONAL CONFERENCE ON ELECTRICAL, CONTROL AND AUTOMATION ENGINEERING (ECAE 2017), 2017, 140 : 290 - 294
  • [40] Spectral features recognition based on data mining algorithms
    Du, Peijun
    Su, Hongjun
    Zhang, Wei
    GEOINFORMATICS 2007: REMOTELY SENSED DATA AND INFORMATION, PTS 1 AND 2, 2007, 6752