Dynamics signature based anomaly detection

被引:2
|
作者
Goenawan, Ivan Hendy [1 ]
Du, Zhihui [2 ]
Wu, Chao [3 ]
Sun, Yankui [1 ]
Wei, Jianyan [3 ]
Bader, David A. [2 ]
机构
[1] Tsinghua Univ, Dept Comp Sci & Technol, Beijing, Peoples R China
[2] New Jersey Inst Technol, Dept Data Sci, Newark, NJ 07102 USA
[3] Chinese Acad Sci, Natl Astron Observ, Beijing 100012, Peoples R China
来源
SOFTWARE-PRACTICE & EXPERIENCE | 2023年 / 53卷 / 01期
基金
美国国家科学基金会; 中国国家自然科学基金;
关键词
anomaly detection; dynamics features; gravitational microlensing; periodic variable stars; time series; PLANET;
D O I
10.1002/spe.3052
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Identifying anomalies, especially weak anomalies in constantly changing targets, is more difficult than in stable targets. In this article, we borrow the dynamics metrics and propose the concept of dynamics signature (DS) in multi-dimensional feature space to efficiently distinguish the abnormal event from the normal behaviors of a variable star. The corresponding dynamics criterion is proposed to check whether a star's current state is an anomaly. Based on the proposed concept of DS, we develop a highly optimized DS algorithm that can automatically detect anomalies from millions of stars' high cadence sky survey data in real-time. Microlensing, which is a typical anomaly in astronomical observation, is used to evaluate the proposed DS algorithm. Two datasets, parameterized sinusoidal dataset containing 262,440 light curves and real variable stars based dataset containing 462,996 light curves are used to evaluate the practical performance of the proposed DS algorithm. Experimental results show that our DS algorithm is highly accurate, sensitive to detecting weak microlensing events at very early stages, and fast enough to process 176,000 stars in less than 1 s on a commodity computer.
引用
收藏
页码:160 / 175
页数:16
相关论文
共 50 条
  • [1] Anomaly detection: A signature.-based approach
    Sy, B
    Chan, HH
    DMIN '05: Proceedings of the 2005 International Conference on Data Mining, 2005, : 193 - 199
  • [2] Fuzzy Clustering Based Anomaly Detection for Updating Intrusion Detection Signature Files
    Padath, Anish Abraham
    Endicott-Popovsky, Barbara
    JOURNAL OF INFORMATION ASSURANCE AND SECURITY, 2011, 6 (06): : 462 - 468
  • [3] Anomaly Detection of Target Dynamics Based on Clustering
    Jian, Zhang
    Qing, Ye
    Ti, Zhou
    2018 15TH INTERNATIONAL SYMPOSIUM ON PERVASIVE SYSTEMS, ALGORITHMS AND NETWORKS (I-SPAN 2018), 2018, : 287 - 291
  • [4] USAID: Unifying signature-based and anomaly-based intrusion detection
    Li, ZW
    Das, A
    Zhou, JY
    ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PROCEEDINGS, 2005, 3518 : 702 - 712
  • [5] Anomaly Detection Based on Profile Signature in Network Using Machine Learning Technique
    Atefi, Kayvan
    Rezaei, Amirali
    Yahya, Saadiah
    Hashim, Siti Hazyanti Binti Mohd
    2016 IEEE REGION 10 SYMPOSIUM (TENSYMP), 2016, : 71 - 76
  • [6] Anomaly Detection Approach to Keystroke Dynamics Based User Authentication
    Ivannikova, Elena
    David, Gil
    Hamalainen, Timo
    2017 IEEE SYMPOSIUM ON COMPUTERS AND COMMUNICATIONS (ISCC), 2017, : 885 - 889
  • [7] A COMPARATIVE STUDY OF HYPERSPECTRAL ANOMALY AND SIGNATURE BASED TARGET DETECTION METHODS FOR OIL SPILLS
    Soydan, Hilal
    Koz, Alper
    Duzgun, H. Sebnem
    Alatan, A. Aydin
    2015 7TH WORKSHOP ON HYPERSPECTRAL IMAGE AND SIGNAL PROCESSING: EVOLUTION IN REMOTE SENSING (WHISPERS), 2015,
  • [8] Anomaly Detection in Web Graphs using Vertex Neighbourhood based Signature Similarity methods
    Ghosh, Aritra
    Gudipati, Pallavi
    PROCEEDINGS OF THE 2016 INTERNATIONAL CONFERENCE ON DATA SCIENCE & ENGINEERING (ICDSE), 2016, : 157 - 162
  • [9] Signature-Based Anomaly Intrusion Detection using Integrated Data Mining Classifiers
    Yassin, Warusia
    Udzir, Nur Izura
    Abdullah, Azizol
    Abdullah, Mohd Taufik
    Zulzalil, Hazura
    Muda, Zaiton
    2014 INTERNATIONAL SYMPOSIUM ON BIOMETRICS AND SECURITY TECHNOLOGIES (ISBAST), 2014, : 232 - 237
  • [10] Hyperspectral anomaly detection using a background endmember signature
    Chang, Hongwei
    Wang, Tao
    Li, Aihua
    Jiang, Yihe
    JOURNAL OF APPLIED REMOTE SENSING, 2020, 14 (04):