Reinforcement learning based metric filtering for evolutionary distance metric learning

被引:2
|
作者
Ali, Bassel [1 ]
Moriyama, Koichi [2 ]
Kalintha, Wasin [1 ]
Numao, Masayuki [3 ]
Fukui, Ken-Ichi [3 ]
机构
[1] Osaka Univ, Grad Sch Informat Sci & Technol, 8-1 Mihogaoka, Osaka 5670047, Japan
[2] Nagoya Inst Technol, Dept Comp Sci, Nagoya, Aichi, Japan
[3] Inst Sci & Ind Res, Osaka, Japan
关键词
Clustering; distance metric learning; feature selection; reinforcement learning;
D O I
10.3233/IDA-194887
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Data collection plays an important role in business agility; data can prove valuable and provide insights for important features. However, conventional data collection methods can be costly and time-consuming. This paper proposes a hybrid system R-EDML that combines a sequential feature selection performed by Reinforcement Learning (RL) with the evolutionary feature prioritization of Evolutionary Distance Metric Learning (EDML) in a clustering process. The goal is to reduce the features while maintaining or increasing the accuracy leading to less time complexity and future data collection time and cost reduction. In this method, features represented by the diagonal elements of EDML matrices are prioritized using a differential evolution algorithm. Further, a selection control strategy using RL is learned by sequentially inserting and evaluating the prioritized elements. The outcome offers the best accuracy R-EDML matrix with the least number of elements. Diagonal R-EDML focusing on the diagonal elements is compared with EDML and conventional feature selection. Full Matrix R-EDML focusing on the diagonal and non-diagonal elements is tested and compared with Information-Theoretic Metric Learning. Moreover, R-EDML policy is tested for each EDML generation and across all generations. Results show a significant decrease in the number of features while maintaining or increasing accuracy.
引用
收藏
页码:1345 / 1364
页数:20
相关论文
共 50 条
  • [31] A SAR Image Recognition Method Based on Distance Metric Learning
    Gao F.
    Zhao J.
    Lin C.
    Chen H.
    Beijing Ligong Daxue Xuebao/Transaction of Beijing Institute of Technology, 2021, 41 (03): : 334 - 340
  • [32] Software defect prediction model based on distance metric learning
    Jin, Cong
    SOFT COMPUTING, 2021, 25 (01) : 447 - 461
  • [33] Kernel-based Distance Metric Learning in the Output Space
    Li, Cong
    Georgiopoulos, Michael
    Anagnostopoulos, Georgios C.
    2013 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2013,
  • [34] Software defect prediction model based on distance metric learning
    Cong Jin
    Soft Computing, 2021, 25 : 447 - 461
  • [35] Research on cardiovascular disease prediction based on distance metric learning
    Ni, Zhuang
    Liu, Kui
    Kang, Guixia
    2ND INTERNATIONAL CONFERENCE ON MACHINE VISION AND INFORMATION TECHNOLOGY (CMVIT 2018), 2018, 1004
  • [36] Distance metric learning for ordinal classification based on triplet constraints
    Bac Nguyen
    Morell, Carlos
    De Baets, Bernard
    KNOWLEDGE-BASED SYSTEMS, 2018, 142 : 17 - 28
  • [37] A Boosting-Based Deep Distance Metric Learning Method
    Li, Zilong
    COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022
  • [38] Fast generalization rates for distance metric learning: Improved theoretical analysis for smooth strongly convex distance metric learning
    Ye, Han-Jia
    Zhan, De-Chuan
    Jiang, Yuan
    MACHINE LEARNING, 2019, 108 (02) : 267 - 295
  • [39] Provably adaptive reinforcement learning in metric spaces
    Cao, Tongyi
    Krishnamurthy, Akshay
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [40] Globality and locality incorporation in distance metric learning
    Wang, Wei
    Hu, Bao-Gang
    Wang, Zeng-Fu
    NEUROCOMPUTING, 2014, 129 : 185 - 198