A two-stage gap safe screening rule for multi-label optimal margin distribution machine

被引:1
|
作者
Ma, Mengdan [1 ]
Xu, Yitian [1 ]
机构
[1] China Agr Univ, Coll Sci, Beijing 100083, Peoples R China
基金
中国国家自然科学基金; 北京市自然科学基金;
关键词
Multi-label learning; Optimal margin distribution; Safe screening; Duality gap;
D O I
10.1016/j.engappai.2022.105653
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Multi-label optimal margin distribution machine (mlODM) is an efficient algorithm for multi-label classifica-tion. Although it can achieve great generalization performance, it is inefficient for large-scale datasets due to the huge number of label pairs. Motivated by its sparse solution, in this paper, we propose a two-stage gap safe screening rule for accelerating mlODM, termed as TSSR. First, a sequential safe screening rule (SSSR) based on gap is designed to screen out part of redundant label pairs prior to training, which reduces the scale of mlODM. Compared with the previous DVI rule, our method ensures absolute safety without destroying efficiency. In the second stage, to further speed up the solving process, a dynamic safe screening rule (DSSR) is embedded into the solving algorithm DCDM when training the simplified mlODM. More importantly, the feasible solution generated in the first stage can promote the efficiency of DSSR. To the best of our knowledge, this is the first attempt to create a hybrid screening rule for multi-label model. Our TSSR can greatly reduce the cost and achieve exactly the same accuracy. Experimental results on seven multi-label benchmark datasets and two real-world learning problems including movie genres classification and hypoglycemic drugs prediction verify the superiority of the proposed methods.
引用
收藏
页数:12
相关论文
共 50 条
  • [41] Multi-class multi-label classification of social media texts for typhoon damage assessment: a two-stage model fully integrating the outputs of the hidden layers of BERT
    Zou, Liwei
    He, Zhi
    Zhou, Chengle
    Zhu, Wenbing
    INTERNATIONAL JOURNAL OF DIGITAL EARTH, 2024, 17 (01)
  • [42] Two-Stage Joint Optimal Scheduling of a Distribution Network With Integrated Energy Systems
    Jiang, Yuhan
    Mei, Fei
    Lu, Jixiang
    Lu, Jinjun
    IEEE ACCESS, 2021, 9 : 12555 - 12566
  • [43] Two-stage method for optimal island partition of distribution system with distributed generations
    Jikeng, L.
    Xudong, W.
    Peng, W.
    Shengwen, L.
    Guang-hui, S.
    Xin, M.
    Xing-wei, X.
    Shanshan, L.
    IET GENERATION TRANSMISSION & DISTRIBUTION, 2012, 6 (03) : 218 - 225
  • [44] A Two-stage Stochastic Programming Model to Determine the Optimal Screening Strategy for Colorectal Cancer
    Young, David
    Cremaschi, Selen
    30TH EUROPEAN SYMPOSIUM ON COMPUTER AIDED PROCESS ENGINEERING, PTS A-C, 2020, 48 : 685 - 690
  • [45] Two-Stage Optimal Scheduling Strategy of Microgrid Distribution Network Considering Multi-Source Agricultural Load Aggregation
    Ma, Guozhen
    Pang, Ning
    Wang, Yunjia
    Hu, Shiyao
    Xu, Xiaobin
    Zhang, Zeya
    Wang, Changhong
    Gao, Liai
    ENERGIES, 2024, 17 (21)
  • [46] Two-stage multi-objective framework for optimal operation of modern distribution network considering demand response program
    Elshenawy, Mohamed R.
    Mohamed, Abdalla
    Ali, A. A.
    Mosa, Magdi A.
    SCIENTIFIC REPORTS, 2025, 15 (01):
  • [47] Two-Stage Approach for the Optimal Power Flow of Photovoltaic-Penetrated Distribution Systems
    Bunaiyan, Amin
    Mancilla-David, Fernando
    2017 NORTH AMERICAN POWER SYMPOSIUM (NAPS), 2017,
  • [48] A two-stage optimal scheduling method for active distribution networks considering uncertainty risk
    Ma, Hengrui
    Liu, Zhe
    Li, Min
    Wang, Bo
    Si, Yang
    Yang, Yan
    Mohamed, Mohamed A.
    ENERGY REPORTS, 2021, 7 : 4633 - 4641
  • [49] Two-Stage Coordinate Optimal Scheduling of Seawater Pumped Storage in Active Distribution Networks
    Liang, Ning
    Deng, Changhong
    Chen, Yahong
    Yao, Weiwei
    Li, Dinglin
    Chen, Man
    Peng, Peng
    SUSTAINABILITY, 2018, 10 (06):
  • [50] A two-stage method for optimal placement of distributed generation units and capacitors in distribution systems
    Mouwafi, Mohamed T.
    El-Sehiemy, Ragab A.
    Abou El-Ela, Adel A.
    APPLIED ENERGY, 2022, 307