Comparison of Bagging and Boosting Algorithms on Sample and Feature Weighting

被引：0

作者：

Shirai, Satoshi ^{[1
]}

Kudo, Mineichi ^{[1
]}

Nakamura, Atsuyoshi ^{[1
]}

机构：

[1] Hokkaido Univ, Div Comp Sci, Grad Sch Informat Sci & Technol, Sapporo, Hokkaido 0600814, Japan

来源：

MULTIPLE CLASSIFIER SYSTEMS, PROCEEDINGS | 2009年 / 5519卷

关键词：

RANDOM SUBSPACE METHOD;

D O I：

暂无

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

We compared boosting with bagging in different strengths of learning algorithms for improving the performance of the set of classifiers to be fused. Our experimental results showed that boosting worked much with weak algorithms and bagging, especially feature-based bagging, worked much with strong algorithms. On the basis of these observations we developed a mixed fusion method in which randomly chosen features are used with a standard boosting method. As a result, it was confirmed that the proposed fusion method worked well regardless of learning algorithms.

引用

页码：22 / 31

页数：10

共 50 条

[21] Margin Based Sample Weighting for Stable Feature Selection
Han, Yue
Yu, Lei
WEB-AGE INFORMATION MANAGEMENT, PROCEEDINGS, 2010, 6184 : 680 - 691
[22] Sample weighting based gene feature selection model
1600, Beijing University of Posts and Telecommunications (39):
[23] Instance selection and feature weighting using evolutionary algorithms
Ramirez-Cruz, Jose-Federico
Alarcon-Aquino, Vicente
Fuentes, Olac
Garcia-Banuelos, Luciano
CIC 2006: 15TH INTERNATIONAL CONFERENCE ON COMPUTING, PROCEEDINGS, 2006, : 73 - +
[24] Genetic algorithms for feature selection and weighting, a review and study
Hussein, F
Kharma, N
Ward, R
SIXTH INTERNATIONAL CONFERENCE ON DOCUMENT ANALYSIS AND RECOGNITION, PROCEEDINGS, 2001, : 1240 - 1244
[25] Iterative RELIEF for feature weighting: Algorithms, theories, and applications
Sun, Yijun
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2007, 29 (06) : 1035 - 1051
[26] Comparison of Bagging, Boosting and Stacking Ensembles Applied to Real Estate Appraisal
Graczyk, Magdalena
Lasota, Tadeusz
Trawinski, Bogdan
Trawinski, Krzysztof
INTELLIGENT INFORMATION AND DATABASE SYSTEMS, PT II, PROCEEDINGS, 2010, 5991 : 340 - +
[27] Boosting和Bagging综述
沈学华
周志华
吴建鑫
陈兆乾
计算机工程与应用, 2000, (12) : 31 - 32+40
[28] Bagging and boosting a treebank parser
Henderson, JC
Brill, E
6TH APPLIED NATURAL LANGUAGE PROCESSING CONFERENCE/1ST MEETING OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, PROCEEDINGS OF THE CONFERENCE AND PROCEEDINGS OF THE ANLP-NAACL 2000 STUDENT RESEARCH WORKSHOP, 2000, : A34 - A41
[29] Bagging, boosting and ordinal classification
Hechenbichler, K
Tutz, G
Classification - the Ubiquitous Challenge, 2005, : 145 - 152
[30] Which are best for successful aging prediction? Bagging, boosting, or simple machine learning algorithms?
Mirzaeian, Razieh
Nopour, Raoof
Varzaneh, Zahra Asghari
Shafiee, Mohsen
Shanbehzadeh, Mostafa
Kazemi-Arpanahi, Hadi
BIOMEDICAL ENGINEERING ONLINE, 2023, 22 (01)

← 1 2 3 4 5 →