Research of assembling optimized classification algorithm by neural network based on Ordinary Least Squares (OLS)

被引:9
|
作者
Xu, Xinzheng [1 ]
Ding, Shifei [1 ,2 ]
Jia, Weikuan [1 ]
Ma, Gang [1 ]
Jin, Fengxiang [3 ]
机构
[1] China Univ Min & Technol, Sch Comp Sci & Technol, Xuzhou 221116, Peoples R China
[2] Chinese Acad Sci, Inst Comp Technol, Key Lab Intelligent Informat Proc, Beijing 100080, Peoples R China
[3] Shandong Univ Sci & Technol, Geomat Coll, Qingdao 266510, Peoples R China
来源
NEURAL COMPUTING & APPLICATIONS | 2013年 / 22卷 / 01期
基金
中国国家自然科学基金;
关键词
Assemble learning; Neural network; Feature dimensionality reduction; Classifier; Ordinary Least Squares (OLS);
D O I
10.1007/s00521-011-0694-3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A new optimized classification algorithm assembled by neural network based on Ordinary Least Squares (OLS) is established here. While recognizing complex high-dimensional data by neural network, the design of network is a challenge. Besides, single network model can hardly get satisfying recognition accuracy. Firstly, feature dimension reduction is carried on so that the design of network is more convenient. Take Elman neural network algorithm based on PCA as sub-classifier I. The recognition precision of this classifier is relatively high, but the convergence rate is not satisfying. Take RBF neural network algorithm based on factor analysis as sub-classifier II. The convergence rate of the classifier algorithm is fast, but the recognition precision is relatively low. In order to make up for the deficiency, by carrying on ensemble learning of the two sub-classifiers and determining optimal weights of each sub-classifier by OLS principle, assembled optimized classification algorithm is obtained, so to some extent, information loss caused by dimensionality reduction in data is made up. In the end, validation of the model can be tested by case analysis.
引用
收藏
页码:187 / 193
页数:7
相关论文
共 50 条
  • [1] Research of assembling optimized classification algorithm by neural network based on Ordinary Least Squares (OLS)
    Xinzheng Xu
    Shifei Ding
    Weikuan Jia
    Gang Ma
    Fengxiang Jin
    [J]. Neural Computing and Applications, 2013, 22 : 187 - 193
  • [2] An Optimized Classification Algorithm by Neural Network Ensemble Based on PLS and OLS
    Jia, Weikuan
    Zhao, Dean
    Tang, Yuyang
    Hu, Chanli
    Zhao, Yuyan
    [J]. MATHEMATICAL PROBLEMS IN ENGINEERING, 2014, 2014
  • [3] An optimized RBF neural network algorithm based on partial least squares and genetic algorithm for classification of small sample
    Jia, Weikuan
    Zhao, Dean
    Ding, Ling
    [J]. APPLIED SOFT COMPUTING, 2016, 48 : 373 - 384
  • [4] A neural network based data least squares algorithm for channel equalization
    Lim, Jun-Seok
    [J]. New Trends in Applied Artificial Intelligence, Proceedings, 2007, 4570 : 582 - 590
  • [5] A Comparison of Partial Least Squares (PLS) and Ordinary Least Squares (OLS) regressions in predicting of couples mental health based on their communicational patterns
    Farahani, Hojjat A.
    Rahiminezhad, Abbas
    Same, Laleh
    Immannezhad, Kobra
    [J]. WCPCG 2010, 2010, 5 : 1459 - 1463
  • [6] Research of Agricultural Land Classification and Evaluation Based on Genetic Algorithm Optimized Neural Network Model
    Liu TingXiang
    Zhang ShuWen
    Wu QuanYuan
    Bao WenDong
    [J]. SOFTWARE ENGINEERING AND KNOWLEDGE ENGINEERING: THEORY AND PRACTICE, VOL 2, 2012, 115 : 465 - +
  • [7] An optimized classification algorithm by BP neural network based on PLS and HCA
    Jia, Weikuan
    Zhao, Dean
    Shen, Tian
    Ding, Shifei
    Zhao, Yuyan
    Hu, Chanli
    [J]. APPLIED INTELLIGENCE, 2015, 43 (01) : 176 - 191
  • [8] An optimized classification algorithm by BP neural network based on PLS and HCA
    Weikuan Jia
    Dean Zhao
    Tian Shen
    Shifei Ding
    Yuyan Zhao
    Chanli Hu
    [J]. Applied Intelligence, 2015, 43 : 176 - 191
  • [9] Response of the ordinary least squares estimator (OLS) to deterministic and stochastic noise.
    Milne, GW
    [J]. AFRICON '96 - 1996 IEEE AFRICON : 4TH AFRICON CONFERENCE IN AFRICA, VOLS I & II: ELECTRICAL ENERGY TECHNOLOGY; COMMUNICATION SYSTEMS; HUMAN RESOURCES, 1996, : 1099 - 1104
  • [10] A Framework for Identifying Essential Proteins with Hybridizing Deep Neural Network and Ordinary Least Squares
    Zou, Sai
    Hu, Yunbin
    Yang, Wenya
    [J]. APPLIED SCIENCES-BASEL, 2023, 13 (15):