A-Optimality Orthogonal Forward Regression Algorithm Using Branch and Bound

被引:2
|
作者
Hong, Xia [1 ]
Chen, Sheng [2 ]
Harris, Chris J. [2 ]
机构
[1] Univ Reading, Sch Syst Engn, Reading RG6 61Y, Berks, England
[2] Univ Southampton, Sch Elect & Comp Sci, Southampton SO17 1BJ, Hants, England
来源
IEEE TRANSACTIONS ON NEURAL NETWORKS | 2008年 / 19卷 / 11期
关键词
Branch and bound (BB); experimental design; forward regression; structure identification;
D O I
10.1109/TNN.2008.2003251
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this brief, we propose an orthogonal forward regression (OFR) algorithm based on the principles of the branch and bound (BB) and A-optimality experimental design. At each forward regression step, each candidate from a pool of candidate regressors, referred to as S, is evaluated in turn with three possible decisions: 1) one of these is selected and included into the model; 2) some of these remain in S for evaluation in the next forward regression step; and 3) the rest are permanently eliminated from S. Based on the BB principle in combination with an A-optimality composite cost function for model structure determination, a simple adaptive diagnostics test is proposed to determine the decision boundary between 2) and 3). As such the proposed algorithm can significantly reduce the computational cost in the A-optimality OFR algorithm. Numerical examples are used to demonstrate the effectiveness of the proposed algorithm.
引用
收藏
页码:1961 / 1967
页数:7
相关论文
共 50 条
  • [21] Nonlinear Identification Using Orthogonal Forward Regression With Nested Optimal Regularization
    Hong, Xia
    Chen, Sheng
    Gao, Junbin
    Harris, Chris J.
    IEEE TRANSACTIONS ON CYBERNETICS, 2015, 45 (12) : 2925 - 2936
  • [22] BRANCH AND BOUND CLUSTERING ALGORITHM
    KOONTZ, WLG
    NARENDRA, PM
    FUKUNAGA, K
    IEEE TRANSACTIONS ON COMPUTERS, 1975, 24 (09) : 908 - 915
  • [23] On the optimality of the Orthogonal Greedy Algorithm for μ-coherent dictionaries
    Livshitz, E. D.
    JOURNAL OF APPROXIMATION THEORY, 2012, 164 (05) : 668 - 681
  • [24] A MULTICRITERIA SCHEDULING TOOL USING A BRANCH-AND-BOUND ALGORITHM
    BAUSCH, R
    EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 1992, 61 (1-2) : 215 - 218
  • [25] Protein tertiary structure prediction using a branch and bound algorithm
    Eyrich, VA
    Standley, DM
    Felts, AK
    Friesner, RA
    PROTEINS-STRUCTURE FUNCTION AND BIOINFORMATICS, 1999, 35 (01) : 41 - 57
  • [26] Identification of nonlinear systems with non-persistent excitation using an iterative forward orthogonal least squares regression algorithm
    Guo, Yuzhu
    Guo, Ling Zhong
    Billings, Stephen A.
    Wei, Hua-Liang
    INTERNATIONAL JOURNAL OF MODELLING IDENTIFICATION AND CONTROL, 2015, 23 (01) : 1 - 7
  • [27] A branch and bound algorithm for the CMST problem
    Han, Jun
    Li, Xian
    Sun, Zhao-Hao
    Lin, Xue-Lian
    Harbin Gongye Daxue Xuebao/Journal of Harbin Institute of Technology, 2007, 39 (09): : 1478 - 1482
  • [28] EVALUATION OF A BRANCH AND BOUND ALGORITHM FOR CLUSTERING
    DIEHR, G
    SIAM JOURNAL ON SCIENTIFIC AND STATISTICAL COMPUTING, 1985, 6 (02): : 268 - 284
  • [29] BRANCH-AND-BOUND ALGORITHM FOR PAGINATION
    DUNCAN, J
    SCOTT, LW
    OPERATIONS RESEARCH, 1975, 23 (02) : 240 - 259
  • [30] PARALLEL ALGORITHM DESIGN FOR BRANCH AND BOUND
    Bader, David A.
    Hart, William E.
    Phillips, Cynthia A.
    TUTORIALS ON EMERGING METHODOLOGIES AND APPLICATIONS IN OPERATIONS RESEARCH, 2005, 76