A-Optimality Orthogonal Forward Regression Algorithm Using Branch and Bound

被引:2
|
作者
Hong, Xia [1 ]
Chen, Sheng [2 ]
Harris, Chris J. [2 ]
机构
[1] Univ Reading, Sch Syst Engn, Reading RG6 61Y, Berks, England
[2] Univ Southampton, Sch Elect & Comp Sci, Southampton SO17 1BJ, Hants, England
来源
IEEE TRANSACTIONS ON NEURAL NETWORKS | 2008年 / 19卷 / 11期
关键词
Branch and bound (BB); experimental design; forward regression; structure identification;
D O I
10.1109/TNN.2008.2003251
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this brief, we propose an orthogonal forward regression (OFR) algorithm based on the principles of the branch and bound (BB) and A-optimality experimental design. At each forward regression step, each candidate from a pool of candidate regressors, referred to as S, is evaluated in turn with three possible decisions: 1) one of these is selected and included into the model; 2) some of these remain in S for evaluation in the next forward regression step; and 3) the rest are permanently eliminated from S. Based on the BB principle in combination with an A-optimality composite cost function for model structure determination, a simple adaptive diagnostics test is proposed to determine the decision boundary between 2) and 3). As such the proposed algorithm can significantly reduce the computational cost in the A-optimality OFR algorithm. Numerical examples are used to demonstrate the effectiveness of the proposed algorithm.
引用
收藏
页码:1961 / 1967
页数:7
相关论文
共 50 条
  • [1] A-OPTIMALITY FOR REGRESSION DESIGNS
    CHAN, NN
    JOURNAL OF MATHEMATICAL ANALYSIS AND APPLICATIONS, 1982, 87 (01) : 45 - 50
  • [2] An iterative orthogonal forward regression algorithm
    Guo, Yuzhu
    Guo, L. Z.
    Billings, S. A.
    Wei, Hua-Liang
    INTERNATIONAL JOURNAL OF SYSTEMS SCIENCE, 2015, 46 (05) : 776 - 789
  • [3] An extended orthogonal forward regression algorithm for system identification using entropy
    Guo, L. Z.
    Billings, S. A.
    Zhu, D. Q.
    INTERNATIONAL JOURNAL OF CONTROL, 2008, 81 (04) : 690 - 699
  • [4] M-estimator, and D-optimality model construction using orthogonal forward regression
    Hong, X
    Chen, S
    IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2005, 35 (01): : 155 - 162
  • [5] An efficient branch-and-bound algorithm for compute-and-forward
    Richter, Johannes
    Scheunert, Christian
    Jorswieck, Eduard
    2012 IEEE 23RD INTERNATIONAL SYMPOSIUM ON PERSONAL INDOOR AND MOBILE RADIO COMMUNICATIONS (PIMRC), 2012, : 77 - 82
  • [6] Sparse model identification using a forward orthogonal regression algorithm aided by mutual information
    Billings, Stephen A.
    Wei, Hua-Liang
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 2007, 18 (01): : 306 - 310
  • [7] A branch-and-bound algorithm for instrumental variable quantile regression
    Xu G.
    Burer S.
    Mathematical Programming Computation, 2017, 9 (4) : 471 - 497
  • [8] Optimality Condition and Branch and Bound Algorithm for Constrained Redundancy Optimization in Series Systems
    Xiaoling L. Sun
    Duan Li
    Optimization and Engineering, 2002, 3 : 53 - 65
  • [9] Optimality Condition and Branch and Bound Algorithm for Constrained Redundancy Optimization in Series Systems
    Sun, Xiaoling
    Li, Duan
    OPTIMIZATION AND ENGINEERING, 2002, 3 (01) : 53 - 65
  • [10] Kernel density construction using orthogonal forward regression
    Chen, S
    Hong, X
    Harris, CJ
    INTELLIGENT DATA ENGINEERING AND AUTOMATED LEARNING IDEAL 2004, PROCEEDINGS, 2004, 3177 : 586 - 592