Bilevel Imaging Learning Problems as Mathematical Programs with Complementarity Constraints: Reformulation and Theory

被引:0
|
作者
De los Reyes, Juan Carlos [1 ]
机构
[1] Escuela Politec Nacl, Res Ctr Math Modeling MODEMAT, Quito, Ecuador
来源
SIAM JOURNAL ON IMAGING SCIENCES | 2023年 / 16卷 / 03期
关键词
bilevel optimization; variational models; machine learning; OPTIMALITY CONDITIONS; OPTIMIZATION;
D O I
10.1137/21M1450744
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We investigate a family of bilevel imaging learning problems where the lower-level instance corre-sponds to a convex variational model involving first-and second-order nonsmooth sparsity-based regularizers. By using geometric properties of the primal-dual reformulation of the lower-level prob-lem and introducing suitable auxiliary variables, we are able to reformulate the original bilevel problems as mathematical programs with complementarity constraints (MPCC). For the latter, we prove tight constraint qualification conditions (MPCC-RCPLD and partial MPCC-LICQ) and derive Mordukhovich (M-) and strong (S-) stationarity conditions. The stationarity systems for the MPCC turn also into stationarity conditions for the original formulation. Second-order suf lcient optimality conditions are derived as well, together with a local uniqueness result for stationary points. The proposed reformulation may be extended to problems in function spaces, leading to MPCC with constraints on the gradient of the state. The MPCC reformulation also leads to the ef lcient use of available large-scale nonlinear programming solvers, as shown in a companion paper, where different imaging applications are studied.
引用
收藏
页码:1655 / 1686
页数:32
相关论文
共 50 条
  • [1] Semismooth Newton method for the lifted reformulation of mathematical programs with complementarity constraints
    A. F. Izmailov
    A. L. Pogosyan
    M. V. Solodov
    [J]. Computational Optimization and Applications, 2012, 51 : 199 - 221
  • [2] Semismooth Newton method for the lifted reformulation of mathematical programs with complementarity constraints
    Izmailov, A. F.
    Pogosyan, A. L.
    Solodov, M. V.
    [J]. COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2012, 51 (01) : 199 - 221
  • [3] On mathematical programs with complementarity constraints
    Outrata, JV
    [J]. OPTIMIZATION METHODS & SOFTWARE, 2000, 14 (1-2): : 117 - 137
  • [4] MATHEMATICAL PROGRAMS WITH CARDINALITY CONSTRAINTS: REFORMULATION BY COMPLEMENTARITY-TYPE CONDITIONS AND A REGULARIZATION METHOD
    Burdakov, Oleg P.
    Kanzow, Christian
    Schwartz, Alexandra
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2016, 26 (01) : 397 - 425
  • [5] On a Reformulation of Mathematical Programs with Cardinality Constraints
    Burdakov, Oleg
    Kanzow, Christian
    Schwartz, Alexandra
    [J]. ADVANCES IN GLOBAL OPTIMIZATION, 2015, 95 : 3 - 14
  • [6] Semismooth SQP method for equality-constrained optimization problems with an application to the lifted reformulation of mathematical programs with complementarity constraints
    Izmailov, A. F.
    Pogosyan, A. L.
    Solodov, M. V.
    [J]. OPTIMIZATION METHODS & SOFTWARE, 2011, 26 (4-5): : 847 - 872
  • [7] Lifting mathematical programs with complementarity constraints
    Stein, Oliver
    [J]. MATHEMATICAL PROGRAMMING, 2012, 131 (1-2) : 71 - 94
  • [8] Lifting mathematical programs with complementarity constraints
    Oliver Stein
    [J]. Mathematical Programming, 2012, 131 : 71 - 94
  • [9] Dependence of bilevel mathematical programs on irrelevant constraints
    Macal, CM
    Hurter, AP
    [J]. COMPUTERS & OPERATIONS RESEARCH, 1997, 24 (12) : 1129 - 1140
  • [10] Dependence of bilevel mathematical programs on irrelevant constraints
    Macal, Charles M.
    Hurter, Arthur P.
    [J]. Computers and Operations Research, 1997, 24 (12): : 1129 - 1140