Inexact proximal Newton methods for self-concordant functions
Author(s) -
Jinchao Li,
Martin S. Andersen,
Lieven Vandenberghe
Publication year - 2016
Publication title -
mathematical methods of operations research
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.524
H-Index - 48
eISSN - 1432-5217
pISSN - 1432-2994
DOI - 10.1007/s00186-016-0566-9
Subject(s) - hessian matrix , proximal gradient methods , newton's method , mathematics , mathematical optimization , convergence (economics) , newton's method in optimization , algorithm , covariance matrix , positive definite matrix , covariance , matrix (chemical analysis) , computer science , function (biology) , operator (biology) , inverse , convex function , regular polygon , local convergence , eigenvalues and eigenvectors , iterative method , quantum mechanics , physics , nonlinear system , materials science , repressor , economic growth , chemistry , composite material , biology , biochemistry , geometry , evolutionary biology , transcription factor , statistics , economics , gene
We analyze the proximal Newton method for minimizing a sum of a self-concordant function and a convex function with an inexpensive proximal operator. We present new results on the global and local convergence of the method when inexact search directions are used. The method is illustrated with an application to L1-regularized covariance selection, in which prior constraints on the sparsity pattern of the inverse covariance matrix are imposed. In the numerical experiments the proximal Newton steps are computed by an accelerated proximal gradient method, and multifrontal algorithms for positive definite matrices with chordal sparsity patterns are used to evaluate gradients and matrix-vector products with the Hessian of the smooth component of the objective.
Accelerating Research
Robert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom
Address
John Eccles HouseRobert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom