This paper deals with a general framework for inexact forward-backward algorithms aimed at minimizing the sum of an analytic function and a lower semicontinuous, subanalytic, convex term. Such framework relies on an implementable inexactness condition for the computation of the proximal operator, and a linesearch procedure which is possibly performed whenever a variable metric is allowed into the forward-backward step. The main focus of the work is the convergence of the considered scheme without additional convexity assumptions on the objective function. Toward this aim, we employ the recent concept of forward{backward envelope to define a continuously differentiable surrogate function, which coincides with the objective at its stationary points, and satisfies the so-called Kurdyka-Lojasiewicz (KL) property on its domain. We adapt the abstract convergence scheme usually exploited in the KL framework to our inexact forward-backward scheme, and prove the convergence of the iterates to a stationary point of the problem, as well as the convergence rates for the function values. Finally, we show the effectiveness and the flexibility of the proposed framework on a large-scale image restoration test problem.
Convergence of inexact forward-backward algorithms using the forward-backward envelope / Bonettini, S.; Prato, M.; Rebegoldi, S.. - In: SIAM JOURNAL ON OPTIMIZATION. - ISSN 1052-6234. - 30:4(2020), pp. 3069-3097. [10.1137/19M1254155]
Convergence of inexact forward-backward algorithms using the forward-backward envelope
S. Bonettini;M. Prato;S. Rebegoldi
2020
Abstract
This paper deals with a general framework for inexact forward-backward algorithms aimed at minimizing the sum of an analytic function and a lower semicontinuous, subanalytic, convex term. Such framework relies on an implementable inexactness condition for the computation of the proximal operator, and a linesearch procedure which is possibly performed whenever a variable metric is allowed into the forward-backward step. The main focus of the work is the convergence of the considered scheme without additional convexity assumptions on the objective function. Toward this aim, we employ the recent concept of forward{backward envelope to define a continuously differentiable surrogate function, which coincides with the objective at its stationary points, and satisfies the so-called Kurdyka-Lojasiewicz (KL) property on its domain. We adapt the abstract convergence scheme usually exploited in the KL framework to our inexact forward-backward scheme, and prove the convergence of the iterates to a stationary point of the problem, as well as the convergence rates for the function values. Finally, we show the effectiveness and the flexibility of the proposed framework on a large-scale image restoration test problem.Pubblicazioni consigliate
I metadati presenti in IRIS UNIMORE sono rilasciati con licenza Creative Commons CC0 1.0 Universal, mentre i file delle pubblicazioni sono rilasciati con licenza Attribuzione 4.0 Internazionale (CC BY 4.0), salvo diversa indicazione.
In caso di violazione di copyright, contattare Supporto Iris