Starting from the work by Barzilai and Borwein, gradient methods have gained a great amount of attention, and efficient low-cost schemes are available nowadays. The acceleration strategies used by these methods are based on the definition of effective steplength updating rules, which capture spectral properties of the Hessian of the objective function. The methods arising from this idea represent effective computational tools, extremely appealing for a variety of large-scale optimization problems arising in applications. In this work we discuss the spectral properties of some recently proposed gradient methods with the aim of providing insight into their computational effectiveness. Numerical experiments supporting and illustrating the theoretical analysis are provided.

A Note on Spectral Properties of Some Gradient Methods / di Serafino, Daniela; Ruggiero, Valeria; Toraldo, Gerardo; Zanni, Luca. - ELETTRONICO. - 1776:(2016), pp. 040003-040003. (Intervento presentato al convegno 2nd International Conference on Numerical Computations: Theory and Algorithms, NUMTA 2016 tenutosi a Pizzo Calabro nel 19-25 giugno 2016) [10.1063/1.4965315].

A Note on Spectral Properties of Some Gradient Methods

ZANNI, Luca
2016

Abstract

Starting from the work by Barzilai and Borwein, gradient methods have gained a great amount of attention, and efficient low-cost schemes are available nowadays. The acceleration strategies used by these methods are based on the definition of effective steplength updating rules, which capture spectral properties of the Hessian of the objective function. The methods arising from this idea represent effective computational tools, extremely appealing for a variety of large-scale optimization problems arising in applications. In this work we discuss the spectral properties of some recently proposed gradient methods with the aim of providing insight into their computational effectiveness. Numerical experiments supporting and illustrating the theoretical analysis are provided.
2016
2nd International Conference on Numerical Computations: Theory and Algorithms, NUMTA 2016
Pizzo Calabro
19-25 giugno 2016
1776
040003
040003
di Serafino, Daniela; Ruggiero, Valeria; Toraldo, Gerardo; Zanni, Luca
A Note on Spectral Properties of Some Gradient Methods / di Serafino, Daniela; Ruggiero, Valeria; Toraldo, Gerardo; Zanni, Luca. - ELETTRONICO. - 1776:(2016), pp. 040003-040003. (Intervento presentato al convegno 2nd International Conference on Numerical Computations: Theory and Algorithms, NUMTA 2016 tenutosi a Pizzo Calabro nel 19-25 giugno 2016) [10.1063/1.4965315].
File in questo prodotto:
File Dimensione Formato  
GM_spectral_properties_07_16.pdf

Open access

Descrizione: Articolo pricipale
Tipologia: Versione dell'autore revisionata e accettata per la pubblicazione
Dimensione 143.33 kB
Formato Adobe PDF
143.33 kB Adobe PDF Visualizza/Apri
Pubblicazioni consigliate

Licenza Creative Commons
I metadati presenti in IRIS UNIMORE sono rilasciati con licenza Creative Commons CC0 1.0 Universal, mentre i file delle pubblicazioni sono rilasciati con licenza Attribuzione 4.0 Internazionale (CC BY 4.0), salvo diversa indicazione.
In caso di violazione di copyright, contattare Supporto Iris

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11380/1122942
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 2
  • ???jsp.display-item.citation.isi??? 2
social impact