Damped inertial dynamics with vanishing Tikhonov regularization: Strong asymptotic convergence towards the minimum norm solution

Affiliation auteurs!!!! Error affiliation !!!!
TitreDamped inertial dynamics with vanishing Tikhonov regularization: Strong asymptotic convergence towards the minimum norm solution
Type de publicationJournal Article
Year of Publication2022
AuteursAttouch H, Balhag A, Chbani Z, Riahi H
JournalJOURNAL OF DIFFERENTIAL EQUATIONS
Volume311
Pagination29-58
Date PublishedFEB 25
Type of ArticleArticle
ISSN0022-0396
Mots-clésAccelerated gradient methods, Convex optimization, Damped inertial dynamics, hierarchical minimization, Nesterov accelerated gradient method, Tikhonov approximation
Résumé

In a Hilbert space, we provide a fast dynamic approach to the hierarchical minimization problem which consists in finding the minimum norm solution of a convex minimization problem. For this, we study the convergence properties of the trajectories generated by a damped inertial dynamic with Tikhonov regularization. When the time goes to infinity, the Tikhonov regularization parameter is supposed to tend towards zero, not too fast, which is a key property to make the trajectories strongly converge towards the minimizer of minimum norm. According to the structure of the heavy ball method for strongly convex functions, the viscous damping coefficient is proportional to the square root of the Tikhonov regularization parameter. Therefore, it also converges to zero, which will ensure rapid convergence of values. Precisely, under a proper tuning of these parameters, based on Lyapunov's analysis, we show that the trajectories strongly converge towards the minimizer of minimum norm, and we provide the convergence rate of the values. We show a trade off between the property of fast convergence of values, and the property of strong convergence towards the minimum norm solution. This study improves several previous works where this type of results was obtained under restrictive hypotheses. (c) 2021 Elsevier Inc. All rights reserved.

DOI10.1016/j.jde.2021.12.005