Convex optimization via monotone operator theory
Convex optimization via monotone operator theory
Disciplines
Mathematics (100%)
Keywords
-
Convex Optimization,
Monotone Operators,
Regularity Condition,
Monotone Inclusion Problems,
Duality Theory,
Penalty-Type Splitting Methods (Algorithms)
For convex optimization problems, the optimality conditions characterizing the set of optimal solutions can be written in many cases in form of monotone inclusion problems. The present project aims to provide improvements of classical theoretical results and some of their algorithmic realizations in convex nondifferentiable optimization, from the perspective of the monotone operator theory. We propose ourselves to attain three main objectives. The first one concerns the investigation of regularity conditions in convex optimization under the use of generalized interiority notions and based on some new separation results. For many applications the classical regularity conditions are not verified, though we expect to be able to overcome this situation with this new class of conditions, for which the quasi-relative interior plays a central role. In particular, applications to dynamic and market equilibrium problems will be considered. The second main objective of the project refers to the problem of the maximality of the sum of some complex structures in which maximally monotone operators are involved. This problem has a big relevance, for example, in the theory of partial differential equations and in the numerical approximation of the set of zeros of sums of maximally monotone operators, the particularization of the latter delivering corresponding numerical results for convex optimization problems. The connections between convex analysis and monotone operators, which have been in the last years intensively investigated, represent the main tool in this context. The third objective is with respect to the formulation of penalty-type algorithms for solving monotone inclusion problems and the study of their convergence properties. We aim to generalize the existing penalty-type schemes to more general inclusion problems, to establish and improve their convergence rates and to allow in the interative schemes summable erros in order to make them error tolerant. Penalty-type algorithms play an important role in constrained convex optimization, while we are in particular interested in their performances when solving problems arising in image processing.
Due to numerous applications in fields like signal and image processing, portfolio optimization, clusteranalysis, location theory, network communication, machine learning, etc., the design and investigation of numerical algorithms for solving structured convex optimization problems attracted in the last couple of years huge interest from the applied mathematics community. The main contributions of the project are in connection with the solving of highly structured optimization problems and their generalizations to monotone operator inclusions. The nonsmooth (set-valued) objects are evaluated in the algorithm by means of the proximal (resolvent) steps, while the smooth (single-valued) operators are processed through forward evaluations. Following the well-known paradigm that implicite/explicite discretization of first-order differential inclusions/equations leads to proximal/subgradient type algorithms, we investigated the obtained numerical schemes also from the continuous perspective, which allowed a more detailed study of the algorithms.
- Universität Wien - 100%
- Jonathan Borwein, University of Newcastle - Australia
- Heinz Bauschke, University of British Columbia - Canada
- Gert Wanka, Technische Universität Chemnitz - Germany
- Patrick Combettes, North Carolina State University - USA
Research Output
- 313 Citations
- 36 Publications
-
2018
Title A second-order dynamical system with Hessian-driven damping and penalty term associated to variational inequalities DOI 10.1080/02331934.2018.1452922 Type Journal Article Author Bot R Journal Optimization Pages 1265-1277 Link Publication -
2018
Title Inducing strong convergence into the asymptotic behaviour of proximal splitting algorithms in Hilbert spaces DOI 10.1080/10556788.2018.1457151 Type Journal Article Author Bot R Journal Optimization Methods and Software Pages 489-514 Link Publication -
2018
Title Second-order dynamical systems with penalty terms associated to monotone inclusions DOI 10.1142/s0219530518500021 Type Journal Article Author Bot R Journal Analysis and Applications Pages 601-622 Link Publication -
2018
Title A forward-backward dynamical approach to the minimization of the sum of a nonsmooth convex with a smooth nonconvex function? DOI 10.1051/cocv/2017020 Type Journal Article Author Bot R Journal ESAIM: Control, Optimisation and Calculus of Variations Pages 463-477 Link Publication -
2020
Title Fixing and extending some recent results on the ADMM algorithm DOI 10.1007/s11075-020-00934-5 Type Journal Article Author Banert S Journal Numerical Algorithms Pages 1303-1325 Link Publication -
2018
Title Convergence rates for forward–backward dynamical systems associated with strongly monotone inclusions DOI 10.1016/j.jmaa.2016.07.007 Type Journal Article Author Bot R Journal Journal of Mathematical Analysis and Applications Pages 1135-1152 Link Publication -
2016
Title Convergence rates for forward-backward dynamical systems associated with strongly monotone inclusions. Type Journal Article Author Bot Ri -
2016
Title Penalty schemes with inertial effects for monotone inclusion problems DOI 10.1080/02331934.2016.1181759 Type Journal Article Author Bot R Journal Optimization Pages 965-982 Link Publication -
2016
Title Approaching the solving of constrained variational inequalities via penalty term-based dynamical systems DOI 10.1016/j.jmaa.2015.11.032 Type Journal Article Author Bot R Journal Journal of Mathematical Analysis and Applications Pages 1688-1700 Link Publication -
2015
Title Penalty schemes with inertial effects for monotone inclusion problems DOI 10.48550/arxiv.1512.04428 Type Preprint Author Bot R -
2015
Title Second order dynamical systems associated to variational inequalities DOI 10.48550/arxiv.1512.04702 Type Preprint Author Bot R -
0
Title Second order dynamical systems with penalty terms associated to monotone inclusions. Type Other Author Bot Ri -
0
Title Inducing strong convergence into the asymptotic behaviour of proximal splitting algorithms in Hilbert spaces. Type Other Author Bot Ri -
0
Title A second order dynamical system with Hessian-driven damping and penalty term associated to variational inequalities. Type Other Author Bot Ri -
0
Title Fixing and extending some recent results on the ADMM algorithm. Type Other Author Bot Ri -
2016
Title Second Order Forward-Backward Dynamical Systems For Monotone Inclusion Problems DOI 10.1137/15m1012657 Type Journal Article Author Bot¸ R Journal SIAM Journal on Control and Optimization Pages 1423-1443 Link Publication -
2015
Title A Dynamical System Associated with the Fixed Points Set of a Nonexpansive Operator DOI 10.1007/s10884-015-9438-x Type Journal Article Author Bot R Journal Journal of Dynamics and Differential Equations Pages 155-168 -
2017
Title Levenberg-Marquardt Dynamics Associated to Variational Inequalities DOI 10.1007/s11228-017-0409-8 Type Journal Article Author Bot R Journal Set-Valued and Variational Analysis Pages 569-589 Link Publication -
2017
Title Approaching Nonsmooth Nonconvex Optimization Problems Through First Order Dynamical Systems with Hidden Acceleration and Hessian Driven Damping Terms DOI 10.1007/s11228-017-0411-1 Type Journal Article Author Bot R Journal Set-Valued and Variational Analysis Pages 227-245 Link Publication -
2017
Title Gradient-type penalty method with inertial effects for solving constrained convex optimization problems with smooth data DOI 10.1007/s11590-017-1158-1 Type Journal Article Author Bot R Journal Optimization Letters Pages 17-33 Link Publication -
2017
Title Proximal-gradient algorithms for fractional programming DOI 10.1080/02331934.2017.1294592 Type Journal Article Author Bot R Journal Optimization Pages 1383-1396 Link Publication -
2017
Title Second order dynamical systems with penalty terms associated to monotone inclusions DOI 10.48550/arxiv.1701.05246 Type Preprint Author Bot R -
2015
Title A forward-backward dynamical approach to the minimization of the sum of a nonsmooth convex with a smooth nonconvex function DOI 10.48550/arxiv.1507.01416 Type Preprint Author Bot R -
2015
Title Approaching the solving of constrained variational inequalities via penalty term-based dynamical systems DOI 10.48550/arxiv.1503.01871 Type Preprint Author Bot R -
2015
Title Second order forward-backward dynamical systems for monotone inclusion problems DOI 10.48550/arxiv.1503.04652 Type Preprint Author Bot R -
2017
Title Gradient-type penalty method with inertial effects for solving constrained convex optimization problems with smooth data DOI 10.60692/n6byk-9t481 Type Other Author Ernö Robert Csetnek Link Publication -
2017
Title Gradient-type penalty method with inertial effects for solving constrained convex optimization problems with smooth data DOI 10.60692/m5f5s-v1q81 Type Other Author Ernö Robert Csetnek Link Publication -
2015
Title Convergence rates for forward-backward dynamical systems associated with strongly monotone inclusions DOI 10.48550/arxiv.1504.01863 Type Preprint Author Bot R Link Publication -
2016
Title A second order dynamical system with Hessian-driven damping and penalty term associated to variational inequalities DOI 10.48550/arxiv.1608.04137 Type Preprint Author Bot R -
2016
Title Levenberg-Marquardt dynamics associated to variational inequalities DOI 10.48550/arxiv.1603.04460 Type Preprint Author Bot R -
2016
Title Inducing strong convergence into the asymptotic behaviour of proximal splitting algorithms in Hilbert spaces DOI 10.48550/arxiv.1609.01627 Type Preprint Author Bot R -
2016
Title Fixing and extending some recent results on the ADMM algorithm DOI 10.48550/arxiv.1612.05057 Type Preprint Author Banert S -
2016
Title Approaching nonsmooth nonconvex optimization problems through first order dynamical systems with hidden acceleration and Hessian driven damping terms DOI 10.48550/arxiv.1610.00911 Type Preprint Author Bot R -
2016
Title Proximal-gradient algorithms for fractional programming DOI 10.48550/arxiv.1601.08166 Type Preprint Author Bot R -
2016
Title Second-order dynamical systems associated to variational inequalities DOI 10.1080/00036811.2016.1157589 Type Journal Article Author Bot R Journal Applicable Analysis Pages 799-809 Link Publication -
2016
Title Approaching monotone inclusion problems via second order dynamical systems with linear and anisotropic damping DOI 10.1142/9789813142862_0004 Type Conference Proceeding Abstract Author Bott R Pages 53-72