Nonsmooth Nonconvex Optimization Methods in Acoustics
Disciplines
Mathematics (75%); Physics, Astronomy (25%)
Keywords
- Nonsmooth Nonconvex Optimization,
- Fractional Programming And Dc Problems,
- Kurdyka-Lojasiewicz property,
- Inertial And Memory Effects,
- Applications To Acoustics,
- Phase Retrieval Algorithms
The most important problems of current interest in the field of acoustic signal processing include the following: compressed sensing a technique that aims to reconstruct a signal from only a few measurements; audio denoise removing noise or other disturbances from a signal; audio inpainting restoring and recovering missing portions in audio signals; system identification estimating the transformation system from the output signal; and phase retrieval to recover a signal from its magnitudes only. These problems share the feature that they can be modelled and formulated as structured nonsmooth nonconvex optimization problems, which means that, in order to solve them, one usually has to minimize a function which in many cases has a complicated expression and it is neither convex nor differentiable. In other words, the function to be minimized has usually not a global minimum, but many local minima and maxima, and it fails to be differentiable, in particular at these local extrema. In practice many approaches apply ad-hoc, smooth or convex methods, ignoring that they are certainly not perfectly fitted, but still reaching successful solutions. In this project we aim at a more holistic approach marrying mathematics and applications. The main aim of this research project is to design numerical algorithms for solving such structured nonsmooth nonconvex optimization problems without heuristic simplifications. The proposed algorithms will be analyzed from the point of view of their convergence properties, accuracy and stability. The applications to audio signal processing problems will help to validate the theoretically founded convergence behavior of the new algorithms, and also provide new understanding and novel approaches for important tasks in acoustics, like the ones mentioned above. The theoretical goals are at the cutting edge of current mathematical research, therefore their application in signal processing will be extremely innovative. The goal of this application-oriented mathematics project, is not only to apply completely novel mathematical results to certain tasks, but also learn from those applications new concepts and properties that are interesting from a purely mathematical point of view.
The most important problems of current interest in the field of acoustic signal processing include the following: compressed sensing a technique that aims to reconstruct a signal from only a few measurements; audio denoise removing noise or other disturbances from a signal; audio inpainting restoring and recovering missing portions in audio signals; system identification estimating the transformation system from the output signal; and phase retrieval to recover a signal from its magnitudes only. These problems share the feature that they can be modelled and formulated as structured nonsmooth nonconvex optimization problems, which means that, in order to solve them, one usually has to minimize a function which in many cases has a complicated expression and it is neither convex nor differentiable. In other words, the function to be minimized has usually not a global minimum, but many local minima and maxima, and it fails to be differentiable, in particular at these local extrema. In practice many approaches apply ad-hoc, smooth or convex methods, ignoring that they are certainly not perfectly fitted, but still reaching successful solutions. In this project we aim at a more holistic approach marrying mathematics and applications. The main aim of this research project is to design numerical algorithms for solving such structured nonsmooth nonconvex optimization problems without heuristic simplifications. The proposed algorithms will be analyzed from the point of view of their convergence properties, accuracy and stability. The applications to audio signal processing problems will help to validate the theoretically founded convergence behavior of the new algorithms, and also provide new understanding and novel approaches for important tasks in acoustics, like the ones mentioned above. The theoretical goals are at the cutting edge of current mathematical research, therefore their application in signal processing will be extremely innovative. The goal of this application-oriented mathematics project, is not only to apply completely novel mathematical results to certain tasks, but also learn from those applications new concepts and properties that are interesting from a purely mathematical point of view.
- Peter Balazs, Österreichische Akademie der Wissenschaften , associated research partner
- Guoyin Li, University of New South Wales - Australia
- Cedric Fevotte, Université de Toulouse - France
- Russell Luke, Georg-August-Universität Göttingen - Germany
- Nathanael Perraudin, ETH Zürich - Switzerland
Research Output
- 135 Citations
- 48 Publications
- 4 Datasets & models
- 2 Disseminations
- 1 Scientific Awards
- 2 Fundings
-
2025
Title On a stochastic differential equation with correction term governed by a monotone and Lipschitz continuous operator DOI 10.3934/eect.2024064 Type Journal Article Author BoÈ› R Journal Evolution Equations and Control Theory -
2025
Title Robust Multicomponent Tracking of Ultrasonic Vocalizations DOI 10.1109/icassp49660.2025.10890025 Type Conference Proceeding Abstract Author Abbasi R Pages 1-5 Link Publication -
2025
Title Fast Convex Optimization via Time Scale and Averaging of the Steepest Descent DOI 10.1287/moor.2023.0186 Type Journal Article Author Attouch H Journal Mathematics of Operations Research Pages 2633-2665 -
2025
Title Fast convex optimization via closed-loop time scaling of gradient dynamics DOI 10.48550/arxiv.2301.00701 Type Preprint Author Attouch H -
2026
Title A full splitting algorithm for structured difference-of-convex programs DOI 10.1016/j.apnum.2026.02.019 Type Journal Article Author Boţ R Journal Applied Numerical Mathematics -
2026
Title Constrained consensus-based optimization and numerical heuristics for the few particle regime DOI 10.1007/s10898-026-01612-x Type Journal Article Author Beddrich J Journal Journal of Global Optimization -
2026
Title Inertial dynamics with vanishing Tikhonov regularization for multiobjective optimization DOI 10.1016/j.jmaa.2025.129940 Type Journal Article Author Boţ R Journal Journal of Mathematical Analysis and Applications -
2026
Title Recovering Nesterov Accelerated Dynamics from Heavy Ball Dynamics via Time Rescaling DOI 10.1137/25m1757903 Type Journal Article Author Attouch H Journal SIAM Journal on Control and Optimization -
2024
Title Trainable signal encoders that are robust against noise DOI 10.3397/in_2024_3089 Type Journal Article Author Balazs P Journal INTER-NOISE and NOISE-CON Congress and Conference Proceedings Link Publication -
2024
Title (Almost) Smooth Sailing: Towards Numerical Stability of Neural Networks Through Differentiable Regularization of the Condition Number DOI 10.48550/arxiv.2410.00169 Type Preprint Author Nenov R Link Publication -
2024
Title Construction of generalized samplets in Banach spaces DOI 10.48550/arxiv.2412.00954 Type Preprint Author Balazs P Link Publication -
2024
Title Fast Krasnoselskii-Mann Method with Overrelaxation and Preconditioners DOI 10.48550/arxiv.2411.18574 Type Preprint Author Boţ R Link Publication -
2024
Title Hold Me Tight: Stable Encoder-Decoder Design for Speech Enhancement DOI 10.21437/interspeech.2024-1622 Type Conference Proceeding Abstract Author Haider D Pages 5013-5017 -
2024
Title Invertibility of ReLU-Layers: A Practical Approach DOI 10.5220/0012951300003837 Type Conference Proceeding Abstract Author Eckert H Pages 423-429 Link Publication -
2025
Title ISAC: An Invertible and Stable Auditory Filter Bank with Customizable Kernels for ML Integration DOI 10.1109/sampta64769.2025.11133523 Type Conference Proceeding Abstract Author Haider D Pages 1-5 -
2025
Title Robust Deconvolution with Parseval Filterbanks DOI 10.1109/sampta64769.2025.11133565 Type Conference Proceeding Abstract Author Nenov R Pages 1-5 -
2025
Title Fast convex optimization via closed-loop time scaling of gradient dynamics DOI 10.1051/cocv/2025076 Type Journal Article Author Attouch H Journal ESAIM: Control, Optimisation and Calculus of Variations Pages 89 Link Publication -
2025
Title Fast Reflected Forward-Backward algorithm: achieving fast convergence rates for convex optimization with linear cone constraints DOI 10.1007/s10915-025-03103-9 Type Journal Article Author Bot R Journal Journal of Scientific Computing Pages 73 Link Publication -
2025
Title Injectivity of ReLU Layers: Tools from Frame Theory DOI 10.1007/s44439-025-00003-6 Type Journal Article Author Haider D Journal Mathematical Foundations of Machine Learning Pages 2 Link Publication -
2025
Title Residual Hybrid Filterbanks DOI 10.1109/ssp64130.2025.11073345 Type Conference Proceeding Abstract Author Lostanlen V Pages 126-130 Link Publication -
2024
Title Instabilities in Convnets for Raw Audio DOI 10.1109/lsp.2024.3386492 Type Journal Article Author Haider D Journal IEEE Signal Processing Letters Pages 1084-1088 Link Publication -
2024
Title On the strong convergence of continuous Newton-like inertial dynamics with Tikhonov regularization for monotone inclusions DOI 10.1016/j.jmaa.2023.127689 Type Journal Article Author Bot R Journal Journal of Mathematical Analysis and Applications Pages 127689 Link Publication -
2024
Title Instabilities in Convnets for Raw Audio DOI 10.48550/arxiv.2309.05855 Type Preprint Author Haider D -
2024
Title Quantitative bounds for unconditional pairs of frames DOI 10.1016/j.jmaa.2023.127874 Type Journal Article Author Balazs P Journal Journal of Mathematical Analysis and Applications Pages 127874 -
2024
Title Fast Optimistic Gradient Descent Ascent (OGDA) method in continuous and discrete time DOI 10.48550/arxiv.2203.10947 Type Preprint Author Bot R -
2022
Title Random Time-varying Filtering with Subsampling Type Conference Proceeding Abstract Author G. Tauböck Conference 24th International Congress on Acoustics - ICA 2022 Pages 186-189 Link Publication -
2022
Title Audio Inpainting Type Conference Proceeding Abstract Author P. Balazs Conference 24th International Congress on Acoustics - ICA 2022 Pages 186-189 Link Publication -
2022
Title Music signal analysis in the Large Time Frequency Analysis Toolbox Type Conference Proceeding Abstract Author C. Hollomey Conference 24th International Congress on Acoustics - ICA 2022 Pages 98-104 Link Publication -
2023
Title A Fast Optimistic Method for Monotone Variational Inequalities DOI 10.48550/arxiv.2307.11281 Type Preprint Author Sedlmayer M -
2023
Title Fast Krasnosel'skii-Mann algorithm with a convergence rate of the fixed point iteration of $o\left(\frac{1}{k}\right)$ DOI 10.48550/arxiv.2206.09462 Type Preprint Author Bot R -
2023
Title Time Rescaling of a Primal-Dual Dynamical System with Asymptotically Vanishing Damping DOI 10.1007/s00245-023-09999-9 Type Journal Article Author Hulett D Journal Applied Mathematics & Optimization Pages 27 Link Publication -
2023
Title Fitting Auditory Filterbanks with Multiresolution Neural Networks DOI 10.1109/waspaa58266.2023.10248131 Type Conference Proceeding Abstract Author Lostanlen V Pages 1-5 Link Publication -
2022
Title A primal-dual splitting algorithm for composite monotone inclusions with minimal lifting DOI 10.48550/arxiv.2202.09665 Type Preprint Author Aragón-Artacho F -
2022
Title A fast continuous time approach with time scaling for nonsmooth convex optimization DOI 10.48550/arxiv.2203.00711 Type Preprint Author Bot R -
2022
Title Capturing the songs of mice with an improved detection and classification method for ultrasonic vocalizations (BootSnap) DOI 10.1371/journal.pcbi.1010049 Type Journal Article Author Abbasi R Journal PLoS Computational Biology Link Publication -
2023
Title Fast convex optimization via time scale and averaging of the steepest descent DOI 10.48550/arxiv.2208.08260 Type Preprint Author Attouch H -
2023
Title Faster Than Fast: Accelerating the Griffin-Lim Algorithm DOI 10.1109/icassp49357.2023.10097224 Type Conference Proceeding Abstract Author Nenov R Pages 1-5 -
2023
Title Double preconditioning for Gabor frame operators: Algebraic, functional analytic and numerical aspects DOI 10.1016/j.acha.2023.04.001 Type Journal Article Author Feichtinger H Journal Applied and Computational Harmonic Analysis Pages 101-137 -
2021
Title Capturing the songs of mice with an improved detection and classification method for ultrasonic vocalizations (BootSnap) DOI 10.1101/2021.05.20.444981 Type Preprint Author Abbasi R Pages 2021.05.20.444981 Link Publication -
2022
Title A fast continuous time approach with time scaling for nonsmooth convex optimization DOI 10.1186/s13662-022-03744-2 Type Journal Article Author Bot R Journal Advances in Continuous and Discrete Models Pages 73 Link Publication -
2022
Title A primal-dual splitting algorithm for composite monotone inclusions with minimal lifting DOI 10.1007/s11075-022-01405-9 Type Journal Article Author Aragón-Artacho F Journal Numerical Algorithms Pages 103-130 Link Publication -
2023
Title Fitting Auditory Filterbanks with Multiresolution Neural Networks DOI 10.48550/arxiv.2307.13821 Type Preprint Author Lostanlen V -
2022
Title Time rescaling of a primal-dual dynamical system with asymptotically vanishing damping DOI 10.48550/arxiv.2209.06438 Type Preprint Author Hulett D -
2023
Title Convex Geometry of ReLU-layers, Injectivity on the Ball and Local Reconstruction DOI 10.48550/arxiv.2307.09672 Type Other Author Haider D Link Publication -
2023
Title Accelerated Griffin-Lim Algorithm: A Fast and Provably Converging Numerical Method for Phase Retrieval DOI 10.1109/tsp.2023.3339232 Type Journal Article Author Nenov R Journal IEEE Transactions on Signal Processing Pages 190-202 -
2023
Title Sampling and Frame Expansions for UWB Signals DOI 10.1109/sampta59647.2023.10301377 Type Conference Proceeding Abstract Author Balazs P Pages 1-5 -
2023
Title Fast Optimistic Gradient Descent Ascent (OGDA) Method in Continuous and Discrete Time DOI 10.1007/s10208-023-09636-5 Type Journal Article Author Bot R Journal Foundations of Computational Mathematics Pages 163-222 Link Publication -
2023
Title Fast Krasnosel’skii–Mann Algorithm with a Convergence Rate of the Fixed Point Iteration of \(\boldsymbol{{ o} \left(\frac{1}{{ k}} \right)}\) DOI 10.1137/22m1504305 Type Journal Article Author Bot R Journal SIAM Journal on Numerical Analysis Pages 2813-2843
-
2026
Link
Title Adaptive DPFS: A Full Splitting Algorithm for Structured DC Programs DOI 10.1016/j.apnum.2026.02.019 Type Computer model/algorithm Public Access Link Link -
2025
Link
Title Robust Deconvolution Framework DOI 10.1109/sampta64769.2025.11133565 Type Computer model/algorithm Public Access Link Link -
2024
Link
Title (Almost) Smooth Sailing: Differentiable Condition Number Regularizer DOI 10.48550/arxiv.2410.00169 Type Computer model/algorithm Public Access Link Link -
2023
Link
Title AGLA: Accelerated Griffin-Lim Algorithm DOI 10.1016/j.sigpro.2023.109156 Type Computer model/algorithm Public Access Link Link
-
2024
Title Colloquium Plenary talk "Frame Theory: the mathematical foundation for acoustics, quantum physics, numerics and machine learning" Type Personally asked as a key note speaker to a conference Level of Recognition National (any country)
-
2021
Title Nonsmooth Nonconvex Optimization Methods in Acoustics Type Other Start of Funding 2021 Funder Austrian Science Fund (FWF) -
2021
Title Smart operation of wind turbines under icing conditions Type Research grant (including intramural programme) Start of Funding 2021 Funder Austrian Research Promotion Agency