Evolutionary Global Optimization
Evolutionary Global Optimization
Disciplines
Computer Sciences (75%); Mathematics (25%)
Keywords
-
Evolution Strategies,
Global Optimization,
Black-Box Optimization,
Derivative-free Non-linear Optimization,
Evolutionary Computation,
Algorithms Analysis
Finding global optimal solutions to problems in science, technology, and economics is becoming of increasing importance. However, certain optimization problems from fields as diverse as structure prediction in chemistry and material science, machine learning, data-driven portfolio management are often highly multimodal. That is, these problems comprise a vast number of local optimal solutions. Yet, one is interested in searching for the best among these local optima, i.e. the global optimum. For such problems, classical numerical optimization algorithms are not well-suited since these strategies yield usually only local optima. Evolution Strategies - algorithms gleaned from nature - are a promising alternative for solving such challenging problems. However, unlike the practical success in applying such algorithms to real-world problems, the theoretical understanding of the working principles of such evolutionary approaches is still in its infancy. It is a first goal of this project to push forward the theoretical understanding of these algorithms in highly multimodal real-valued fitness landscapes. This will pave the way for a principled design methodology for evolutionary global optimization algorithms. Furthermore, hybrid techniques will be developed to connect classical numerical optimization with evolutionary computation techniques. The findings of these investigations will be used to tackle selected real-world problems taken from the field of structure prediction in chemistry and applications in machine learning.
Finding global optimal solutions to problems in science, technology, and economics is becoming of increasing importance. However, certain optimization problems from fields as diverse as structure prediction in chemistry and material science, machine learning, data-driven portfolio management are often highly multimodal. That is, these problems comprise a vast number of local optimal solutions. Yet, one is interested in searching for the best among these local optima, i.e. the global optimum. For such problems, classical numerical optimization algorithms are not well-suited since these strategies yield usually only local optima. Evolution Strategies - population based algorithms gleaned from Darwinian evolution - are a promising alternative for solving such challenging problems. However, unlike the practical success in applying such algorithms to real-world problems, the theoretical understanding of the working principles of such evolutionary methods in highly multimodal landscapes was in the dark for a long time. In this project we were able to push forward a theory that explains how and why these algorithms perform so well, how to choose the populations in these algorithms in highly multimodal real-valued fitness landscapes, how to perform restarts, and what are the conditions for a global search. These results pave the way for improved and more efficient Evolution Strategies.
- FH Vorarlberg - 100%
- Dirk Arnold, Dalhousie University - Canada
- Marc Schoenauer, Université Paris Sud - France
- Silja Meyer-Nieberg, Universität der Bundeswehr München - Germany
Research Output
- 6 Citations
- 14 Publications
- 1 Scientific Awards
-
2024
Title On the Interaction of Adaptive Population Control with Cumulative Step-Size Adaptation DOI 10.48550/arxiv.2410.00595 Type Preprint Author Beyer H Link Publication -
2024
Title Bias in Standard Self-Adaptive Evolution Strategies DOI 10.1109/cec60901.2024.10612110 Type Conference Proceeding Abstract Author Beyer H Pages 1-8 -
2024
Title Optimal Scaling of an Algorithmic Parameter in Restart Strategies; In: Proceedings - 34. Workshop Computational Intelligence: Berlin, 21.-22. November 2024 Type Book Chapter Author Schönenberger L Publisher KIT Scientific Publishing Pages 193-207 Link Publication -
2024
Title Success Rate of Evolution Strategies on the Multimodal Griewank Function Type Conference Proceeding Abstract Author Beyer Hg Conference 2024 IEEE Congress on Evolutionary Computation (CEC) Link Publication -
2025
Title Optimal Restart Strategies for Parameter-dependent Optimization Algorithms Type Conference Proceeding Abstract Author Beyer Hg Conference 18th ACM/SIGEVO Conference on Foundations of Genetic Algorithms FOGA XVIII -
2025
Title On a Population Sizing Model for Evolution Strategies in Multimodal Landscapes DOI 10.1109/tevc.2024.3419931 Type Journal Article Author Beyer H Journal IEEE Transactions on Evolutionary Computation -
2025
Title Self-Adaptation of Multirecombinant Evolution Strategies on the Highly Multimodal Rastrigin Function DOI 10.1109/tevc.2024.3400857 Type Journal Article Author Beyer H Journal IEEE Transactions on Evolutionary Computation -
2025
Title Convergence Properties of Evolution Strategies on the Multimodal Rastrigin Function Type PhD Thesis Author Omeradzic, Amir Link Publication -
2025
Title Convergence properties of evolution strategies on the multimodal Rastrigin function Type Other Author Omeradzic A Link Publication -
2023
Title Progress analysis of a multi-recombinative evolution strategy on the highly multimodal Rastrigin function. DOI 10.1016/j.tcs.2023.114179 Type Journal Article Author Beyer Hg Journal Theoretical computer science Pages 114179 -
2022
Title Benchmarking ?MAg-ES and BP-?MAg-ES on the bbob-constrained testbed DOI 10.1145/3520304.3534010 Type Conference Proceeding Abstract Author Hellwig M Pages 1717-1724 Link Publication -
2023
Title Convergence Properties of the (/I, )-ES on the Rastrigin Function. DOI 10.1145/3594805.3607126 Type Journal Article Author Beyer Hg Journal Proceedings of the ... ACM SIGEVO Conference on Foundations of Genetic Algorithms. Workshop on Foundations of Genetic Algorithms Pages 117-128 -
2023
Title On a Population Sizing Model for Evolution Strategies Optimizing the Highly Multimodal Rastrigin Function. DOI 10.1145/3583131.3590451 Type Journal Article Author Beyer Hg Journal Genetic and Evolutionary Computation Conference : [proceedings]. Genetic and Evolutionary Computation Conference Pages 848-855 -
2022
Title Progress Rate Analysis of Evolution Strategies on the Rastrigin Function: First Results DOI 10.1007/978-3-031-14721-0_35 Type Book Chapter Author Omeradzic A Publisher Springer Nature Pages 499-511
-
2024
Title Young Author Award Type Poster/abstract prize Level of Recognition Continental/International