Markov Chain Analysis of Evolution Strategies on a Linear Constraint Optimization Problem
Abstract
This paper analyses a $(1,\lambda)$-Evolution Strategy, a randomised comparison-based adaptive search algorithm, on a simple constraint optimisation problem. The algorithm uses resampling to handle the constraint and optimizes a linear function with a linear constraint. Two cases are investigated: first the case where the step-size is constant, and second the case where the step-size is adapted using path length control. We exhibit for each case a Markov chain whose stability analysis would allow us to deduce the divergence of the algorithm depending on its internal parameters. We show divergence at a constant rate when the step-size is constant. We sketch that with step-size adaptation geometric divergence takes place. Our results complement previous studies where stability was assumed.
- Publication:
-
arXiv e-prints
- Pub Date:
- April 2014
- DOI:
- 10.48550/arXiv.1404.3023
- arXiv:
- arXiv:1404.3023
- Bibcode:
- 2014arXiv1404.3023C
- Keywords:
-
- Computer Science - Neural and Evolutionary Computing;
- Mathematics - Optimization and Control
- E-Print:
- Amir Hussain