Continuous Function Structured in Multilayer Perceptron for Global Optimization
Abstract
The gradient information of multilayer perceptron with a linear neuron is modified with functional derivative for the global minimum search benchmarking problems. From this approach, we show that the landscape of the gradient derived from given continuous function using functional derivative can be the MLP-like form with ax+b neurons. In this extent, the suggested algorithm improves the availability of the optimization process to deal all the parameters in the problem set simultaneously. The functionality of this method could be improved through intentionally designed convex function with Kullack-Liebler divergence applied to cost value as well.
- Publication:
-
arXiv e-prints
- Pub Date:
- March 2023
- DOI:
- 10.48550/arXiv.2303.04623
- arXiv:
- arXiv:2303.04623
- Bibcode:
- 2023arXiv230304623K
- Keywords:
-
- Computer Science - Machine Learning;
- Condensed Matter - Disordered Systems and Neural Networks