Multiplicative nonholonomic/Newton-like algorithm
Abstract
We construct new algorithms, which use the fourth order cumulant of stochastic variables for the cost function. The multiplicative updating rule here constructed is natural from the homogeneous nature of the Lie group and has numerous merits for the rigorous treatment of the dynamics. As one consequence, the second order convergence is shown. For the cost function, functions invariant under the componentwise scaling are chosen. By identifying points which can be transformed to each other by the scaling, we assume that the dynamics is in a coset space. In our method, a point can move toward any direction in this coset. Thus, no prewhitening is required.
- Publication:
-
Chaos Solitons and Fractals
- Pub Date:
- January 2001
- DOI:
- 10.1016/S0960-0779(00)00077-1
- arXiv:
- arXiv:cs/0002006
- Bibcode:
- 2001CSF....12..785A
- Keywords:
-
- Computer Science - Machine Learning;
- G.1.6
- E-Print:
- 12 pages