Online Learning in Discrete Hidden Markov Models
Abstract
We present and analyze three different online algorithms for learning in discrete Hidden Markov Models (HMMs) and compare their performance with the Baldi-Chauvin Algorithm. Using the Kullback-Leibler divergence as a measure of the generalization error we draw learning curves in simplified situations and compare the results. The performance for learning drifting concepts of one of the presented algorithms is analyzed and compared with the Baldi-Chauvin algorithm in the same situations. A brief discussion about learning and symmetry breaking based on our results is also presented.
- Publication:
-
Bayesian Inference and Maximum Entropy Methods In Science and Engineering
- Pub Date:
- November 2006
- DOI:
- 10.1063/1.2423274
- arXiv:
- arXiv:0708.2377
- Bibcode:
- 2006AIPC..872..187A
- Keywords:
-
- 02.50.Ga;
- 07.05.Mh;
- Markov processes;
- Neural networks fuzzy logic artificial intelligence;
- Statistics - Machine Learning
- E-Print:
- 8 pages, 6 figures