Improved Estimation in Time Varying Models
Abstract
Locally adapted parameterizations of a model (such as locally weighted regression) are expressive but often suffer from high variance. We describe an approach for reducing the variance, based on the idea of estimating simultaneously a transformed space for the model, as well as locally adapted parameterizations in this new space. We present a new problem formulation that captures this idea and illustrate it in the important context of time varying models. We develop an algorithm for learning a set of bases for approximating a time varying sparse network; each learned basis constitutes an archetypal sparse network structure. We also provide an extension for learning task-driven bases. We present empirical results on synthetic data sets, as well as on a BCI EEG classification task.
- Publication:
-
arXiv e-prints
- Pub Date:
- June 2012
- DOI:
- 10.48550/arXiv.1206.6385
- arXiv:
- arXiv:1206.6385
- Bibcode:
- 2012arXiv1206.6385P
- Keywords:
-
- Computer Science - Machine Learning;
- Statistics - Methodology;
- Statistics - Machine Learning
- E-Print:
- Appears in Proceedings of the 29th International Conference on Machine Learning (ICML 2012)