Statistical Mechanics of Time-Domain Ensemble Learning

Conventional ensemble learning combines students in the space domain. On the other hand, in this paper, we combine students in the time domain and call it time-domain ensemble learning. We analyze the generalization performance of time-domain ensemble learning in the framework of on-line learning using a statistical mechanical method. We use a model in which both the teacher and the student are linear perceptrons with noises. Time-domain ensemble learning is twice as effective as conventional space-domain ensemble learning.