Multitask Diffusion Adaptation Over Networks With Common Latent Representations
Abstract
Online learning with streaming data in a distributed and collaborative manner can be useful in a wide range of applications. This topic has been receiving considerable attention in recent years with emphasis on both single-task and multitask scenarios. In single-task adaptation, agents cooperate to track an objective of common interest, while in multitask adaptation agents track multiple objectives simultaneously. Regularization is one useful technique to promote and exploit similarity among tasks in the latter scenario. This work examines an alternative way to model relations among tasks by assuming that they all share a common latent feature representation. As a result, a new multitask learning formulation is presented and algorithms are developed for its solution in a distributed online manner. We present a unified framework to analyze the mean-square-error performance of the adaptive strategies, and conduct simulations to illustrate the theoretical findings and potential applications.
- Publication:
-
IEEE Journal of Selected Topics in Signal Processing
- Pub Date:
- April 2017
- DOI:
- 10.1109/JSTSP.2017.2671789
- arXiv:
- arXiv:1702.03614
- Bibcode:
- 2017ISTSP..11..563C
- Keywords:
-
- Computer Science - Multiagent Systems;
- Statistics - Machine Learning
- E-Print:
- 30 pages, 8 figures, IEEE Journal of Selected Topics in Signal Processing 2017