Stopping Active Learning based on Predicted Change of F Measure for Text Classification
Abstract
During active learning, an effective stopping method allows users to limit the number of annotations, which is cost effective. In this paper, a new stopping method called Predicted Change of F Measure will be introduced that attempts to provide the users an estimate of how much performance of the model is changing at each iteration. This stopping method can be applied with any base learner. This method is useful for reducing the data annotation bottleneck encountered when building text classification systems.
- Publication:
-
arXiv e-prints
- Pub Date:
- January 2019
- DOI:
- 10.48550/arXiv.1901.09118
- arXiv:
- arXiv:1901.09118
- Bibcode:
- 2019arXiv190109118A
- Keywords:
-
- Computer Science - Machine Learning;
- Computer Science - Computation and Language;
- Computer Science - Information Retrieval;
- Statistics - Machine Learning;
- H.3.3;
- I.2.6;
- I.2.7;
- I.5.4
- E-Print:
- 8 pages, 12 tables