Higher Criticism for Discriminating Word-Frequency Tables and Testing Authorship
Abstract
We adapt the Higher Criticism (HC) goodness-of-fit test to measure the closeness between word-frequency tables. We apply this measure to authorship attribution challenges, where the goal is to identify the author of a document using other documents whose authorship is known. The method is simple yet performs well without handcrafting and tuning; reporting accuracy at the state of the art level in various current challenges. As an inherent side effect, the HC calculation identifies a subset of discriminating words. In practice, the identified words have low variance across documents belonging to a corpus of homogeneous authorship. We conclude that in comparing the similarity of a new document and a corpus of a single author, HC is mostly affected by words characteristic of the author and is relatively unaffected by topic structure.
- Publication:
-
arXiv e-prints
- Pub Date:
- October 2019
- DOI:
- 10.48550/arXiv.1911.01208
- arXiv:
- arXiv:1911.01208
- Bibcode:
- 2019arXiv191101208K
- Keywords:
-
- Computer Science - Computation and Language;
- Computer Science - Machine Learning;
- Statistics - Computation;
- Statistics - Machine Learning;
- 62G;
- 62P;
- J.5
- E-Print:
- The Annals of Applied Statistics 16, no. 2 (2022): 1236-1252