Unsupervised Pronoun Resolution via Masked Noun-Phrase Prediction
Abstract
In this work, we propose Masked Noun-Phrase Prediction (MNPP), a pre-training strategy to tackle pronoun resolution in a fully unsupervised setting. Firstly, We evaluate our pre-trained model on various pronoun resolution datasets without any finetuning. Our method outperforms all previous unsupervised methods on all datasets by large margins. Secondly, we proceed to a few-shot setting where we finetune our pre-trained model on WinoGrande-S and XS separately. Our method outperforms RoBERTa-large baseline with large margins, meanwhile, achieving a higher AUC score after further finetuning on the remaining three official splits of WinoGrande.
- Publication:
-
arXiv e-prints
- Pub Date:
- May 2021
- DOI:
- 10.48550/arXiv.2105.12392
- arXiv:
- arXiv:2105.12392
- Bibcode:
- 2021arXiv210512392S
- Keywords:
-
- Computer Science - Computation and Language
- E-Print:
- Accepted to ACL2021