Investigating the Successes and Failures of BERT for Passage Re-Ranking
Abstract
The bidirectional encoder representations from transformers (BERT) model has recently advanced the state-of-the-art in passage re-ranking. In this paper, we analyze the results produced by a fine-tuned BERT model to better understand the reasons behind such substantial improvements. To this aim, we focus on the MS MARCO passage re-ranking dataset and provide potential reasons for the successes and failures of BERT for retrieval. In more detail, we empirically study a set of hypotheses and provide additional analysis to explain the successful performance of BERT.
- Publication:
-
arXiv e-prints
- Pub Date:
- May 2019
- DOI:
- 10.48550/arXiv.1905.01758
- arXiv:
- arXiv:1905.01758
- Bibcode:
- 2019arXiv190501758P
- Keywords:
-
- Computer Science - Information Retrieval;
- Computer Science - Computation and Language