.png){kind=icon}
返回
PARADE: Passage Representation Aggregation for Document Reranking
.png){kind=icon}
OA
AI
DOI：10.1145/3600088.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Pre-trained transformer models, such as BERT and T5, have shown to be highly effective at ad hoc passage and document ranking. Due to the inherent sequence length limits of these models, they need to process document passages one at a time rather than processing the entire document sequence at once. Although several approaches for aggregating passage-level signals into a document-level relevance score have been proposed, there has yet to be an extensive comparison of these techniques. In this work, we explore strategies for aggregating relevance signals from a document's passages into a final ranking score. We find that passage representation aggregation techniques can significantly improve over score aggregation techniques proposed in prior work, such as taking the maximum passage score. We call this new approach PARADE. In particular, PARADE can significantly improve results on collections with broad information needs where relevance signals can be spread throughout the document (such as TREC Robust04 and GOV2). Meanwhile, less complex aggregation techniquesmaywork better on collections with an information need that can often be pinpointed to a single passage (such as TREC DL and TREC Genomics). We also conduct efficiency analyses and highlight several strategies for improving transformer-based aggregation.
Keyword:
Document reranking
passage representation aggregation
pre-trained language models
期刊
IF:
9.1
论文数:
1.2K
被引数:
4.7K
机构
引用论文
分享收藏Circadian Regulation of Myocardial Sarcomeric Titin-cap (Tcap, Telethonin): Identification of Cardiac Clock-Controlled Genes Using Open Access Bioinformatics Data.png)
PLoS ONEOAAI
PLoS ONEIF0
OAAI分享收藏Mine Sited after Mine Activity: The Brownfields Methodology and Kuzbass Coal Mining CaseResources
OAAI
ResourcesIF0
OAAI分享收藏
查看更多内容