.png){kind=icon}
Return
Improving Multitask Retrieval by Promoting Task Specialization
.png){kind=icon}
OA
AI
DOI：10.1162/tacl_a_00597.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
In multitask retrieval, a single retriever is trained to retrieve relevant contexts for multiple tasks. Despite its practical appeal, naive multitask retrieval lags behind task-specific retrieval, in which a separate retriever is trained for each task. We show that it is possible to train a multitask retriever that outperforms task-specific retrievers by promoting task specialization. The main ingredients are: (1) a better choice of pretrained model-one that is explicitly optimized for multitasking-along with compatible prompting, and (2) a novel adaptive learning method that encourages each parameter to specialize in a particular task. The resulting multitask retriever is highly performant on the KILT benchmark. Upon analysis, we find that the model indeed learns parameters that are more task-specialized compared to naive multitasking without prompting or adaptive learning.1
Journal
T
IF:
6.9
Papers:
486
Citations:
5.7K
Organization
Cited Papers
.png){kind=icon}
ShareSaveShareSaveShareSavePolarons inπ-conjugated semiconductors: absorption spectroscopy and spin-dependent recombination
PREAI
ShareSave
View more