arrow
Return

Stop filtering: Multi-view attribute-enhanced dialogue learning

delete2023-10-01
delete1
delete
OA
AI
Y
Yiwei Li
孙斌 cover
孙斌 (Bin Sun)
李侃 cover
李侃 (Kan Li) *
DOI:10.1016/j.knosys.2023.110833delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
There is a growing interest in improving the conversational ability of models by filtering dialogue corpora. Previous filtering strategies rely on a scoring method to assess and discard samples from one perspective, enabling the model to enhance the corresponding dialogue attributes (e.g., consistency). However, the discarded samples may achieve high scores in other perspectives and can also provide regularization effects on the model learning. In this work, we propose a multi-view attribute-enhanced dialogue learning framework that can capture the attribute-related features steadily and comprehensively. Instead of filtering the raw dataset, our framework introduces adapters to learn knowledge from the attribute-related sub-sets after pre-training the model on the full dataset. Considering the variety of dialogue attributes, we further design a multi-view enhancement mechanism, including multiview selection and inter-view fusion. It groups the high-quality samples from multiple perspectives, respectively, and enhances different attributes of responses with the corresponding sub-sets and adapters, keeping knowledge independent and allowing flexible integration. Empirical results and analysis show that our framework outperforms the state-of-the-art data filtering methods significantly in terms of enhancing dialogue attributes and fusing view-specific knowledge.& COPY; 2023 Elsevier B.V. All rights reserved.
Keywords:
Open-domain dialogue generation
Data filtering
Dialogue attributes
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

K
Knowledge-Based Systems
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

B
beijing institute of technology
Scholars:
5.5W
Papers: 4.0W
Citations: 63
Cited Papers

Cited Papers

Diabetic neuropathies in brain are induced by deficiency of BDNF
err2002-09-01
err0
PREAI
errA Nitta; R Murai; N Suzuki; H Ito; H Nomoto; G Katoh; Y Furukawa; S Furukawa
errShare
errSave