arrow
返回

Dynamic curriculum learning for conversation response selection

delete2024-06-01
delete0
PRE
AI
G
Guanhua Chen
D
Derek F. Wong *
L
Lidia S. Chao
DOI:10.1016/j.knosys.2024.111687delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Curriculum learning (CL) has demonstrated its potential to fine-tune pre -trained models for the response selection task. However, existing CL works exhibit a significant reliance on fixed data buckets and a preordained learning schedule. This paper seeks to transcend these constraints by proposing a novel dynamic curriculum learning (DCL) algorithm that employs: (1) a new difficulty measurement that amalgamates linguistic features with model confidence, and (2) an automatic uncertainty -based learning scheduler with a dynamic data sampling policy. This unique approach enables the model to autonomously assemble rational data batches and adjust the curriculum stage by itself. Empirical experiments show that our DCL method reveals its superior performance over three strong baselines and the competitive method on three multi -turn dialogue datasets. The in-depth analysis demonstrates our approach dynamically adapts the CL process, which in turn makes effective use of existing data and alleviates data scarcity.
Keyword:
Response selection
Curriculum learning
Dynamic learning

期刊

K
Knowledge-Based Systems
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

U
University of Macau
学者数:
1.1W
论文数: 1.3W
被引数: 2.0W
引用论文

引用论文

Response selection from unstructured documents for human-computer conversation systems
err2018-02-01
err11
PREAI
errYan, Zhao; Duan, Nan; Bao, Junwei; Chen, Peng; Zhou, Ming; Li, Zhoujun
err分享
err收藏
err分享
err收藏
Response selection with topic clues for retrieval-based chatbots
err2018-11-01
err42
errOAAI
errWu, Yu; Li, Zhoujun; Wu, Wei; Zhou, Ming
err分享
err收藏
Connecting model species to nature: predator-induced long-term sensitization in Aplysia californica
err2014-07-15
err0
errOAAI
errMaria J. Mason; Amanda J. Watkins; Jordann Wakabayashi; Jennifer Buechler; Christine Pepino; Michelle Brown; William G. Wright
err分享
err收藏
err分享
err收藏
Long‐term changes in the floristic composition and soil characteristics of reclaimed sodic land during eco‐restoration
err2011-02-07
err0
PREAI
errPankaj Kumar Srivastava; Baleshwar; Soumit Kumar Behera; Nandita Singh; Radhey Shyam Tripathi
err分享
err收藏
Exploring Dense Retrieval for Dialogue Response Selection
err2024-01-22
err0
errOAAI
errLan, Tian; Cai, Deng; Wang, Yan; Su, Yixuan; Huang, Heyan; Mao, Xian-Ling
err分享
err收藏
学者 查看更多内容