.png){kind=icon}
.png){kind=icon}
Return
Improving learning by using artificial hints
.png){kind=icon}
PRE
AI
DOI：10.1016/j.neucom.2011.09.020.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
In Multi-Task Learning (MTL), when several related tasks are learned at the same time considering one of them as the main task and the others as secondary ones, there is a transfer of positive information that improves the performance of the main one. However, not only does the difficulty of finding the relationship among different tasks pose a problem in real applications, but also knowing the kind of relationship among them. This paper presents a new method to generate artificial hints (subsets from the original data set) that helps the learning of the main task when all of them are learned simultaneously (as in a MTL scheme). Thus, although these hints cannot be strictly considered as secondary tasks, they will act as guides for the main one. The results obtained with toy and real problems show the advantages of the proposed method. In particular, a faster convergence, a very good performance, and a reduction in the likelihood of being trapped in a local minimum are achieved. (C) 2011 Elsevier B.V. All rights reserved.
Keywords:
Neural networks
Hint
Multi-task learning
Data editing
Inductive bias
Knowledge transfer
Artificial tasks
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.
Journal
IF:
6.5
Papers:
2.5W
Citations:
6.5W