arrow
Return

Inductive transfer with context-sensitive neural networks

delete2008-10-21
delete40
delete
OA
AI
D
Daniel Silver *
R
Ryan Poirier
D
Duane Currie
DOI:10.1007/s10994-008-5088-0delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Context-sensitive Multiple Task Learning, or csMTL, is presented as a method of inductive transfer which uses a single output neural network and additional contextual inputs for learning multiple tasks. Motivated by problems with the application of MTL networks to machine lifelong learning systems, csMTL encoding of multiple task examples was developed and found to improve predictive performance. As evidence, the csMTL method is tested on seven task domains and shown to produce hypotheses for primary tasks that are often better than standard MTL hypotheses when learning in the presence of related and unrelated tasks. We argue that the reason for this performance improvement is a reduction in the number of effective free parameters in the csMTL network brought about by the shared output node and weight update constraints due to the context inputs. An examination of IDT and SVM models developed from csMTL encoded data provides initial evidence that this improvement is not shared across all machine learning models.
Keywords:
Inductive transfer
Artificial neural networks
Context-sensitive learning
Context attributes
Task relatedness
Machine lifelong learning

Journal

Machine Learning cover
Machine Learning
IF:
2.9
Papers:
2.7K
Citations:
3.4W

Organization

Acadia University cover
Acadia University
Scholars:
794
Papers: 801
Citations: 1.1K
Cited Papers

Cited Papers

Analysis of incidental focal hypermetabolic uptake in the breast as detected by 18F-FDG PET/CT: clinical significance and differential diagnosis
err2012-06-01
err0
PREAI
errEun Young Chae; Joo Hee Cha; Hak Hee Kim; Hee Jung Shin; Hyun Ji Kim; Ha Yeun Oh; Young Hwan Koh; Dae Hyuk Moon
errShare
errSave
Multitask learning
err1997-01-01
err4.9K
errOAAI
errCaruana, R
errShare
errSave
errShare
errSave
researcher View more