arrow
Return

Efficient Version Space Algorithms for Human-in-the-loop Model Development

delete2024-01-12
delete0
delete
OA
AI
L
Luciano Di Palma *
Y
Yanlei Diao
A
Anna Liu
DOI:10.1145/3637443delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
When active learning (AL) is applied to help users develop a model on a large dataset through interactively presenting data instances for labeling, existing AL techniques often suffer from two main drawbacks: First, to reach high accuracy they may require the user to label hundreds of data instances, which is an onerous task for the user. Second, retrieving the next instance to label from a large dataset can be time-consuming, making it incompatible with the interactive nature of the human exploration process. To address these issues, we introduce a novel version-space-based active learner for kernel classifiers, which possesses strong theoretical guarantees on performance and efficient implementation in time and space. In addition, by leveraging additional insights obtained in the user labeling process, we can factorize the version space to perform active learning in a set of subspaces, which further reduces the user labeling effort. Evaluation results show that our algorithms significantly outperform state-of-the-art version space strategies, as well as a recent factorization-aware algorithm, for model development over large datasets.
Keywords:
Active learning
version space
kernel classifiers
hit-and-run
factorization

Journal

ACM Transactions on Knowledge Discovery from Data cover
ACM Transactions on Knowledge Discovery from Data
IF:
4.8
Papers:
1.3K
Citations:
4.4K

Organization

E
Ecole Polytechnique
Scholars:
6.6K
Papers: 4.8K
Citations: 211
I
institut polytechnique de paris
Scholars:
1.3W
Papers: 1.0W
Citations: 6
Cited Papers

Cited Papers

Selection and Characterization of Tau Binding ᴅ-Enantiomeric Peptides with Potential for Therapy of Alzheimer Disease
err2016-12-22
err0
errOAAI
errChristina Dammers; Deniz Yolcu; Laura Kukuk; Dieter Willbold; Marcus Pickhardt; Eckhard Mandelkow; Anselm H. C. Horn; Heinrich Sticht; Marwa Nidal Malhis; Nadja Will; Judith Schuster; Susanne Aileen Funke
errShare
errSave
Solution structure of 5-keto-D-fructose: relevance to the specificity of hexose kinases
err2002-05-01
err0
PREAI
errJohn S. Blanchard; C. F. Brewer; Sasha Englard; Gad Avigad
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
THE IMPACT OF AGRICULTURAL DEVELOPMENT ON KARSTIC GROUNDWATER OF THE SAÏDA MOUNTAINS, ALGERIA
err2019-11-11
err0
errOAAI
errAbdelkader Bentabet; Habib Azzaz; Christophe Emblanch; Benyakhelef Benamina
errShare
errSave
Neuronal Survival after CNS Insult Is Determined by a Genetically Encoded Autoimmune Response
err2001-07-01
err0
errOAAI
errJonathan Kipnis; Eti Yoles; Hadas Schori; Ehud Hauben; Iftach Shaked; Michal Schwartz
errShare
errSave
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
researcher View more