Return
Efficient Version Space Algorithms for Human-in-the-loop Model Development
DOI:10.1145/3637443.png)
Abstract
En 中文
When active learning (AL) is applied to help users develop a model on a large dataset through interactively presenting data instances for labeling, existing AL techniques often suffer from two main drawbacks: First, to reach high accuracy they may require the user to label hundreds of data instances, which is an onerous task for the user. Second, retrieving the next instance to label from a large dataset can be time-consuming, making it incompatible with the interactive nature of the human exploration process. To address these issues, we introduce a novel version-space-based active learner for kernel classifiers, which possesses strong theoretical guarantees on performance and efficient implementation in time and space. In addition, by leveraging additional insights obtained in the user labeling process, we can factorize the version space to perform active learning in a set of subspaces, which further reduces the user labeling effort. Evaluation results show that our algorithms significantly outperform state-of-the-art version space strategies, as well as a recent factorization-aware algorithm, for model development over large datasets.
Keywords:
Active learning
version space
kernel classifiers
hit-and-run
factorization
Journal
IF:
4.8
Papers:
1.3K
Citations:
4.4K
Organization
Cited Papers
Selection and Characterization of Tau Binding ᴅ-Enantiomeric Peptides with Potential for Therapy of Alzheimer Disease
PLOS ONE
IF0
Petrography, strontium, barium and uranium concentrations, and strontium and uranium isotope ratios in speleothems as palaeoclimatic proxies: Soreq Cave, Israel
The Holocene
IF0
Solution structure of 5-keto-D-fructose: relevance to the specificity of hexose kinases
Biochemistry
IF0
Prevention of Clostridium sordellii Lethal Toxin-Induced Apoptotic Cell Death by Tauroursodeoxycholic Acid
Biochemistry
IF0

