arrow
Return

Crowd-based ontology engineering with the uComp Protege plugin

delete2016-05-27
delete10
delete
OA
AI
G
Gerhard Wohlgenannt *
M
Marta Sabou
F
Florian Hanika
DOI:10.3233/SW-150181delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Crowdsourcing techniques provide effective means for solving a variety of ontology engineering problems. Yet, they are mainly used as external support to ontology engineering, without being closely integrated into the work of ontology engineers. In this paper we investigate how to closely integrate crowdsourcing into ontology engineering practices. Firstly, we show that a set of basic crowdsourcing tasks are used recurrently to solve a range of ontology engineering problems. Secondly, we present the uComp Protege plugin that facilitates the integration of such typical crowdsourcing tasks into ontology engineering from within the Protege ontology editor. An evaluation of the plugin in a typical ontology engineering scenario where ontologies are built from automatically learned semantic structures, shows that its use reduces the working times for the ontology engineers 11 times, lowers the overall task costs by 40% to 83% depending on the crowdsourcing settings used and leads to data quality comparable with that of tasks performed by ontology engineers. Evaluations on a large anatomy ontology confirm that crowdsourcing is a scalable and effective method: good quality results (accuracy of 89% and 99%) are obtained while achieving cost reductions of 75% from the ontology engineer costs and providing comparable overall task duration.
Keywords:
Crowdsourcing
ontology engineering
ontology learning
Protege plugin
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Semantic Web cover
Semantic Web
IF:
2.9
Papers:
606
Citations:
1.6K

Organization

T
Technische Universitat Wien
Scholars:
1.3W
Papers: 1.1W
Citations: 21
V
vienna university of economics & business
Scholars:
1.1K
Papers: 1.4K
Citations: 2