Quotation Wohlgenannt, Gerhard and Sabou, Marta and Hanika, Florian. 2016. Crowd-based Ontology Engineering with the uComp Protege Plugin. Semantic Web Journal 7 (4), 379-398.




Crowdsourcing techniques have been shown to provide ef- fective means for solving a variety of ontology engineering problems. Yet, they are mainly being used as external means to ontology engi- neering, without being closely integrated into the work of ontology engi- neers. In this paper we investigate how to closely integrate crowdsourcing into ontology engineering practices. Firstly, we show that a set of basic crowdsourcing tasks are used recurrently to solve a range of ontology engineering problems. Secondly, we present the uComp Protege plugin that facilitates the integration of such typical crowdsourcing tasks into ontology engineering work from within the Protege ontology editing en- vironment. An evaluation of the plugin in a typical ontology engineering scenario where ontologies are built from automatically learned semantic structures, shows that its use reduces the working times for the ontology engineers 11 times, lowers the overall task costs with 40% to 83% depend- ing on the crowdsourcing settings used and leads to data quality com- parable with that of tasks performed by ontology engineers. Evaluations on a large ontology from the anatomy domain confirm that crowdsourc- ing is a scalable and effective method: good quality results (accuracy of 89% and 99%) are obtained while achieving cost reductions with 75% from the ontology engineer costs and providing comparable overall task duration.


Press 'enter' for creating the tag

Publication's profile

Status of publication Published
Affiliation WU
Type of publication Journal article
Journal Semantic Web
Citation Index SCI
WU-Journal-Rating new INF-A
Language English
Title Crowd-based Ontology Engineering with the uComp Protege Plugin
Volume 7
Number 4
Year 2016
Page from 379
Page to 398
Reviewed? Y
URL http://www.semantic-web-journal.net/system/files/swj894.pdf
DOI na


uComp (Embedded Human Computation for Knowledge Extraction and Evaluation)
Wohlgenannt, Gerhard (Former researcher)
Hanika, Florian
Sabou, Marta
Institute for Data, Process and Knowledge Management (AE Polleres) (Details)
Research Institute for Computational Methods FI (Details)
Google Scholar: Search