Ontology engineering using volunteer labor

12 years 15 days ago
Ontology engineering using volunteer labor
We describe an approach designed to reduce the costs of ontology development through the use of untrained, volunteer knowledge engineers. Results are provided from an experiment in which volunteers were asked to judge the correctness of automatically inferred subsumption relationships in the biomedical domain. The experiment indicated that volunteers can be recruited fairly easily but that their attention is difficult to hold, that most do not understand the subsumption relationship without training, and that incorporating learned estimates of trust into voting systems is beneficial to aggregate performance. Categories and Subject Descriptors H.5.3 [Group and Organization Interfaces]: Collaborative computing, Evaluation/methodology, Web-based interaction. General Terms Design, Economics, Experimentation, Human Factors. Keywords ontology engineering, knowledge acquisition, semantic web
Benjamin M. Good, Mark D. Wilkinson
Added 22 Nov 2009
Updated 22 Nov 2009
Type Conference
Year 2007
Where WWW
Authors Benjamin M. Good, Mark D. Wilkinson
Comments (0)