Revealing Criteria for the Ontology Evaluation Task

Abstract

Ontological concept evaluation is a difficult task. Till now, it is done either by domain expert or a knowledge base (thesaurus, ontology, etc.). In this research, we propose a new evaluation method based on a large web document collection, several context definitions deduced from it and three criteria. It provides a support for either a domain expert or a novice user. Moreover, it facilitates the semantic interpretation of the word clusters and consequently the ontological concept generation. Our contribution is to propose an evaluation framework that does not depend on a gold standard, could be applied to any domain even if expert intervention is not available and provides qualitative and quantitative criteria. Our experiments show how our method assists and facilitates the evaluation task for the domain expert.