Towards a Quantitative, Platform-Independent Analysis of Knowledge Systems

The Halo Pilot, a six-month effort to evaluate the state-ofthe-art in applied Knowledge Representation and Reasoning (KRR) systems, collaboratively developed a taxonomy of failures with the goal of creating a common framework of metrics against which we could measure inter- and intra- system failure characteristics of each of the three Halo knowledge applications. This platform independent taxonomy was designed with the intent of maximizing its coverage of potential failure types; providing the necessary granularity and precision to enable clear categorization of failure types; and providing a productive framework for short and longer term corrective action. Examining the failure analysis and initial empirical use of the taxonomy provides quantitative insights into the strengths and weaknesses of individual systems and raises some issues shared by all three. These results are particularly interesting when considered against the long history of assumed reasons for knowledge system fail...

• Type: Conference
• Year: 2004
• Where: KR
• Authors: Noah S. Friedland, Paul G. Allen, Michael J. Witbrock, Gavin Matthews, Nancy Salay, Pierluigi Miraglia, Jürgen Angele, Steffen Staab, David J. Israel, Vinay K. Chaudhri, Bruce W. Porter, Ken Barker, Peter Clark
• Keywords: Artificial Intelligence, Failure Types, KR 2004, Potential Failure Types, Taxonomy