Text Categorization with Knowledge Transfer from Heterogeneous Data Sources

Multi-category classification of short dialogues is a common task performed by humans. When assigning a question to an expert, a customer service operator tries to classify the customer query into one of N different classes for which experts are available. Similarly, questions on the web (for example questions at Yahoo Answers) can be automatically forwarded to a restricted group of people with a specific expertise. Typical questions are short and assume background world knowledge for correct classification. With exponentially increasing amount of knowledge available, with distinct properties (labeled vs unlabeled, structured vs unstructured), no single knowledge-transfer algorithm such as transfer learning, multi-task learning or selftaught learning can be applied universally. In this work we show that bag-of-words classifiers performs poorly on noisy short conversational text snippets. We present an algorithm for leveraging heterogeneous data sources and algorithms with significant ...

• Type: Conference
• Year: 2008
• Where: AAAI
• Authors: Rakesh Gupta, Lev-Arie Ratinov
• Keywords: AAAI 2008, Correct Classification, Heterogeneous Data Sources, Intelligent Agents, Yahoo Answers