Document Retrieval by Projection Based Frequency Distribution

In document retrieval task, random projection (RP) is a useful technique of dimension reduction. It can be obtained very quickly yet the recalculation is not necessary to any changes. However, in lower dimension, random projection has instability by randomness in itself. In this investigation, we propose a new technique, called skewed projection (SP) for dimension reduction technique based term frequency distribution. We show that this technique can take advantages of local independency thus we can obtain efficient retrieval for documents which belong to specific application area. Key words Information Retrieval, Vector Space Model, Skewed Projection, Random Projection, Dimension Reduction

• Type: Journal
• Year: 2007
• Where: IJAIT
• Authors: Isamu Shioya, Hirohito Oh'uchi, Takao Miura
• Keywords: Dimension Reduction, Dimension Reduction Technique, IJAIT 2007, Random Projection