Sciweavers

Share
CAIP
2007
Springer

A New Manifold Representation for Visual Speech Recognition

9 years 8 months ago
A New Manifold Representation for Visual Speech Recognition
In this paper, we propose a new manifold representation capable of being applied for visual speech recognition. In this regard, the real time input video data is compressed using Principal Component Analysis (PCA) and the low-dimensional points calculated for each frame define the manifolds. Since the number of frames that from the video sequence is dependent on the word complexity, in order to use these manifolds for visual speech classification it is required to re-sample them into a fixed number of keypoints that are used as input for classification. In this paper two classification schemes, namely the k Nearest Neighbour (kNN) algorithm that is used in conjunction with the twostage PCA and Hidden-Markov-Model (HMM) classifier are evaluated. The classification results for a group of English words indicate that the proposed approach is able to produce accurate classification results.
Dahai Yu, Ovidiu Ghita, Alistair Sutherland, Paul
Added 07 Jun 2010
Updated 07 Jun 2010
Type Conference
Year 2007
Where CAIP
Authors Dahai Yu, Ovidiu Ghita, Alistair Sutherland, Paul F. Whelan
Comments (0)
books