Sciweavers

Share
CVPR
2011
IEEE

Exploiting Phonological Constraints for Handshape Inference in ASL Video

7 years 10 months ago
Exploiting Phonological Constraints for Handshape Inference in ASL Video
Handshape is a key linguistic component of signs, and thus, handshape recognition is essential to algorithms for sign language recognition and retrieval. In this work, linguistic constraints on the relationship between start and end handshapes are leveraged to improve handshape recognition accuracy. A Bayesian network formulation is proposed for learning and exploiting these constraints, while taking into consideration inter-signer variations in the production of particular handshapes. A Variational Bayes formulation is employed for supervised learning of the model parameters. A non-rigid image alignment algorithm, which yields improved robustness to variability in handshape appearance, is proposed for computing image observation likelihoods in the model. The resulting handshape inference algorithm is evaluated using a dataset of 1500 lexical signs in American Sign Language (ASL), where each lexical sign is produced by three native ASL signers.
Ashwin Thangali, Stan Sclaroff, Carol Neidle, Joan
Added 20 Aug 2011
Updated 20 Aug 2011
Type Journal
Year 2011
Where CVPR
Authors Ashwin Thangali, Stan Sclaroff, Carol Neidle, Joan Nash
Comments (0)
books