Sciweavers

Share
MM
2004
ACM

LyricAlly: automatic synchronization of acoustic musical signals and textual lyrics

9 years 7 months ago
LyricAlly: automatic synchronization of acoustic musical signals and textual lyrics
We present a prototype that automatically aligns acoustic musical signals with their corresponding textual lyrics, in a manner similar to manually-aligned karaoke. We tackle this problem using a multimodal approach, where the appropriate pairing of audio and text processing helps create a more accurate system. Our audio processing technique uses a combination of top-down and bottomup approaches, combining the strength of low-level audio features and high-level musical knowledge to determine the hierarchical rhythm structure, singing voice and chorus sections in the musical audio. Text processing is also employed to approximate the length of the sung passages using the textual lyrics. Results show an average error of less than one bar for per-line alignment of the lyrics on a test bed of 20 songs (sampled from CD audio and carefully selected for variety). We perform holistic and percomponent testing and analysis and outline steps for further development. Categories and Subject Descript...
Ye Wang, Min-Yen Kan, Tin Lay Nwe, Arun Shenoy, Ju
Added 30 Jun 2010
Updated 30 Jun 2010
Type Conference
Year 2004
Where MM
Authors Ye Wang, Min-Yen Kan, Tin Lay Nwe, Arun Shenoy, Jun Yin
Comments (0)
books