Automatic Sign Dance Synthesis from Gesture-based Sign Language

Automatic Sign Dance Synthesis from Gesture-based Sign Language

Abstract

Automatic dance synthesis has become more and more popular due to the increasing demand in computer games and animations. Existing research generates dance motions without much consideration for the context of the music. In reality, professional dancers make choreography according to the lyrics and music features. In this research, we focus on a particular genre of dance known as sign dance, which combines gesture-based sign language with full body dance motion. We propose a system to automatically generate sign dance from a piece of music and its corresponding sign gesture. The core of the system is a Sign Dance Model trained by multiple regression analysis to represent the correlations between sign dance and sign gesture/music, as well as a set of objective functions to evaluate the quality of the sign dance. Our system can be applied to music visualization, allowing people with hearing difficulties to understand and enjoy music.

Publication

Automatic Sign Dance Synthesis from Gesture-based Sign Language by Pengpeng Hu, Edmond S. L. Ho, Nauman Aslam, Taku Komura and Hubert P. H. Shum in 2021
Proceedings of the 2019 International Conference on Motion, Interactions and Games (MIG)

# Impact factors are artificially designed to facilitate this assignment
## Citation counts are artificially designed to facilitate this assignment
Citation: 3##  

Links and Downloads

Thumbnail Thumbnail Thumbnail Thumbnail Thumbnail Thumbnail Thumbnail Thumbnail
Paper
Thumbnail Thumbnail Thumbnail Thumbnail Thumbnail Thumbnail Thumbnail Thumbnail
Video
Thumbnail
DOI - Publisher's Page

YouTube

Similar Research