The cross-modality generative model that synthesizes dance from music

Dancing to Music
PyTorch implementation of the cross-modality generative model that synthesizes dance from music.
Paper
Hsin-Ying Lee, Xiaodong Yang, Ming-Yu Liu, Ting-Chun Wang, Yu-Ding Lu, Ming-Hsuan Yang, Jan Kautz
Dancing to Music Neural Information Processing Systems (NeurIPS) 2019
[Paper] [YouTube] [Project] [Blog] [Supp]
Example Videos
- Beat-Matching
1st row: generated dance sequences, 2nd row: music beats, 3rd row: kinematics beats
- Multimodality
Generate various dance sequences with