高级检索

KM2D:舞蹈动作基元符号和音乐语义驱动的舞蹈动画生成方法

KM2D: Method for Generating Dance Animation Driven by Dance Movement Primitives and Musical Semantics

  • 摘要: 舞蹈创作的流畅性与表现力,往往受到音乐节奏和舞蹈动作基元的影响。然而已有方法往往只针对单一影响因素生成舞蹈动作,难以实现多模信息驱动的舞作生成。为了解决上述问题,提出了一种基于舞蹈动作基元与音乐语义驱动的舞蹈生成方法。首先,构造了一个舞蹈数据集,与仅包含音乐和舞蹈类型标注的主流数据集不同,该数据集在已有标注的基础上,增加了更为精细的舞蹈动作基元标注,为风格、音乐和动作基元共同驱动的舞蹈生成提供数据基础;然后,提出了一种基于扩散模型的舞蹈生成网络,通过引入动作基元特征提取模块,能够更好地支持特定动作的创意表达,减少随机生成动作带来的不协调和不可预见性;最后,设计了一组优化的损失函数,通过动作平滑性损失、动作连续性损失和物理合理性损失,保证了舞蹈的流畅性和物理真实感。在不同数据集上的定量实验结果表明,所提方法在足部接触评分等评估指标上的表现优于对比的舞蹈动作生成方法;在定性实验中,展现了舞蹈基元符号或舞蹈风格等因素对实验结果的影响,表明所提方法在生成舞蹈动作时能够有效地控制舞蹈动作及其风格。通过定性和定量评估,验证了本文方法在各项评估指标上均优于现有方法。

     

    Abstract: The fluency and expressiveness of dance creation are often influenced by music rhythm and dance movement primitives. However, the existing methods only focus on a single influencing factor to generate dance movements, and it is difficult to realize multimodal information-driven dance movement generation. In order to solve the above problem, a dance generation method based on dance movement primitives and music semantics is proposed. First, a dance dataset is constructed. Unlike the mainstream dataset which only contains music and dance genre annotations, this dataset adds more fine-grained dance movement primitives on top of the existing annotations, which provides a data basis for dance generation driven by style, music and movement primitives together; Then, a diffusion model-based dance generation network is proposed, which is able to support the creative expression of a specific movement and reduce randomly generated movements through the introduction of the movement primitives feature extraction module. Finally, a set of optimized loss functions is designed to ensure the smoothness and physical realism of the dance through the loss of movement smoothness, the loss of movement continuity and the loss of physical reasonableness. Quantitative experiments on different datasets show that the proposed method outperforms comparative dance movement generation methods in evaluation metrics such as foot contact scores; qualitative experiments demonstrate the influence of factors such as dance primitives symbols or dance styles on the experimental results, which indicate that the proposed method is able to control the dance movements and their styles effectively when generating dance movements. The qualitative and quantitative evaluations show that the proposed method outperforms the existing methods in all evaluation criteria.

     

/

返回文章
返回