Abstract
With the advancement of conversational AI, research on bodily expressions, including gestures and facial expressions, has also progressed. However, many existing studies focus on photorealistic avatars, making them unsuitable for non-photorealistic characters, such as those found in anime. This study proposes methods for expressing emotions, including exaggerated expressions unique to non-photorealistic characters, by utilizing expression data extracted from comics and dialogue-specific semantic gestures. A user study demonstrated significant improvements across multiple aspects when compared to existing research.
Abstract (translated)
随着对话人工智能的进步，关于身体语言的研究，包括手势和面部表情，也得到了发展。然而，许多现有的研究主要集中在拟真的虚拟角色上，这使得这些方法不适用于非写实风格的角色，比如动画中的角色。本研究提出了一种利用从漫画中提取的表情数据以及特定于对话的语义手势来表达情感的方法，包括非写实角色特有的夸张表情。一项用户研究表明，在多个方面相比现有研究成果都有显著改进。
URL
https://arxiv.org/abs/2506.16159
