Abstract
Gestures are central to human communication, enriching interactions through non-verbal expression. Virtual avatars increasingly use AI-generated gestures to enhance life-likeness, yet evaluations have largely been confined to 2D. Virtual Reality (VR) provides an immersive alternative that may affect how gestures are perceived. This paper presents a comparative evaluation of computer-generated gestures in VR and 2D, examining three models from the 2023 GENEA Challenge. Results show that gestures viewed in VR were rated slightly higher on average, with the strongest effect observed for motion-capture "true movement." While model rankings remained consistent across settings, VR influenced participants' overall perception and offered unique benefits over traditional 2D evaluation.
Abstract (translated)
手势在人类交流中至关重要，通过非言语表达丰富了互动体验。虚拟化身越来越多地使用AI生成的手势来增强其逼真度，但评估工作大多局限于二维空间内进行。虚拟现实（VR）提供了一种沉浸式的替代方案，可能会影响人们对手势的感知方式。本文呈现了一个关于计算机生成的手势在VR和2D环境中的比较性评价研究，考察了来自2023年GENEA挑战赛的三种模型。结果显示，在VR中观看的手势总体评分略高一些，尤其是对于基于动作捕捉技术的“真实运动”效果最为明显。虽然不同模型在各个设置下的排名保持一致，但VR环境对参与者整体感知的影响独特，并且提供了传统二维评估所不具备的优势。
URL
https://arxiv.org/abs/2509.12816
