Abstract
Gestures are an expressive input modality for controlling multiple robots, but their use is often limited by rigid mappings and recognition constraints. To move beyond these limitations, we propose roleplaying metaphors as a scaffold for designing richer interactions. By introducing three roles: Director, Puppeteer, and Wizard, we demonstrate how narrative framing can guide the creation of diverse gesture sets and interaction styles. These roles enable a variety of scenarios, showing how roleplay can unlock new possibilities for multi-robot systems. Our approach emphasizes creativity, expressiveness, and intuitiveness as key elements for future human-robot interaction design.
Abstract (translated)
手势是一种用于控制多台机器人的表达性输入方式，但其使用通常受到固定映射和识别限制的约束。为了超越这些局限，我们提出采用角色扮演隐喻作为设计更丰富交互体验的基础框架。通过引入三个角色：导演、木偶师和巫师，我们展示了叙事构架如何指导多样手势集及互动风格的设计与创造。这些角色能够支持多种应用场景，并展示出角色扮演如何为多机器人系统解锁新的可能性。我们的方法强调创造性、表达性和直观性作为未来人机交互设计的关键要素。
URL
https://arxiv.org/abs/2508.01736
