Paper Reading AI Learner

Topology-Agnostic Animal Motion Generation from Text Prompt

2025-12-11 07:08:29
Keyi Chen, Mingze Sun, Zhenyu Liu, Zhangquan Chen, Ruqi Huang

Abstract

Motion generation is fundamental to computer animation and widely used across entertainment, robotics, and virtual environments. While recent methods achieve impressive results, most rely on fixed skeletal templates, which prevent them from generalizing to skeletons with different or perturbed topologies. We address the core limitation of current motion generation methods - the combined lack of large-scale heterogeneous animal motion data and unified generative frameworks capable of jointly modeling arbitrary skeletal topologies and textual conditions. To this end, we introduce OmniZoo, a large-scale animal motion dataset spanning 140 species and 32,979 sequences, enriched with multimodal annotations. Building on OmniZoo, we propose a generalized autoregressive motion generation framework capable of producing text-driven motions for arbitrary skeletal topologies. Central to our model is a Topology-aware Skeleton Embedding Module that encodes geometric and structural properties of any skeleton into a shared token space, enabling seamless fusion with textual semantics. Given a text prompt and a target skeleton, our method generates temporally coherent, physically plausible, and semantically aligned motions, and further enables cross-species motion style transfer.

Abstract (translated)

运动生成是计算机动画的基础,并广泛应用于娱乐、机器人技术和虚拟环境等领域。尽管最近的方法取得了令人印象深刻的结果,但大多数方法依赖于固定的骨骼模板,这限制了它们对不同或受到干扰的拓扑结构的适应能力。我们解决了当前运动生成方法的核心局限性——缺乏大规模异构动物运动数据和统一的生成框架,这些框架能够同时建模任意骨骼拓扑和文本条件。为此,我们引入了OmniZoo,这是一个包含140种物种、共32,979个序列的大规模动物运动数据集,并且包含了多模式注释。基于OmniZoo,我们提出了一种通用的自回归运动生成框架,能够为任意骨骼拓扑生成文本驱动的动作。我们的模型核心是一个感知拓扑结构的骨架嵌入模块,该模块将任何骨骼的几何和结构性质编码到共享令牌空间中,从而能够无缝融合文本语义。在给定一个文本提示和目标骨骼后,我们的方法可以生成时间上连贯、物理上合理且语义对齐的动作,并进一步支持跨物种动作风格转换。

URL

https://arxiv.org/abs/2512.10352

PDF

https://arxiv.org/pdf/2512.10352.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot