Paper Reading AI Learner

NECromancer: Breathing Life into Skeletons via BVH Animation

2026-02-06 09:52:29
Mingxi Xu, Qi Wang, Zhengyu Wen, Phong Dao Thien, Zhengyu Li, Ning Zhang, Xiaoyu He, Wei Zhao, Kehong Gong, Mingyuan Zhang

Abstract

Motion tokenization is a key component of generalizable motion models, yet most existing approaches are restricted to species-specific skeletons, limiting their applicability across diverse morphologies. We propose NECromancer (NEC), a universal motion tokenizer that operates directly on arbitrary BVH skeletons. NEC consists of three components: (1) an Ontology-aware Skeletal Graph Encoder (OwO) that encodes structural priors from BVH files, including joint semantics, rest-pose offsets, and skeletal topology, into skeletal embeddings; (2) a Topology-Agnostic Tokenizer (TAT) that compresses motion sequences into a universal, topology-invariant discrete representation; and (3) the Unified BVH Universe (UvU), a large-scale dataset aggregating BVH motions across heterogeneous skeletons. Experiments show that NEC achieves high-fidelity reconstruction under substantial compression and effectively disentangles motion from skeletal structure. The resulting token space supports cross-species motion transfer, composition, denoising, generation with token-based models, and text-motion retrieval, establishing a unified framework for motion analysis and synthesis across diverse morphologies. Demo page: this https URL

Abstract (translated)

运动标记化是通用运动模型的关键组成部分,然而现有的大多数方法都局限于特定物种的骨骼结构,从而限制了其在不同形态之间的适用性。为此,我们提出了NECromancer(简称NEC),这是一种能在任意BVH骨骼上直接操作的普适运动标记器。NEC由三个部分组成: 1. **Ontology-aware Skeletal Graph Encoder (OwO)**:这一模块根据来自BVH文件的数据编码结构先验知识到骨骼嵌入中,包括关节语义、静止姿态偏移和骨骼拓扑。 2. **Topology-Agnostic Tokenizer (TAT)**:这个组件将运动序列压缩为一种普遍的、与拓扑无关的离散表示形式。 3. **Unified BVH Universe (UvU)**:这是一个大规模的数据集,它汇集了来自不同形态骨骼的各种BVH动作数据。 实验结果表明,NEC在大幅度压缩的情况下仍能实现高保真度的重建,并且有效地将运动与骨骼结构分离。由此产生的标记空间支持跨物种的动作转移、组合、去噪、基于标记模型生成以及文本-动作检索,为不同形态下动作分析和合成提供了一个统一框架。 演示页面: [此链接](this https URL)

URL

https://arxiv.org/abs/2602.06548

PDF

https://arxiv.org/pdf/2602.06548.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot