Abstract
Creating hand-drawn animation sequences is labor-intensive and demands professional expertise. We introduce PhysAnimator, a novel approach for generating physically plausible meanwhile anime-stylized animation from static anime illustrations. Our method seamlessly integrates physics-based simulations with data-driven generative models to produce dynamic and visually compelling animations. To capture the fluidity and exaggeration characteristic of anime, we perform image-space deformable body simulations on extracted mesh geometries. We enhance artistic control by introducing customizable energy strokes and incorporating rigging point support, enabling the creation of tailored animation effects such as wind interactions. Finally, we extract and warp sketches from the simulation sequence, generating a texture-agnostic representation, and employ a sketch-guided video diffusion model to synthesize high-quality animation frames. The resulting animations exhibit temporal consistency and visual plausibility, demonstrating the effectiveness of our method in creating dynamic anime-style animations.
Abstract (translated)
创作手绘动画序列是一项劳动密集型工作，需要专业的技能。我们提出了一种名为PhysAnimator的新方法，可以从静态的动漫插图生成既符合物理原理又具有动漫风格的动画。我们的方法将基于物理的仿真与数据驱动的生成模型无缝结合，以产生动态且视觉上引人注目的动画。 为了捕捉动漫中特有的流畅性和夸张效果，我们在提取出的网格几何体上执行图像空间中的可变形身体模拟。通过引入可以自定义的能量笔触和加入绑定点支持来增强艺术控制，使创作风交互等定制化的动画效果成为可能。 最后，我们从仿真序列中抽取并扭曲草图，生成一种无关纹理的表现形式，并使用引导草图的视频扩散模型合成高质量的动画帧。由此产生的动画在时间上具有一致性和视觉上的真实性，证明了我们的方法在创造动态动漫风格动画方面的有效性。
URL
https://arxiv.org/abs/2501.16550
