Abstract
The transformative potential of 3D content creation has been progressively unlocked through advancements in generative models. Recently, intuitive drag editing with geometric changes has attracted significant attention in 2D editing yet remains challenging for 3D scenes. In this paper, we introduce 3DGS-Drag -- a point-based 3D editing framework that provides efficient, intuitive drag manipulation of real 3D scenes. Our approach bridges the gap between deformation-based and 2D-editing-based 3D editing methods, addressing their limitations to geometry-related content editing. We leverage two key innovations: deformation guidance utilizing 3D Gaussian Splatting for consistent geometric modifications and diffusion guidance for content correction and visual quality enhancement. A progressive editing strategy further supports aggressive 3D drag edits. Our method enables a wide range of edits, including motion change, shape adjustment, inpainting, and content extension. Experimental results demonstrate the effectiveness of 3DGS-Drag in various scenes, achieving state-of-the-art performance in geometry-related 3D content editing. Notably, the editing is efficient, taking 10 to 20 minutes on a single RTX 4090 GPU.
Abstract (translated)
三维内容创作的变革潜力通过生成模型的进步逐步被解锁。最近，直观的拖拽编辑结合几何变化在二维编辑中引起了广泛关注，但在三维场景中的实现仍面临挑战。本文介绍了3DGS-Drag——一种基于点的三维编辑框架，它提供了一种高效且直观地操作真实三维场景的方法。我们的方法连接了基于变形和基于二维编辑的三维编辑方式之间的差距，并解决了它们在与几何相关的三维内容编辑方面的局限性。我们利用两个关键创新：使用3D高斯斑点进行一致的几何修改的变形引导，以及用于内容校正和视觉质量增强的扩散引导。一种渐进式编辑策略进一步支持了激进的三维拖拽编辑。我们的方法能够实现一系列编辑操作，包括运动变化、形状调整、纹理修复（inpainting）和内容扩展。实验结果表明，3DGS-Drag在各种场景中表现出色，在与几何相关的三维内容编辑方面达到了最先进的性能水平。值得注意的是，该编辑过程高效快捷，使用单个RTX 4090 GPU时，整个编辑过程仅需10到20分钟。
URL
https://arxiv.org/abs/2601.07963
