Abstract
This paper addresses the task of 3D clothed human generation from textural descriptions. Previous works usually encode the human body and clothes as a holistic model and generate the whole model in a single-stage optimization, which makes them struggle for clothing editing and meanwhile lose fine-grained control over the whole generation process. To solve this, we propose a layer-wise clothed human representation combined with a progressive optimization strategy, which produces clothing-disentangled 3D human models while providing control capacity for the generation process. The basic idea is progressively generating a minimal-clothed human body and layer-wise clothes. During clothing generation, a novel stratified compositional rendering method is proposed to fuse multi-layer human models, and a new loss function is utilized to help decouple the clothing model from the human body. The proposed method achieves high-quality disentanglement, which thereby provides an effective way for 3D garment generation. Extensive experiments demonstrate that our approach achieves state-of-the-art 3D clothed human generation while also supporting cloth editing applications such as virtual try-on. Project page: this http URL
Abstract (translated)
本文讨论了从文本描述中生成3D带衣服的人的任务。以前的工作通常将人体和衣服编码为一个整体模型，并在一个阶段优化中生成整个模型，这使得他们在衣物编辑方面挣扎，同时失去了对整个生成过程的细粒度控制。为了解决这个问题，我们提出了一个逐层的带衣服的人表示与渐进优化策略相结合的方法，从而在生成过程中实现衣物分离的3D人体模型，并提供了对生成过程的控制能力。基本思路是逐步生成最小带衣服的人体和逐层生成衣服。在服装生成过程中，我们提出了一种新的分层组合渲染方法来融合多层人体模型，并使用新的损失函数帮助解耦服装模型与人体。所提出的方法实现了高质量的分离，从而为3D服装生成提供了一种有效的方法。大量的实验证明，我们的方法在实现最先进的3D带衣服的人生成的同时，还支持虚拟试穿等衣物编辑应用。项目页面：http:// this http URL
URL
https://arxiv.org/abs/2404.16748
