Abstract
This paper presents 3Description, an experimental human-AI collaborative approach for intuitive 3D modeling. 3Description aims to address accessibility and usability challenges in traditional 3D modeling by enabling non-professional individuals to co-create 3D models using verbal and gesture descriptions. Through a combination of qualitative research, product analysis, and user testing, 3Description integrates AI technologies such as Natural Language Processing and Computer Vision, powered by OpenAI and MediaPipe. Recognizing the web has wide cross-platform capabilities, 3Description is web-based, allowing users to describe the desired model and subsequently adjust its components using verbal and gestural inputs. In the era of AI and emerging media, 3Description not only contributes to a more inclusive and user-friendly design process, empowering more people to participate in the construction of the future 3D world, but also strives to increase human engagement in co-creation with AI, thereby avoiding undue surrender to technology and preserving human creativity.
Abstract (translated)
本文介绍了3Description，这是一种实验性的人机协作方法，旨在实现直观的三维建模。3Description致力于解决传统三维建模中的可访问性和易用性问题，让非专业人士能够通过口头和手势描述共同创建三维模型。通过定性研究、产品分析和用户测试相结合的方式，3Description整合了自然语言处理和计算机视觉等AI技术，这些技术由OpenAI和MediaPipe提供支持。鉴于网络具有广泛的跨平台能力，3Description是基于网页的，允许用户使用口头和手势输入描述所需模型并随后调整其组件。 在人工智能和新兴媒体的时代，3Description不仅有助于设计过程更加包容且易于用户操作，使更多的人能够参与到未来三维世界的建设中来，而且还努力增加人在与AI协同创作中的参与度，从而避免对技术的过度依赖，并保持人类创造力。
URL
https://arxiv.org/abs/2506.21845
