Abstract
Drawing is an art that enables people to express their imagination and emotions. However, individuals usually face challenges in drawing, especially when translating conceptual ideas into visually coherent representations and bridging the gap between mental visualization and practical execution. In response, we propose ARtVista - a novel system integrating AR and generative AI technologies. ARtVista not only recommends reference images aligned with users' abstract ideas and generates sketches for users to draw but also goes beyond, crafting vibrant paintings in various painting styles. ARtVista also offers users an alternative approach to create striking paintings by simulating the paint-by-number concept on reference images, empowering users to create visually stunning artwork devoid of the necessity for advanced drawing skills. We perform a pilot study and reveal positive feedback on its usability, emphasizing its effectiveness in visualizing user ideas and aiding the painting process to achieve stunning pictures without requiring advanced drawing skills. The source code will be available at this https URL.
Abstract (translated)
绘画是一种艺术形式，让人们对想象力和情感进行表达。然而，在绘画过程中，个人通常会面临挑战，尤其是在将概念性想法转化为视觉上连贯的图像，以及将头脑中的想象和实际操作之间建立联系时。为此，我们提出了ArtVista - 一款集成了AR和生成式人工智能技术的全新系统。ArtVista不仅推荐与用户抽象想法相符的参考图像，还为用户生成绘画草图，但还超越了这一点，通过各种绘画风格创作出鲜艳的画作。ArtVista还通过模拟“画数法”概念在参考图像上，让用户在不需要高级绘画技能的情况下，创造出令人惊叹的画作。我们对ArtVista的可用性进行了试点研究，并得到了积极的反馈，强调其在可视化用户想法和帮助绘画过程方面的高效性。源代码将在此处链接提供。
URL
https://arxiv.org/abs/2403.08876
