Paper Reading AI Learner

Thinking Like Van Gogh: Structure-Aware Style Transfer via Flow-Guided 3D Gaussian Splatting

2026-01-15 05:00:02
Zhendong Wang, Lebin Zhou, Jingchuan Xiao, Rongduo Han, Nam Ling, Cihan Ruan

Abstract

In 1888, Vincent van Gogh wrote, "I am seeking exaggeration in the essential." This principle, amplifying structural form while suppressing photographic detail, lies at the core of Post-Impressionist art. However, most existing 3D style transfer methods invert this philosophy, treating geometry as a rigid substrate for surface-level texture projection. To authentically reproduce Post-Impressionist stylization, geometric abstraction must be embraced as the primary vehicle of expression. We propose a flow-guided geometric advection framework for 3D Gaussian Splatting (3DGS) that operationalizes this principle in a mesh-free setting. Our method extracts directional flow fields from 2D paintings and back-propagates them into 3D space, rectifying Gaussian primitives to form flow-aligned brushstrokes that conform to scene topology without relying on explicit mesh priors. This enables expressive structural deformation driven directly by painterly motion rather than photometric constraints. Our contributions are threefold: (1) a projection-based, mesh-free flow guidance mechanism that transfers 2D artistic motion into 3D Gaussian geometry; (2) a luminance-structure decoupling strategy that isolates geometric deformation from color optimization, mitigating artifacts during aggressive structural abstraction; and (3) a VLM-as-a-Judge evaluation framework that assesses artistic authenticity through aesthetic judgment instead of conventional pixel-level metrics, explicitly addressing the subjective nature of artistic stylization.

Abstract (translated)

1888年,文森特·梵高写道:“我追求的是在本质上的夸张。”这一原则强调放大结构形式的同时抑制摄影细节的呈现,构成了后印象派艺术的核心。然而,现有的大多数三维风格迁移方法与此理念背道而驰,将几何视为表面纹理投影的固定基底。为了真实地再现后印象派风格化效果,必须采用几何抽象作为主要表现手段。 我们提出了一种基于流引导的几何推进框架,应用于3D高斯点云(3DGS),该框架在没有网格约束的情况下实现了这一原则的应用。我们的方法从二维画作中提取方向性流动场,并将其回传至三维空间中,矫正高斯原始模型以形成与场景拓扑相吻合且符合画家动作的流线型笔触,而不依赖显式的网格先验条件。这使得结构变形能够直接由绘画动作驱动,而非基于摄影测量约束。 我们的贡献有三个方面: 1. 提供了一种投影基、无网格流动引导机制,将二维艺术运动转移至三维高斯几何中。 2. 一种亮度-结构解耦策略,使几何变形从颜色优化中分离出来,在进行激进的结构抽象时减少了伪影的产生。 3. VLM(视觉语言模型)作为评判者的评估框架,通过审美判断而非传统的像素级度量来评定艺术作品的真实性和表现力,直接应对了艺术风格化主观性的挑战。

URL

https://arxiv.org/abs/2601.10075

PDF

https://arxiv.org/pdf/2601.10075.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot