Paper Reading AI Learner

Coarse-to-Fine Structure-Aware Artistic Style Transfer

2025-02-08 00:04:12
Kunxiao Liu, Guowu Yuan, Hao Wu, Wenhua Qian

Abstract

Artistic style transfer aims to use a style image and a content image to synthesize a target image that retains the same artistic expression as the style image while preserving the basic content of the content image. Many recently proposed style transfer methods have a common problem; that is, they simply transfer the texture and color of the style image to the global structure of the content image. As a result, the content image has a local structure that is not similar to the local structure of the style image. In this paper, we present an effective method that can be used to transfer style patterns while fusing the local style structure into the local content structure. In our method, dif-ferent levels of coarse stylized features are first reconstructed at low resolution using a Coarse Network, in which style color distribution is roughly transferred, and the content structure is combined with the style structure. Then, the reconstructed features and the content features are adopted to synthesize high-quality structure-aware stylized images with high resolution using a Fine Network with three structural selective fusion (SSF) modules. The effectiveness of our method is demonstrated through the generation of appealing high-quality stylization results and a com-parison with some state-of-the-art style transfer methods.

Abstract (translated)

艺术风格转换的目标是利用一幅风格图像和一幅内容图像来合成目标图像,使其保留与风格图像相同的艺术表达的同时保持内容图像的基本内容不变。然而,许多最近提出的风格转移方法存在一个共同的问题:它们只是简单地将风格图像的纹理和颜色转移到内容图像的整体结构上。因此,生成的内容图像在局部结构上往往并不类似风格图像的局部结构。 在这篇论文中,我们提出了一种有效的方法,可以用于在融合局部风格结构到局部内容结构的同时进行样式图案转移。我们的方法首先使用一个粗略网络(Coarse Network)在低分辨率下重构不同级别的粗略风格化特征,在此过程中大致传输了风格颜色分布,并结合了内容与风格的结构。然后,通过一个配备有三个结构选择性融合(SSF)模块的精细网络(Fine Network),利用重建后的特征和内容特征来生成高分辨率且具有高度感知结构意识的风格化图像。 我们的方法的有效性通过生成吸引人的高质量风格化结果以及与其他最新风格转移方法进行比较得到了证明。

URL

https://arxiv.org/abs/2502.05387

PDF

https://arxiv.org/pdf/2502.05387.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot