Paper Reading AI Learner

Deep Image Prior with L0 Gradient Regularizer for Image Smoothing

2026-01-19 21:10:32
Nhat Thanh Tran, Kevin Bui, Jack Xin

Abstract

Image smoothing is a fundamental image processing operation that preserves the underlying structure, such as strong edges and contours, and removes minor details and textures in an image. Many image smoothing algorithms rely on computing local window statistics or solving an optimization problem. Recent state-of-the-art methods leverage deep learning, but they require a carefully curated training dataset. Because constructing a proper training dataset for image smoothing is challenging, we propose DIP-$\ell_0$, a deep image prior framework that incorporates the $\ell_0$ gradient regularizer. This framework can perform high-quality image smoothing without any training data. To properly minimize the associated loss function that has the nonconvex, nonsmooth $\ell_0$ ``norm", we develop an alternating direction method of multipliers algorithm that utilizes an off-the-shelf $\ell_0$ gradient minimization solver. Numerical experiments demonstrate that the proposed DIP-$\ell_0$ outperforms many image smoothing algorithms in edge-preserving image smoothing and JPEG artifact removal.

Abstract (translated)

图像平滑是一种基本的图像处理操作,它保留了底层结构(如强边缘和轮廓),同时移除图像中的小细节和纹理。许多图像平滑算法依赖于计算局部窗口统计信息或求解优化问题。最近最先进的方法利用深度学习技术,但它们需要精心准备的训练数据集。由于为图像平滑构建合适的训练数据集颇具挑战性,我们提出了一种名为DIP-$\ell_0$(Deep Image Prior)的框架,并在该框架中引入了$\ell_0$梯度正则化器。这个框架能够在无需任何训练数据的情况下实现高质量的图像平滑。 为了有效最小化含有非凸且不光滑的$\ell_0$“范数”的相关损失函数,我们开发了一种交替方向乘子法算法,并利用现成的$\ell_0$梯度最小化求解器。数值实验表明,所提出的DIP-$\ell_0$框架在边缘保护型图像平滑和JPEG伪影去除方面优于许多其他图像平滑算法。

URL

https://arxiv.org/abs/2601.13400

PDF

https://arxiv.org/pdf/2601.13400.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot