Paper Reading AI Learner

Deep Equilibrium models for Poisson Imaging Inverse problems via Mirror Descent

2025-07-15 16:33:01
Christian Daniele, Silvia Villa, Samuel Vaiter, Luca Calatroni

Abstract

Deep Equilibrium Models (DEQs) are implicit neural networks with fixed points, which have recently gained attention for learning image regularization functionals, particularly in settings involving Gaussian fidelities, where assumptions on the forward operator ensure contractiveness of standard (proximal) Gradient Descent operators. In this work, we extend the application of DEQs to Poisson inverse problems, where the data fidelity term is more appropriately modeled by the Kullback-Leibler divergence. To this end, we introduce a novel DEQ formulation based on Mirror Descent defined in terms of a tailored non-Euclidean geometry that naturally adapts with the structure of the data term. This enables the learning of neural regularizers within a principled training framework. We derive sufficient conditions to guarantee the convergence of the learned reconstruction scheme and propose computational strategies that enable both efficient training and fully parameter-free inference. Numerical experiments show that our method outperforms traditional model-based approaches and it is comparable to the performance of Bregman Plug-and-Play methods, while mitigating their typical drawbacks - namely, sensitivity to initialization and careful tuning of hyperparameters. The code is publicly available at this https URL.

Abstract (translated)

深度平衡模型(DEQs)是一种隐式神经网络,具有固定点特性,在学习图像正则化函数方面近期受到了广泛关注,特别是在涉及高斯保真度的情况下。在这种情况下,关于前向操作符的假设保证了标准梯度下降算子的收敛性。在这项工作中,我们将DEQ的应用扩展到了泊松逆问题领域,在此背景下数据保真度项更适宜用Kullback-Leibler散度来建模。 为此,我们提出了一种新的基于镜像下降(Mirror Descent)的DEQ模型,该模型根据特定于任务而非欧几里得几何结构进行定义。这种设计能够自然地适应数据项的特性,并允许在网络框架内学习神经正则化器。我们推导了保证学习重构方案收敛性的充分条件,并提出计算策略以实现高效训练和完全无需参数调整的推理过程。 数值实验表明,与传统模型驱动的方法相比,我们的方法性能更优;同时,在表现上也与Bregman Plug-and-Play方法相当,但避免了后者常见的缺点——即对初始化敏感以及需要精细调参。代码在提供的URL中公开发布。

URL

https://arxiv.org/abs/2507.11461

PDF

https://arxiv.org/pdf/2507.11461.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot