Paper Reading AI Learner

Learning Physics-Informed Color-Aware Transforms for Low-Light Image Enhancement

2025-04-16 09:23:38
Xingxing Yang, Jie Chen, Zaifeng Yang

Abstract

Image decomposition offers deep insights into the imaging factors of visual data and significantly enhances various advanced computer vision tasks. In this work, we introduce a novel approach to low-light image enhancement based on decomposed physics-informed priors. Existing methods that directly map low-light to normal-light images in the sRGB color space suffer from inconsistent color predictions and high sensitivity to spectral power distribution (SPD) variations, resulting in unstable performance under diverse lighting conditions. To address these challenges, we introduce a Physics-informed Color-aware Transform (PiCat), a learning-based framework that converts low-light images from the sRGB color space into deep illumination-invariant descriptors via our proposed Color-aware Transform (CAT). This transformation enables robust handling of complex lighting and SPD variations. Complementing this, we propose the Content-Noise Decomposition Network (CNDN), which refines the descriptor distributions to better align with well-lit conditions by mitigating noise and other distortions, thereby effectively restoring content representations to low-light images. The CAT and the CNDN collectively act as a physical prior, guiding the transformation process from low-light to normal-light domains. Our proposed PiCat framework demonstrates superior performance compared to state-of-the-art methods across five benchmark datasets.

Abstract (translated)

图像分解为视觉数据的成像因素提供了深刻见解,并显著增强了各种先进的计算机视觉任务。在这项工作中,我们介绍了一种基于分解物理信息先验的新方法来改进低光条件下的图像增强技术。现有直接将低光图像映射到正常光照条件下图像的方法在sRGB色彩空间中存在颜色预测不一致以及对光谱功率分布(SPD)变化高度敏感的问题,导致其在不同照明条件下表现不稳定。为解决这些问题,我们引入了物理信息感知的颜色变换框架——Physics-informed Color-aware Transform (PiCat),它通过我们提出的Color-aware Transform (CAT) 将低光图像从sRGB色彩空间转换成深度的光照不变描述符。这种变换能够更好地处理复杂的光照和SPD变化问题,从而增强其鲁棒性。 此外,我们提出了内容噪声分解网络(CNDN),该网络通过减少噪声和其他失真来优化描述符分布,使低光图像的内容表示与良好照明条件下的表示更加一致,进而有效地恢复了这些内容的表示。CAT和CNDN共同作为物理先验知识,在从低光照域到正常光照领域的转换过程中提供指导。 我们的PiCat框架在五个基准数据集上展示出优于现有最佳方法的表现。

URL

https://arxiv.org/abs/2504.11896

PDF

https://arxiv.org/pdf/2504.11896.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot