Paper Reading AI Learner

Data relativistic uncertainty framework for low-illumination anime scenery image enhancement

2025-12-26 09:43:24
Yiquan Gao, John See

Abstract

By contrast with the prevailing works of low-light enhancement in natural images and videos, this study copes with the low-illumination quality degradation in anime scenery images to bridge the domain gap. For such an underexplored enhancement task, we first curate images from various sources and construct an unpaired anime scenery dataset with diverse environments and illumination conditions to address the data scarcity. To exploit the power of uncertainty information inherent with the diverse illumination conditions, we propose a Data Relativistic Uncertainty (DRU) framework, motivated by the idea from Relativistic GAN. By analogy with the wave-particle duality of light, our framework interpretably defines and quantifies the illumination uncertainty of dark/bright samples, which is leveraged to dynamically adjust the objective functions to recalibrate the model learning under data uncertainty. Extensive experiments demonstrate the effectiveness of DRU framework by training several versions of EnlightenGANs, yielding superior perceptual and aesthetic qualities beyond the state-of-the-art methods that are incapable of learning from data uncertainty perspective. We hope our framework can expose a novel paradigm of data-centric learning for potential visual and language domains. Code is available.

Abstract (translated)

与现有的自然图像和视频低光增强作品相比,本研究针对动漫风景图像中的低光照质量退化问题,旨在弥合领域差异。为了应对这一尚未充分探索的增强任务,我们首先从各种来源收集图片,并构建了一个包含多样化环境和光照条件的无配对动漫风景数据集,以解决数据稀缺的问题。 为了利用与多样化的照明条件固有的不确定性信息的力量,我们提出了一种数据相对论不确定性(DRU)框架,这一框架受到了相对论生成对抗网络思想的启发。通过将光的波粒二象性类比到我们的框架中,我们明确地定义和量化了暗/亮样本的光照不确定性,并利用这种不确定性动态调整目标函数以在数据不确定性的情况下重新校准模型学习。 大量的实验展示了DRU框架的有效性,通过对几个版本的EnlightenGAN进行训练,结果超越了当前最先进的方法,在感知质量和美学质量方面均表现出色。我们希望我们的框架可以揭示一种新的以数据为中心的学习范式,适用于潜在的视觉和语言领域。代码已公开提供。

URL

https://arxiv.org/abs/2512.21944

PDF

https://arxiv.org/pdf/2512.21944.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot