Paper Reading AI Learner

HaineiFRDM: Explore Diffusion to Restore Defects in Fast-Movement Films

2025-12-31 16:18:07
Rongji Xun, Junjie Yuan, Zhongjie Wang

Abstract

Existing open-source film restoration methods show limited performance compared to commercial methods due to training with low-quality synthetic data and employing noisy optical flows. In addition, high-resolution films have not been explored by the open-source this http URL propose HaineiFRDM(Film Restoration Diffusion Model), a film restoration framework, to explore diffusion model's powerful content-understanding ability to help human expert better restore indistinguishable film this http URL, we employ a patch-wise training and testing strategy to make restoring high-resolution films on one 24GB-VRAMR GPU possible and design a position-aware Global Prompt and Frame Fusion this http URL, we introduce a global-local frequency module to reconstruct consistent textures among different patches. Besides, we firstly restore a low-resolution result and use it as global residual to mitigate blocky artifacts caused by patching this http URL, we construct a film restoration dataset that contains restored real-degraded films and realistic synthetic this http URL experimental results conclusively demonstrate the superiority of our model in defect restoration ability over existing open-source methods. Code and the dataset will be released.

Abstract (translated)

现有的开源电影修复方法由于使用低质量的合成数据进行训练和采用噪声光学流,其性能相比商业方法较为有限。此外,高分辨率影片的修复尚未被开源社区充分探索。为此,我们提出了HaineiFRDM(Film Restoration Diffusion Model),这是一种基于扩散模型的电影修复框架,旨在利用扩散模型强大的内容理解能力帮助人类专家更好地恢复难以辨别的电影片段。 具体来说,我们采用了一种基于补丁的方法进行训练和测试,使得在配备24GB VRAM GPU上对高分辨率影片进行修复成为可能,并设计了一个位置感知全局提示及帧融合模块。此外,为了重建不同补丁间的连贯纹理,我们引入了全球-局部频率模块。 进一步地,我们在首次恢复低分辨率结果后将其用作全局残差以减轻由分块引起的方块效应(blocky artifacts)。我们构建了一个包含修复的现实降质影片和逼真的合成数据的电影修复数据集。实验结果显示,我们的模型在缺陷修复能力上显著优于现有的开源方法。代码及数据集将公开发布。

URL

https://arxiv.org/abs/2512.24946

PDF

https://arxiv.org/pdf/2512.24946.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot