Paper Reading AI Learner

ScrollScape: Unlocking 32K Image Generation With Video Diffusion Priors

2026-03-25 13:03:02
Haodong Yu, Yabo Zhang, Donglin Di, Ruyi Zhang, Wangmeng Zuo

Abstract

While diffusion models excel at generating images with conventional dimensions, pushing them to synthesize ultra-high-resolution imagery at extreme aspect ratios (EAR) often triggers catastrophic structural failures, such as object repetition and spatial this http URL limitation fundamentally stems from a lack of robust spatial priors, as static text-to-image models are primarily trained on image distributions with conventional this http URL overcome this bottleneck, we present ScrollScape, a novel framework that reformulates EAR image synthesis into a continuous video generation process through two core this http URL mapping the spatial expansion of a massive canvas to the temporal evolution of video frames, ScrollScape leverages the inherent temporal consistency of video models as a powerful global constraint to ensure long-range structural this http URL, Scanning Positional Encoding (ScanPE) distributes global coordinates across frames to act as a flexible moving camera, while Scrolling Super-Resolution (ScrollSR) leverages video super-resolution priors to circumvent memory bottlenecks, efficiently scaling outputs to an unprecedented 32K resolution. Fine-tuned on a curated 3K multi-ratio image dataset, ScrollScape effectively aligns pre-trained video priors with the EAR generation task. Extensive evaluations demonstrate that it significantly outperforms existing image-diffusion baselines by eliminating severe localized artifacts. Consequently, our method overcomes inherent structural bottlenecks to ensure exceptional global coherence and visual fidelity across diverse domains at extreme scales.

Abstract (translated)

尽管扩散模型在生成常规尺寸图像方面表现出色,但将其推向极端纵横比(EAR)的超高分辨率图像合成时,常会引发灾难性的结构失效,例如物体重复和空间局限。这一根本限制源于缺乏稳健的空间先验,因为静态文本到图像模型主要基于常规尺寸图像分布进行训练。为突破这一瓶颈,我们提出了ScrollScape,一种新颖框架,通过两个核心机制将EAR图像合成重新构建为连续视频生成过程:通过将超大画布的空间扩展映射到视频帧的时间演变,ScrollScape利用视频模型固有的时间一致性作为强大的全局约束,以确保长程结构连贯性。扫描位置编码(ScanPE)将全局坐标分布到各帧中,充当灵活的移动摄像机;而滚动超分辨率(ScrollSR)则利用视频超分辨率先验来规避内存瓶颈,高效将输出扩展至前所未有的32K分辨率。经精心策划的3K多纵横比图像数据集微调后,ScrollScape能有效将预训练的视频先验与EAR生成任务对齐。广泛评估表明,该方法通过消除严重的局部伪影,显著优于现有图像扩散基线。因此,我们的方法克服了固有的结构瓶颈,确保了在极端尺度下跨不同领域的卓越全局连贯性和视觉保真度。

URL

https://arxiv.org/abs/2603.24270

PDF

https://arxiv.org/pdf/2603.24270.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot