Paper Reading AI Learner

Warm Starts Accelerate Generative Modelling

2025-07-12 09:07:05
Jonas Scholz, Richard E. Turner

Abstract

Iterative generative models, like diffusion and flow-matching, create high-fidelity samples by progressively refining a noise vector into data. However, this process is notoriously slow, often requiring hundreds of function evaluations. We introduce the warm-start model, a simple, deterministic model that dramatically accelerates conditional generation by providing a better starting point. Instead of starting generation from an uninformed N(0, I) prior, our warm-start model predicts an informed prior N(mu, sigma), whose moments are conditioned on the input context. This "warm start" substantially reduces the distance the generative process must traverse, particularly when the conditioning information is strongly informative. On tasks like image inpainting, our method achieves results competitive with a 1000-step DDPM baseline using only 11 total function evaluations (1 for the warm start, 10 for generation). A simple conditional normalization trick makes our method compatible with any standard generative model and sampler without modification, allowing it to be combined with other efficient sampling techniques for further acceleration. Our implementation is available at this https URL.

Abstract (translated)

迭代生成模型,如扩散和流匹配模型,通过逐步将噪声向量细化为数据来创建高保真样本。然而,这一过程通常非常慢,往往需要进行数百次函数评估。我们引入了预热启动模型(warm-start model),这是一种简单且确定性的模型,可以通过提供一个更好的起点显著加速条件生成。我们的预热启动模型预测了一个基于输入上下文的有信息量的先验分布N(mu, sigma),而不是从无信息的N(0, I)先验开始生成。这种“预热”大幅减少了生成过程必须覆盖的距离,尤其是在上下文信息非常有用的情况下。 在图像修复等任务上,我们的方法仅使用总共11次函数评估(一次用于预热启动,十次用于生成)就能达到与一个需要1000步的DDPM基线相当的结果。一种简单的条件归一化技巧使得该方法可以与其他标准生成模型和采样器兼容,无需进行任何修改,并允许它结合其他高效的采样技术以进一步加速。 我们的实现代码可在[此处](https://this https URL)获得。

URL

https://arxiv.org/abs/2507.09212

PDF

https://arxiv.org/pdf/2507.09212.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot