Paper Reading AI Learner

VideoPDE: Unified Generative PDE Solving via Video Inpainting Diffusion Models

2025-06-16 17:58:00
Edward Li, Zichen Wang, Jiahe Huang, Jeong Joon Park

Abstract

We present a unified framework for solving partial differential equations (PDEs) using video-inpainting diffusion transformer models. Unlike existing methods that devise specialized strategies for either forward or inverse problems under full or partial observation, our approach unifies these tasks under a single, flexible generative framework. Specifically, we recast PDE-solving as a generalized inpainting problem, e.g., treating forward prediction as inferring missing spatiotemporal information of future states from initial conditions. To this end, we design a transformer-based architecture that conditions on arbitrary patterns of known data to infer missing values across time and space. Our method proposes pixel-space video diffusion models for fine-grained, high-fidelity inpainting and conditioning, while enhancing computational efficiency through hierarchical modeling. Extensive experiments show that our video inpainting-based diffusion model offers an accurate and versatile solution across a wide range of PDEs and problem setups, outperforming state-of-the-art baselines.

Abstract (translated)

我们提出了一种使用视频修复扩散变换器模型解决偏微分方程(PDE)的统一框架。与现有方法不同,后者为完整或部分观测下的正向问题或逆向问题设计了专门策略,我们的方法将这些任务统一在一个单一且灵活的生成框架下进行处理。具体来说,我们将求解PDE的问题重新表述为一个广义修复问题,例如,将其视为从初始条件推断未来状态缺失的空间-时间信息的过程。 为此,我们设计了一种基于变换器架构的方法,它可以根据任意已知数据模式,在时间和空间上推测出缺失的值。我们的方法采用像素空间视频扩散模型进行精细化、高保真度的修复和条件设定,并通过分层建模提高计算效率。 大量的实验表明,我们提出的基于视频修复的扩散模型在广泛的PDE问题设置中提供了准确且灵活的解决方案,超过了现有的最先进基准。

URL

https://arxiv.org/abs/2506.13754

PDF

https://arxiv.org/pdf/2506.13754.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot