Paper Reading AI Learner

MVGSR: Multi-View Consistent 3D Gaussian Super-Resolution via Epipolar Guidance

2025-12-17 03:23:12
Kaizhe Zhang, Shinan Chen, Qian Zhao, Weizhan Zhang, Caixia Yan, Yudeng Xin

Abstract

Scenes reconstructed by 3D Gaussian Splatting (3DGS) trained on low-resolution (LR) images are unsuitable for high-resolution (HR) rendering. Consequently, a 3DGS super-resolution (SR) method is needed to bridge LR inputs and HR rendering. Early 3DGS SR methods rely on single-image SR networks, which lack cross-view consistency and fail to fuse complementary information across views. More recent video-based SR approaches attempt to address this limitation but require strictly sequential frames, limiting their applicability to unstructured multi-view datasets. In this work, we introduce Multi-View Consistent 3D Gaussian Splatting Super-Resolution (MVGSR), a framework that focuses on integrating multi-view information for 3DGS rendering with high-frequency details and enhanced consistency. We first propose an Auxiliary View Selection Method based on camera poses, making our method adaptable for arbitrarily organized multi-view datasets without the need of temporal continuity or data reordering. Furthermore, we introduce, for the first time, an epipolar-constrained multi-view attention mechanism into 3DGS SR, which serves as the core of our proposed multi-view SR network. This design enables the model to selectively aggregate consistent information from auxiliary views, enhancing the geometric consistency and detail fidelity of 3DGS representations. Extensive experiments demonstrate that our method achieves state-of-the-art performance on both object-centric and scene-level 3DGS SR benchmarks.

Abstract (translated)

使用低分辨率(LR)图像训练的3D高斯点云重建方法(3D Gaussian Splatting,简称3DGS)所重构的场景对于高清渲染来说是不合适的。因此需要一种3DGS超分辨技术来连接低分辨率输入和高质量的高清渲染。早期的3DGS超分辨技术主要依赖于单图像超分辨网络,这些技术缺乏视图间的一致性,并且无法融合来自不同视角的互补信息。最近一些基于视频序列的技术试图解决这一问题,但要求严格的顺序帧输入,限制了其在非结构化多视图数据集中的应用。 本文中我们引入了一种新的方法:多视角一致3D高斯点云超分辨技术(MVGSR),该框架旨在整合多视角信息以提高基于3DGS渲染的高频细节和一致性。首先,我们提出一种基于摄像机姿态的辅助视图选择方法,使我们的方法能够适应任意组织化的多视角数据集,并且无需时间连续性或数据重新排序。 此外,我们首次在3DGS超分辨技术中引入了符合基线约束的多视角注意力机制,这是我们的多视角超分辨网络的核心设计。这种设计使得模型可以有选择地从辅助视图中聚合一致的信息,从而增强了3DGS表示的几何一致性与细节准确性。 大量的实验表明,在面向对象和场景级别的基于3DGS的超分辨率基准测试上,该方法达到了最先进的性能表现。

URL

https://arxiv.org/abs/2512.15048

PDF

https://arxiv.org/pdf/2512.15048.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot