Paper Reading AI Learner

Generalizable NGP-SR: Generalizable Neural Radiance Fields Super-Resolution via Neural Graph Primitives

2026-03-20 16:50:16
Wanqi Yuan, Omkar Sharad Mayekar, Connor Pennington, Nianyi Li

Abstract

Neural Radiance Fields (NeRF) achieve photorealistic novel view synthesis but become costly when high-resolution (HR) rendering is required, as HR outputs demand dense sampling and higher-capacity models. Moreover, naively super-resolving per-view renderings in 2D often breaks multi-view consistency. We propose Generalizable NGP-SR, a 3D-aware super-resolution framework that reconstructs an HR radiance field directly from low-resolution (LR) posed images. Built on Neural Graphics Primitives (NGP), NGP-SR conditions radiance prediction on 3D coordinates and learned local texture tokens, enabling recovery of high-frequency details within the radiance field and producing view-consistent HR novel views without external HR references or post-hoc 2D upsampling. Importantly, our model is generalizable: once trained, it can be applied to unseen scenes and rendered from novel viewpoints without per-scene optimization. Experiments on multiple datasets show that NGP-SR consistently improves both reconstruction quality and runtime efficiency over prior NeRF-based super-resolution methods, offering a practical solution for scalable high-resolution novel view synthesis.

Abstract (translated)

神经辐射场(NeRF)可实现照片级真实感的新视角合成,但当需要高分辨率(HR)渲染时,其计算成本高昂,因为高分辨率输出需要密集采样和更高容量的模型。此外,简单地以2D方式对单视角渲染结果进行超分辨率处理,往往会破坏多视角一致性。我们提出了通用型NGP-SR,这是一个三维感知的超分辨率框架,可直接从低分辨率(LR)的位姿图像中重建高分辨率辐射场。基于神经图形基元(NGP),NGP-SR将辐射预测条件化于三维坐标与学习得到的局部纹理标记,从而在辐射场内恢复高频细节,并生成视角一致的高分辨率新视图,而无需外部高分辨率参考或事后的2D上采样。重要的是,我们的模型具有通用性:训练完成后,可应用于未见场景并从新视角进行渲染,无需针对每个场景进行优化。在多个数据集上的实验表明,NGP-SR在重建质量和运行效率上均持续优于先前的基于NeRF的超分辨率方法,为可扩展的高分辨率新视角合成提供了实用解决方案。

URL

https://arxiv.org/abs/2603.20128

PDF

https://arxiv.org/pdf/2603.20128.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot