Paper Reading AI Learner

A Survey and Benchmark of Automatic Surface Reconstruction from Point Clouds

2023-01-31 14:18:19
Raphael Sulzer, Loic Landrieu, Renaud Marlet, Bruno Vallet

Abstract

We survey and benchmark traditional and novel learning-based algorithms that address the problem of surface reconstruction from point clouds. Surface reconstruction from point clouds is particularly challenging when applied to real-world acquisitions, due to noise, outliers, non-uniform sampling and missing data. Traditionally, different handcrafted priors of the input points or the output surface have been proposed to make the problem more tractable. However, hyperparameter tuning for adjusting priors to different acquisition defects can be a tedious task. To this end, the deep learning community has recently addressed the surface reconstruction problem. In contrast to traditional approaches, deep surface reconstruction methods can learn priors directly from a training set of point clouds and corresponding true surfaces. In our survey, we detail how different handcrafted and learned priors affect the robustness of methods to defect-laden input and their capability to generate geometric and topologically accurate reconstructions. In our benchmark, we evaluate the reconstructions of several traditional and learning-based methods on the same grounds. We show that learning-based methods can generalize to unseen shape categories, but their training and test sets must share the same point cloud characteristics. We also provide the code and data to compete in our benchmark and to further stimulate the development of learning-based surface reconstruction this https URL.

Abstract (translated)

我们综述并基准了传统的和新型基于学习的算法,以解决从点云表面重建的问题。在实际应用中,从点云表面重建的问题特别具有挑战性,因为噪声、异常值、非均匀采样和缺失数据。传统上,提出了不同手工计算的先验概率,以使问题更可处理。然而,调整不同获取缺陷的先验概率是一项繁琐的任务。为此,深度学习社区最近解决了表面重建问题。与传统方法不同,深度表面重建方法可以从训练集中的点云和对应的真实表面学习先验概率。在我们的调查中,我们详细阐述了不同手工计算和学习先验如何影响方法对缺陷负荷的鲁棒性和生成几何和拓扑准确的重构能力。在我们的基准中,我们评估了多种传统和基于学习的方法的重构性能,并在同一标准下进行比较。我们表明,基于学习的方法可以泛化到未曾见过的形状类别中,但其训练和测试集必须共享相同的点云特征。我们 also提供了代码和数据,以在我们的基准中竞争,并进一步刺激基于学习的表面重建技术的发展,该URL指向https。

URL

https://arxiv.org/abs/2301.13656

PDF

https://arxiv.org/pdf/2301.13656.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot