Paper Reading AI Learner

Denoise and Align: Towards Source-Free UDA for Robust Panoramic Semantic Segmentation

2026-03-26 07:54:43
Yaowen Chang, Zhen Cao, Xu Zheng, Xiaoxin Mi, Zhen Dong

Abstract

Panoramic semantic segmentation is pivotal for comprehensive 360° scene understanding in critical applications like autonomous driving and virtual reality. However, progress in this domain is constrained by two key challenges: the severe geometric distortions inherent in panoramic projections and the prohibitive cost of dense annotation. While Unsupervised Domain Adaptation (UDA) from label-rich pinhole-camera datasets offers a viable alternative, many real-world tasks impose a stricter source-free (SFUDA) constraint where source data is inaccessible for privacy or proprietary reasons. This constraint significantly amplifies the core problems of domain shift, leading to unreliable pseudo-labels and dramatic performance degradation, particularly for minority classes. To overcome these limitations, we propose the DAPASS framework. DAPASS introduces two synergistic modules to robustly transfer knowledge without source data. First, our Panoramic Confidence-Guided Denoising (PCGD) module generates high-fidelity, class-balanced pseudo-labels by enforcing perturbation consistency and incorporating neighborhood-level confidence to filter noise. Second, a Contextual Resolution Adversarial Module (CRAM) explicitly addresses scale variance and distortion by adversarially aligning fine-grained details from high-resolution crops with global semantics from low-resolution contexts. DAPASS achieves state-of-the-art performances on outdoor (Cityscapes-to-DensePASS) and indoor (Stanford2D3D) benchmarks, yielding 55.04% (+2.05%) and 70.38% (+1.54%) mIoU, respectively.

Abstract (translated)

全景语义分割对于自动驾驶和虚拟现实等关键应用中的全方位360°场景理解至关重要。然而,该领域的发展受限于两个核心挑战:全景投影固有的严重几何畸变,以及密集标注的高昂成本。尽管从标注丰富的针孔相机数据集进行无监督域适应(UDA)提供了一种可行方案,但许多实际任务施加了更严格的源自由(SFUDA)约束——因隐私或专有原因无法访问源数据。这一约束显著加剧了域偏移的核心问题,导致伪标签不可靠且性能急剧下降,尤其对少数类影响显著。为克服这些限制,我们提出了DAPASS框架。该框架引入两个协同模块以在无源数据条件下稳健迁移知识:首先,全景置信度引导去噪(PCGD)模块通过强制扰动一致性并引入邻域级置信度过滤噪声,生成高保真、类别平衡的伪标签;其次,上下文分辨率对抗模块(CRAM)通过对抗性对齐高分辨率裁剪的细粒度细节与低分辨率上下文的全局语义,显式解决尺度变异和畸变问题。DAPASS在户外(Cityscapes-to-DensePASS)和室内(Stanford2D3D)基准测试中均达到最先进性能,分别取得55.04%(+2.05%)和70.38%(+1.54%)的mIoU。

URL

https://arxiv.org/abs/2603.25131

PDF

https://arxiv.org/pdf/2603.25131.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot