Paper Reading AI Learner

OMUDA: Omni-level Masking for Unsupervised Domain Adaptation in Semantic Segmentation

2025-12-13 12:01:23
Yang Ou, Xiongwei Zhao, Xinye Yang, Yihan Wang, Yicheng Di, Rong Yuan, Xieyuanli Chen, Xu Zhu

Abstract

Unsupervised domain adaptation (UDA) enables semantic segmentation models to generalize from a labeled source domain to an unlabeled target domain. However, existing UDA methods still struggle to bridge the domain gap due to cross-domain contextual ambiguity, inconsistent feature representations, and class-wise pseudo-label noise. To address these challenges, we propose Omni-level Masking for Unsupervised Domain Adaptation (OMUDA), a unified framework that introduces hierarchical masking strategies across distinct representation levels. Specifically, OMUDA comprises: 1) a Context-Aware Masking (CAM) strategy that adaptively distinguishes foreground from background to balance global context and local details; 2) a Feature Distillation Masking (FDM) strategy that enhances robust and consistent feature learning through knowledge transfer from pre-trained models; and 3) a Class Decoupling Masking (CDM) strategy that mitigates the impact of noisy pseudo-labels by explicitly modeling class-wise uncertainty. This hierarchical masking paradigm effectively reduces the domain shift at the contextual, representational, and categorical levels, providing a unified solution beyond existing approaches. Extensive experiments on multiple challenging cross-domain semantic segmentation benchmarks validate the effectiveness of OMUDA. Notably, on the SYNTHIA->Cityscapes and GTA5->Cityscapes tasks, OMUDA can be seamlessly integrated into existing UDA methods and consistently achieving state-of-the-art results with an average improvement of 7%.

Abstract (translated)

无监督领域适应(UDA)使语义分割模型能够从有标签的源域泛化到无标签的目标域。然而,现有的UDA方法仍然难以弥合因跨域上下文模糊性、特征表示不一致以及类别伪标签噪声等原因导致的领域差距。为了解决这些挑战,我们提出了Omni-level Masking for Unsupervised Domain Adaptation(OMUDA),这是一种统一框架,引入了在不同表示层次上的分层掩码策略。具体来说,OMUDA包括: 1. 上下文感知掩码(CAM)策略:该策略能够自适应地区分前景和背景,并平衡全局上下文与局部细节; 2. 特征蒸馏掩码(FDM)策略:通过从预训练模型的知识转移来增强鲁棒且一致的特征学习; 3. 类别解耦掩码(CDM)策略:该策略通过显式建模类别不确定性,减轻了噪声伪标签的影响。 这种分层掩码范例在上下文、表示和分类级别上有效地减少了领域偏移,并提供了一种超越现有方法的统一解决方案。多项具有挑战性的跨域语义分割基准实验验证了OMUDA的有效性。特别地,在SYNTHIA->Cityscapes和GTA5->Cityscapes任务中,OMUDA可以无缝集成到现有的UDA方法中,并始终取得最先进的结果,平均改进达到7%。

URL

https://arxiv.org/abs/2512.12303

PDF

https://arxiv.org/pdf/2512.12303.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot