Paper Reading AI Learner

Toward Stable Semi-Supervised Remote Sensing Segmentation via Co-Guidance and Co-Fusion

2025-12-28 18:24:19
Yi Zhou, Xuechao Zou, Shun Zhang, Kai Li, Shiying Wang, Jingming Chen, Congyan Lang, Tengfei Cao, Pin Tao, Yuanchun Shi

Abstract

Semi-supervised remote sensing (RS) image semantic segmentation offers a promising solution to alleviate the burden of exhaustive annotation, yet it fundamentally struggles with pseudo-label drift, a phenomenon where confirmation bias leads to the accumulation of errors during training. In this work, we propose Co2S, a stable semi-supervised RS segmentation framework that synergistically fuses priors from vision-language models and self-supervised models. Specifically, we construct a heterogeneous dual-student architecture comprising two distinct ViT-based vision foundation models initialized with pretrained CLIP and DINOv3 to mitigate error accumulation and pseudo-label drift. To effectively incorporate these distinct priors, an explicit-implicit semantic co-guidance mechanism is introduced that utilizes text embeddings and learnable queries to provide explicit and implicit class-level guidance, respectively, thereby jointly enhancing semantic consistency. Furthermore, a global-local feature collaborative fusion strategy is developed to effectively fuse the global contextual information captured by CLIP with the local details produced by DINOv3, enabling the model to generate highly precise segmentation results. Extensive experiments on six popular datasets demonstrate the superiority of the proposed method, which consistently achieves leading performance across various partition protocols and diverse scenarios. Project page is available at this https URL.

Abstract (translated)

半监督遥感(RS)图像语义分割提供了一种有前景的解决方案,以减轻详尽标注的工作负担。然而,它在训练过程中面临着伪标签漂移的问题,这是一种由确认偏差导致错误积累的现象。在这项工作中,我们提出了Co2S,这是一个稳定的半监督RS分割框架,该框架将视觉语言模型和自监督模型中的先验知识进行了协同融合。具体而言,我们构建了一个异构双学生架构,其中包括两个基于ViT的视觉基础模型,并分别用预训练的CLIP和DINOv3进行初始化,以减轻错误积累和伪标签漂移的问题。 为了有效整合这些不同的先验知识,引入了显式隐式语义协同引导机制。该机制利用文本嵌入为明确类别提供指导,同时通过可学习查询提供隐式的类别级指导,从而共同提升语义一致性。 此外,开发了一种全局局部特征协作融合策略,以有效地将CLIP捕获的全球上下文信息与DINOv3产生的本地细节进行融合。这使模型能够生成高度精确的分割结果。 在六个流行数据集上的广泛实验表明了所提出方法的优势,在各种分区协议和多样化场景中均取得了领先性能。项目页面可在提供的链接查看。

URL

https://arxiv.org/abs/2512.23035

PDF

https://arxiv.org/pdf/2512.23035.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot