Paper Reading AI Learner

Towards Single-Source Domain Generalized Object Detection via Causal Visual Prompts

2025-10-22 11:24:52
Chen Li, Huiying Xu, Changxin Gao, Zeyu Wang, Yun Liu, Xinzhong Zhu

Abstract

Single-source Domain Generalized Object Detection (SDGOD), as a cutting-edge research topic in computer vision, aims to enhance model generalization capability in unseen target domains through single-source domain training. Current mainstream approaches attempt to mitigate domain discrepancies via data augmentation techniques. However, due to domain shift and limited domain-specific knowledge, models tend to fall into the pitfall of spurious correlations. This manifests as the model's over-reliance on simplistic classification features (e.g., color) rather than essential domain-invariant representations like object contours. To address this critical challenge, we propose the Cauvis (Causal Visual Prompts) method. First, we introduce a Cross-Attention Prompts module that mitigates bias from spurious features by integrating visual prompts with cross-attention. To address the inadequate domain knowledge coverage and spurious feature entanglement in visual prompts for single-domain generalization, we propose a dual-branch adapter that disentangles causal-spurious features while achieving domain adaptation via high-frequency feature extraction. Cauvis achieves state-of-the-art performance with 15.9-31.4% gains over existing domain generalization methods on SDGOD datasets, while exhibiting significant robustness advantages in complex interference environments.

Abstract (translated)

单一来源领域泛化目标检测(SDGOD)作为计算机视觉领域的前沿研究课题,旨在通过单源域训练来提升模型在未见目标域中的泛化能力。当前主流方法试图通过数据增强技术来缓解不同领域间的差异性问题。然而,由于领域偏移和特定领域知识的限制,模型容易陷入虚假相关性的陷阱中。这表现为模型过分依赖于简单的分类特征(例如颜色),而不是像物体轮廓这样的领域不变表示特征。 为了解决这一关键挑战,我们提出了Cauvis(因果视觉提示)方法。首先,我们引入了一个跨注意力提示模块,通过将视觉提示与跨注意力机制结合来减轻虚假特征偏差的影响。为了应对单域泛化中视觉提示的领域知识覆盖不足和虚假特征纠缠的问题,我们提出了一种双分支适配器,该适配器在提取高频特征实现领域适应的同时,还能分离因果虚假特征。 Cauvis 方法在 SDGOD 数据集上相对于现有领域的泛化方法取得了 15.9-31.4% 的性能提升,并且在复杂的干扰环境中展示了显著的鲁棒性优势。

URL

https://arxiv.org/abs/2510.19487

PDF

https://arxiv.org/pdf/2510.19487.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot