Paper Reading AI Learner

Mitigating Long-Tail Bias via Prompt-Controlled Diffusion Augmentation

2026-02-04 16:49:16
Buddhi Wijenayake, Nichula Wasalathilake, Roshan Godaliyadda, Vijitha Herath, Parakrama Ekanayake, Vishal M. Patel

Abstract

Semantic segmentation of high-resolution remote-sensing imagery is critical for urban mapping and land-cover monitoring, yet training data typically exhibits severe long-tailed pixel imbalance. In the dataset LoveDA, this challenge is compounded by an explicit Urban/Rural split with distinct appearance and inconsistent class-frequency statistics across domains. We present a prompt-controlled diffusion augmentation framework that synthesizes paired label--image samples with explicit control of both domain and semantic composition. Stage~A uses a domain-aware, masked ratio-conditioned discrete diffusion model to generate layouts that satisfy user-specified class-ratio targets while respecting learned co-occurrence structure. Stage~B translates layouts into photorealistic, domain-consistent images using Stable Diffusion with ControlNet guidance. Mixing the resulting ratio and domain-controlled synthetic pairs with real data yields consistent improvements across multiple segmentation backbones, with gains concentrated on minority classes and improved Urban and Rural generalization, demonstrating controllable augmentation as a practical mechanism to mitigate long-tail bias in remote-sensing segmentation. Source codes, pretrained models, and synthetic datasets are available at \href{this https URL}{Github}

Abstract (translated)

高分辨率遥感图像的语义分割对于城市制图和土地覆盖监测至关重要,然而训练数据通常表现出严重的长尾像素不平衡问题。在LoveDA数据集中,这一挑战进一步被明确的城市/农村划分所加剧,这些区域具有不同的外观特征以及跨领域的不一致类别频率统计。 我们提出了一种受提示控制的扩散增强框架,该框架能够生成带有明确领域和语义成分控制的配对标签-图像样本。第一阶段(Stage A)使用了具备领域感知能力的、条件于掩码比例的离散扩散模型来生成满足用户指定类别比例目标的布局,并同时保持学习到的共现结构。第二阶段(Stage B)则利用Stable Diffusion结合ControlNet指导,将这些布局转换为逼真的且符合相应领域的图像。 通过将这种比率和领域受控合成对与真实数据混合使用,我们观察到了多个分割骨干网络的一致性改进,并且这些改进主要集中在少数类上以及城市和农村区域的泛化能力得到提升。这表明可控增强作为一种实用机制能够有效缓解遥感分割中的长尾偏差问题。 源代码、预训练模型及合成数据集可在Github上的[此链接](https://github.com/yourusername/repo)获取。

URL

https://arxiv.org/abs/2602.04749

PDF

https://arxiv.org/pdf/2602.04749.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot