Paper Reading AI Learner

RePainter: Empowering E-commerce Object Removal via Spatial-matting Reinforcement Learning

2025-10-09 02:57:33
Zipeng Guo, Lichen Ma, Xiaolong Fu, Gaojing Zhou, Lan Yang, Yuchen Zhou, Linkai Liu, Yu He, Ximan Liu, Shiping Dong, Jingling Fu, Zhen Chen, Yu Shi, Junshi Huang, Jason Li, Chao Gou

Abstract

In web data, product images are central to boosting user engagement and advertising efficacy on e-commerce platforms, yet the intrusive elements such as watermarks and promotional text remain major obstacles to delivering clear and appealing product visuals. Although diffusion-based inpainting methods have advanced, they still face challenges in commercial settings due to unreliable object removal and limited domain-specific adaptation. To tackle these challenges, we propose Repainter, a reinforcement learning framework that integrates spatial-matting trajectory refinement with Group Relative Policy Optimization (GRPO). Our approach modulates attention mechanisms to emphasize background context, generating higher-reward samples and reducing unwanted object insertion. We also introduce a composite reward mechanism that balances global, local, and semantic constraints, effectively reducing visual artifacts and reward hacking. Additionally, we contribute EcomPaint-100K, a high-quality, large-scale e-commerce inpainting dataset, and a standardized benchmark EcomPaint-Bench for fair evaluation. Extensive experiments demonstrate that Repainter significantly outperforms state-of-the-art methods, especially in challenging scenes with intricate compositions. We will release our code and weights upon acceptance.

Abstract (translated)

在网页数据中,产品图片对于提高电子商务平台上的用户参与度和广告效果至关重要。然而,水印和促销文字等侵入性元素仍然是提供清晰、吸引人的产品视觉效果的主要障碍。尽管基于扩散的图像修复方法已经有所进步,但在商业环境中仍然面临着对象移除不可靠以及领域特定适应能力有限的问题。为了应对这些挑战,我们提出了Repainter框架,这是一种结合了空间-遮罩轨迹细化与组相对策略优化(GRPO)的强化学习框架。我们的方法通过调节注意力机制来强调背景信息,从而生成高奖励样本并减少不需要的对象插入。此外,我们引入了一种复合奖励机制,该机制平衡全局、局部和语义约束,有效减少了视觉伪影和奖励欺骗。 另外,我们还贡献了一个高质量的大规模电子商务图像修复数据集EcomPaint-100K以及一个标准化基准测试平台EcomPaint-Bench,以实现公正的评估。广泛的实验表明,Repainter在具有复杂构图的挑战性场景中显著优于现有的最先进的方法。一旦获得接受,我们将发布我们的代码和权重。

URL

https://arxiv.org/abs/2510.07721

PDF

https://arxiv.org/pdf/2510.07721.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot