Paper Reading AI Learner

MoEdit: On Learning Quantity Perception for Multi-object Image Editing

2025-03-13 07:13:54
Yanfeng Li, Kahou Chan, Yue Sun, Chantong Lam, Tong Tong, Zitong Yu, Keren Fu, Xiaohong Liu, Tao Tan

Abstract

Multi-object images are prevalent in various real-world scenarios, including augmented reality, advertisement design, and medical imaging. Efficient and precise editing of these images is critical for these applications. With the advent of Stable Diffusion (SD), high-quality image generation and editing have entered a new era. However, existing methods often struggle to consider each object both individually and part of the whole image editing, both of which are crucial for ensuring consistent quantity perception, resulting in suboptimal perceptual performance. To address these challenges, we propose MoEdit, an auxiliary-free multi-object image editing framework. MoEdit facilitates high-quality multi-object image editing in terms of style transfer, object reinvention, and background regeneration, while ensuring consistent quantity perception between inputs and outputs, even with a large number of objects. To achieve this, we introduce the Feature Compensation (FeCom) module, which ensures the distinction and separability of each object attribute by minimizing the in-between interlacing. Additionally, we present the Quantity Attention (QTTN) module, which perceives and preserves quantity consistency by effective control in editing, without relying on auxiliary tools. By leveraging the SD model, MoEdit enables customized preservation and modification of specific concepts in inputs with high quality. Experimental results demonstrate that our MoEdit achieves State-Of-The-Art (SOTA) performance in multi-object image editing. Data and codes will be available at this https URL.

Abstract (translated)

多对象图像在增强现实、广告设计和医学成像等多种实际场景中普遍存在。高效且精准地编辑这些图像对于上述应用至关重要。随着Stable Diffusion(SD)的出现,高质量的图像生成与编辑进入了一个新的时代。然而,现有的方法往往难以同时考虑每个对象的独立性和其作为整体图像的一部分的重要性,而这两种因素对保证一致的数量感知都至关重要,从而导致了次优的感知性能。 为了解决这些问题,我们提出了MoEdit——一种无辅助工具支持的多对象图像编辑框架。MoEdit使高质量的多对象图像编辑成为可能,包括风格转移、对象重新发明和背景再生,并确保输入与输出之间一致的数量感知,即使是在处理大量对象的情况下也是如此。为了实现这一点,我们引入了特征补偿(FeCom)模块,通过最小化中间交叉来保证每个对象属性的区别性和可分离性。此外,我们还提出了数量注意力(QTTN)模块,在编辑过程中有效控制以感知并保持数量的一致性,无需依赖辅助工具。 借助SD模型,MoEdit能够高质量地定制保存和修改输入中的特定概念。实验结果表明,我们的MoEdit在多对象图像编辑方面达到了最先进的性能水平。数据和代码将在以下链接提供:[此URL](请将括号内的内容替换为实际提供的网址)。

URL

https://arxiv.org/abs/2503.10112

PDF

https://arxiv.org/pdf/2503.10112.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot