Paper Reading AI Learner

Detecting Localized Deepfakes: How Well Do Synthetic Image Detectors Handle Inpainting?

2025-12-18 15:54:51
Serafino Pandolfini, Lorenzo Pellegrini, Matteo Ferrara, Davide Maltoni

Abstract

The rapid progress of generative AI has enabled highly realistic image manipulations, including inpainting and region-level editing. These approaches preserve most of the original visual context and are increasingly exploited in cybersecurity-relevant threat scenarios. While numerous detectors have been proposed for identifying fully synthetic images, their ability to generalize to localized manipulations remains insufficiently characterized. This work presents a systematic evaluation of state-of-the-art detectors, originally trained for the deepfake detection on fully synthetic images, when applied to a distinct challenge: localized inpainting detection. The study leverages multiple datasets spanning diverse generators, mask sizes, and inpainting techniques. Our experiments show that models trained on a large set of generators exhibit partial transferability to inpainting-based edits and can reliably detect medium- and large-area manipulations or regeneration-style inpainting, outperforming many existing ad hoc detection approaches.

Abstract (translated)

生成式人工智能的迅速进步使得高度逼真的图像操纵成为可能,包括修复绘画(inpainting)和区域级别的编辑。这些方法保留了大部分原始视觉上下文,并且在网络安全相关的威胁场景中被越来越多地利用。虽然已经提出了多种用于识别完全合成图像的检测器,但它们对局部修改的泛化能力尚未充分表征。这项工作系统性地评估了最先进的检测器,在其原本用于深度伪造图像检测的基础上,当应用于不同的挑战时的表现:即局部修复绘画(inpainting)的检测。该研究利用了涵盖多种生成模型、遮罩大小和修复技术的多个数据集。我们的实验表明,基于大量生成模型训练出的模型在面对基于修复绘画的编辑时表现出部分可转移性,并且能够可靠地检测到中等面积和大面积的人为改动或再生风格的修复绘画,优于许多现有的临时检测方法。

URL

https://arxiv.org/abs/2512.16688

PDF

https://arxiv.org/pdf/2512.16688.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot