Paper Reading AI Learner

Towards Generalized Proactive Defense against Face Swappingwith Contour-Hybrid Watermark

2025-05-25 10:29:23
Ruiyang Xia, Dawei Zhou, Decheng Liu, Lin Yuan, Jie Li, Nannan Wang, Xinbo Gao

Abstract

Face swapping, recognized as a privacy and security concern, has prompted considerable defensive research. With the advancements in AI-generated content, the discrepancies between the real and swapped faces have become nuanced. Considering the difficulty of forged traces detection, we shift the focus to the face swapping purpose and proactively embed elaborate watermarks against unknown face swapping techniques. Given that the constant purpose is to swap the original face identity while preserving the background, we concentrate on the regions surrounding the face to ensure robust watermark generation, while embedding the contour texture and face identity information to achieve progressive image determination. The watermark is located in the facial contour and contains hybrid messages, dubbed the contour-hybrid watermark (CMark). Our approach generalizes face swapping detection without requiring any swapping techniques during training and the storage of large-scale messages in advance. Experiments conducted across 8 face swapping techniques demonstrate the superiority of our approach compared with state-of-the-art passive and proactive detectors while achieving a favorable balance between the image quality and watermark robustness.

Abstract (translated)

面部替换,作为一种隐私和安全问题,已经引起了大量防御性研究的关注。随着人工智能生成内容的进步,真实人脸与被替换后的人脸之间的差异变得更加微妙。鉴于伪造痕迹检测的难度,我们将重点转移到面部替换的目的上,并主动嵌入复杂的水印以对抗未知的面部替换技术。考虑到面部替换的主要目的是在保持背景不变的情况下更换原始面部身份,我们专注于面部周围的区域来确保生成稳健的水印,同时嵌入口轮纹理和面部识别信息,实现渐进式图像判定。该水印位于面部轮廓中,并包含混合消息,被称为轮廓混合水印(CMark)。我们的方法可以泛化面部替换检测,在训练过程中不需要任何特定的替换技术,也不需要提前存储大规模的消息。 实验在八种不同的面部替换技术上进行,证明了我们方法相较于现有的被动和主动检测器具有优越性,同时实现了图像质量和水印稳健性的良好平衡。

URL

https://arxiv.org/abs/2505.19081

PDF

https://arxiv.org/pdf/2505.19081.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot