Paper Reading AI Learner

Enhancing Facial Privacy Protection via Weakening Diffusion Purification

2025-03-13 13:27:53
Ali Salar, Qing Liu, Yingli Tian, Guoying Zhao

Abstract

The rapid growth of social media has led to the widespread sharing of individual portrait images, which pose serious privacy risks due to the capabilities of automatic face recognition (AFR) systems for mass surveillance. Hence, protecting facial privacy against unauthorized AFR systems is essential. Inspired by the generation capability of the emerging diffusion models, recent methods employ diffusion models to generate adversarial face images for privacy protection. However, they suffer from the diffusion purification effect, leading to a low protection success rate (PSR). In this paper, we first propose learning unconditional embeddings to increase the learning capacity for adversarial modifications and then use them to guide the modification of the adversarial latent code to weaken the diffusion purification effect. Moreover, we integrate an identity-preserving structure to maintain structural consistency between the original and generated images, allowing human observers to recognize the generated image as having the same identity as the original. Extensive experiments conducted on two public datasets, i.e., CelebA-HQ and LADN, demonstrate the superiority of our approach. The protected faces generated by our method outperform those produced by existing facial privacy protection approaches in terms of transferability and natural appearance.

Abstract (translated)

社交媒体的快速增长导致个人肖像图片广泛分享,这给自动面部识别(AFR)系统的大规模监控带来了严重的隐私风险。因此,保护面部隐私以防止未经授权的AFR系统至关重要。受到新兴扩散模型生成能力的启发,最近的方法使用扩散模型来生成对抗性人脸图像以实现隐私保护。然而,这些方法受到了扩散净化效应的影响,导致了较低的成功保护率(PSR)。在这篇论文中,我们首先提出了学习无条件嵌入以增强针对对抗性修改的学习容量,并利用它们引导对抗性潜在代码的修改,从而削弱扩散净化效应。此外,我们整合了一个保持身份特征的结构,在原始图像和生成图像之间维持结构性的一致性,使人类观察者能够识别出生成的图片与原图具有相同的个体身份。在两个公共数据集CelebA-HQ和LADN上进行的广泛实验表明了我们的方法的优越性。我们方法生成的受保护面孔在可迁移性和自然外观方面超过了现有的面部隐私保护方法。

URL

https://arxiv.org/abs/2503.10350

PDF

https://arxiv.org/pdf/2503.10350.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot