Paper Reading AI Learner

Identifying Physically Realizable Triggers for Backdoored Face Recognition Networks

2025-06-24 11:36:27
Ankita Raj, Ambar Pal, Chetan Arora

Abstract

Backdoor attacks embed a hidden functionality into deep neural networks, causing the network to display anomalous behavior when activated by a predetermined pattern in the input Trigger, while behaving well otherwise on public test data. Recent works have shown that backdoored face recognition (FR) systems can respond to natural-looking triggers like a particular pair of sunglasses. Such attacks pose a serious threat to the applicability of FR systems in high-security applications. We propose a novel technique to (1) detect whether an FR network is compromised with a natural, physically realizable trigger, and (2) identify such triggers given a compromised network. We demonstrate the effectiveness of our methods with a compromised FR network, where we are able to identify the trigger (e.g., green sunglasses or red hat) with a top-5 accuracy of 74%, whereas a naive brute force baseline achieves 56% accuracy.

Abstract (translated)

后门攻击将隐藏功能嵌入深度神经网络,使得当输入触发器(Trigger)中包含预设模式时,该网络会表现出异常行为;而在其他情况下,则在网络的公开测试数据上表现良好。最近的研究表明,被植入后门的人脸识别系统会对一些自然存在的触发器做出响应,例如特定的一副太阳镜。此类攻击对人脸识别系统的高安全性应用构成了严重威胁。 我们提出了一种新的技术方法来: 1. 检测一个人脸识别网络是否被一种自然、可物理实现的触发器所侵入; 2. 在一个已经遭到入侵的人脸识别系统中,找出这样的触发器。 通过使用一个已被植入后门的人脸识别系统作为案例,我们能够以74%的准确率识别出具体的触发器(例如绿色太阳镜或红色帽子),而相比之下,一种简单的暴力破解基线方法只能达到56%的准确度。

URL

https://arxiv.org/abs/2506.19533

PDF

https://arxiv.org/pdf/2506.19533.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot