Paper Reading AI Learner

Generalized Single-Image-Based Morphing Attack Detection Using Deep Representations from Vision Transformer

2025-01-16 20:09:19
Haoyu Zhang, Raghavendra Ramachandra, Kiran Raja, Christoph Busch

Abstract

Face morphing attacks have posed severe threats to Face Recognition Systems (FRS), which are operated in border control and passport issuance use cases. Correspondingly, morphing attack detection algorithms (MAD) are needed to defend against such attacks. MAD approaches must be robust enough to handle unknown attacks in an open-set scenario where attacks can originate from various morphing generation algorithms, post-processing and the diversity of printers/scanners. The problem of generalization is further pronounced when the detection has to be made on a single suspected image. In this paper, we propose a generalized single-image-based MAD (S-MAD) algorithm by learning the encoding from Vision Transformer (ViT) architecture. Compared to CNN-based architectures, ViT model has the advantage on integrating local and global information and hence can be suitable to detect the morphing traces widely distributed among the face region. Extensive experiments are carried out on face morphing datasets generated using publicly available FRGC face datasets. Several state-of-the-art (SOTA) MAD algorithms, including representative ones that have been publicly evaluated, have been selected and benchmarked with our ViT-based approach. Obtained results demonstrate the improved detection performance of the proposed S-MAD method on inter-dataset testing (when different data is used for training and testing) and comparable performance on intra-dataset testing (when the same data is used for training and testing) experimental protocol.

Abstract (translated)

面部变形攻击已经对应用于边境控制和护照发放等场景的面部识别系统(FRS)构成了严重威胁。为此,需要开发能够防御此类攻击的面部变形检测算法(MAD)。这些算法必须足够稳健以处理开放集场景中的未知攻击,其中攻击可能源自多种不同的生成方法、后处理过程以及打印机/扫描仪的多样性。当仅基于一张疑似图像进行判断时,泛化问题更为突出。 本文提出了一种基于单张图片的通用面部变形检测(S-MAD)算法,并通过从视觉变压器(ViT)架构中学习编码来实现这一目标。与基于CNN的架构相比,ViT模型在整合局部和全局信息方面具有优势,因此更适于检测广泛分布在脸部区域中的变形痕迹。 我们在使用公开可用的FRGC面部数据集生成的脸部变形数据集上进行了广泛的实验,并将包括已公开评估在内的几种最先进的(SOTA)MAD算法与我们的基于ViT的方法进行了基准测试。结果表明,在跨数据集测试(即训练和测试使用的数据不同)时,所提出的S-MAD方法表现出改进的检测性能;在同数据集测试(即使用相同的数据进行训练和测试)时,则具有相当的检测性能。

URL

https://arxiv.org/abs/2501.09817

PDF

https://arxiv.org/pdf/2501.09817.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot