Paper Reading AI Learner

FROQ: Observing Face Recognition Models for Efficient Quality Assessment

2025-09-22 12:29:44
\v{Z}iga Babnik, Deepak Kumar Jain, Peter Peer, Vitomir \v{S}truc

Abstract

Face Recognition (FR) plays a crucial role in many critical (high-stakes) applications, where errors in the recognition process can lead to serious consequences. Face Image Quality Assessment (FIQA) techniques enhance FR systems by providing quality estimates of face samples, enabling the systems to discard samples that are unsuitable for reliable recognition or lead to low-confidence recognition decisions. Most state-of-the-art FIQA techniques rely on extensive supervised training to achieve accurate quality estimation. In contrast, unsupervised techniques eliminate the need for additional training but tend to be slower and typically exhibit lower performance. In this paper, we introduce FROQ (Face Recognition Observer of Quality), a semi-supervised, training-free approach that leverages specific intermediate representations within a given FR model to estimate face-image quality, and combines the efficiency of supervised FIQA models with the training-free approach of unsupervised methods. A simple calibration step based on pseudo-quality labels allows FROQ to uncover specific representations, useful for quality assessment, in any modern FR model. To generate these pseudo-labels, we propose a novel unsupervised FIQA technique based on sample perturbations. Comprehensive experiments with four state-of-the-art FR models and eight benchmark datasets show that FROQ leads to highly competitive results compared to the state-of-the-art, achieving both strong performance and efficient runtime, without requiring explicit training.

Abstract (translated)

人脸识别(FR)在许多关键应用中扮演着重要角色,识别过程中的错误可能导致严重后果。人脸图像质量评估(FIQA)技术通过提供面部样本的质量估计来增强人脸识别系统,使得系统能够丢弃不适合可靠识别或导致低置信度识别决策的样本。 大多数最新的FIQA技术依赖于广泛的监督训练以实现准确的质量估算。相比之下,无监督技术消除了对额外训练的需求,但往往运行较慢且通常表现出较低性能。在本文中,我们介绍了一种半监督、无需训练的方法FROQ(Face Recognition Observer of Quality),该方法利用给定人脸识别模型中的特定中间表示来估计人脸图像的质量,并结合了基于监督FIQA模型的效率和无监督方法的免训特性。 通过基于伪质量标签的简单校准步骤,FROQ能够揭示任何现代人脸识别模型中对质量评估有用的特定表示。为了生成这些伪标签,我们提出了一种基于样本扰动的新颖无监督FIQA技术。在四个最先进的FR模型和八个基准数据集上进行的全面实验表明,与现有方法相比,FROQ可以实现高度竞争的结果,在不需显式训练的情况下同时提供强大的性能和高效的运行时间。

URL

https://arxiv.org/abs/2509.17689

PDF

https://arxiv.org/pdf/2509.17689.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot