Paper Reading AI Learner

Enhancing Domain Diversity in Synthetic Data Face Recognition with Dataset Fusion

2025-07-22 17:36:48
Anjith George, Sebastien Marcel

Abstract

While the accuracy of face recognition systems has improved significantly in recent years, the datasets used to train these models are often collected through web crawling without the explicit consent of users, raising ethical and privacy concerns. To address this, many recent approaches have explored the use of synthetic data for training face recognition models. However, these models typically underperform compared to those trained on real-world data. A common limitation is that a single generator model is often used to create the entire synthetic dataset, leading to model-specific artifacts that may cause overfitting to the generator's inherent biases and artifacts. In this work, we propose a solution by combining two state-of-the-art synthetic face datasets generated using architecturally distinct backbones. This fusion reduces model-specific artifacts, enhances diversity in pose, lighting, and demographics, and implicitly regularizes the face recognition model by emphasizing identity-relevant features. We evaluate the performance of models trained on this combined dataset using standard face recognition benchmarks and demonstrate that our approach achieves superior performance across many of these benchmarks.

Abstract (translated)

虽然近年来面部识别系统的准确性有了显著提高,但用于训练这些模型的数据集通常是通过网络爬虫收集的,并未获得用户的明确同意,这引发了伦理和隐私方面的担忧。为了解决这个问题,许多近期的方法探索了使用合成数据来训练面部识别模型的可能性。然而,与基于真实世界数据训练的模型相比,这类方法通常表现较差。常见的限制是单个生成器模型通常用于创建整个合成数据集,导致特定于该模型的偏差和伪影,可能导致过度拟合到生成器本身的偏见和伪影上。 在本研究中,我们提出了一种解决方案,即结合使用两种最新的合成面部数据集,这些数据集是由架构不同的骨干网络生成的。这种融合减少了特定于模型的伪影,增强了姿态、光照及人口统计学方面的多样性,并通过强调与身份相关的特征隐式地对面部识别模型进行了正则化处理。 我们评估了在标准面部识别基准测试中使用该组合数据集训练的模型性能,并证明我们的方法在此类基准中的表现明显优于其他方法。

URL

https://arxiv.org/abs/2507.16790

PDF

https://arxiv.org/pdf/2507.16790.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot