Paper Reading AI Learner

Beyond black and white: A more nuanced approach to facial recognition with continuous ethnicity labels

2025-06-02 10:49:36
Pedro C. Neto, Naser Damer, Jaime S. Cardoso, Ana F. Sequeira

Abstract

Bias has been a constant in face recognition models. Over the years, researchers have looked at it from both the model and the data point of view. However, their approach to mitigation of data bias was limited and lacked insight on the real nature of the problem. Here, in this document, we propose to revise our use of ethnicity labels as a continuous variable instead of a discrete value per identity. We validate our formulation both experimentally and theoretically, showcasing that not all identities from one ethnicity contribute equally to the balance of the dataset; thus, having the same number of identities per ethnicity does not represent a balanced dataset. We further show that models trained on datasets balanced in the continuous space consistently outperform models trained on data balanced in the discrete space. We trained more than 65 different models, and created more than 20 subsets of the original datasets.

Abstract (translated)

偏见一直是面部识别模型中的一个持续问题。多年来,研究人员从模型和数据两个角度对此进行了研究。然而,他们缓解数据偏差的方法是有限的,并且缺乏对问题本质的理解。在此文档中,我们提出将种族标签作为连续变量而非每个身份的一个离散值来使用。我们通过实验和理论验证了我们的方法,展示了来自同一族裔的不同身份对于数据集平衡的贡献并不相同;因此,拥有相同比例的各族裔身份并不代表一个均衡的数据集。此外,我们还证明在连续空间中平衡的数据集上训练出的模型始终优于在离散空间中平衡的数据集上训练出的模型。为了支持这一结论,我们训练了超过65种不同的模型,并创建了原始数据集的20多个子集。

URL

https://arxiv.org/abs/2506.01532

PDF

https://arxiv.org/pdf/2506.01532.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot