Paper Reading AI Learner

Illumination Variation Correction Using Image Synthesis For Unsupervised Domain Adaptive Person Re-Identification

2023-01-23 20:11:24
Jiaqi Guo, Amy R. Reibman, Edward J. Delp

Abstract

Unsupervised domain adaptive (UDA) person re-identification (re-ID) aims to learn identity information from labeled images in source domains and apply it to unlabeled images in a target domain. One major issue with many unsupervised re-identification methods is that they do not perform well relative to large domain variations such as illumination, viewpoint, and occlusions. In this paper, we propose a Synthesis Model Bank (SMB) to deal with illumination variation in unsupervised person re-ID. The proposed SMB consists of several convolutional neural networks (CNN) for feature extraction and Mahalanobis matrices for distance metrics. They are trained using synthetic data with different illumination conditions such that their synergistic effect makes the SMB robust against illumination variation. To better quantify the illumination intensity and improve the quality of synthetic images, we introduce a new 3D virtual-human dataset for GAN-based image synthesis. From our experiments, the proposed SMB outperforms other synthesis methods on several re-ID benchmarks.

Abstract (translated)

无监督领域自适应(UDA)的人重识别(re-ID)旨在从源 domains 中的标记图像中学习身份信息,并将其应用于目标 domains 中的未标记图像。许多无监督重识别方法的一个主要问题是它们在大型领域变化方面的表现不如其他变化因素如光照、视角和遮挡。在本文中,我们提出了一种合成模型库(SMB),以处理无监督的人重识别光照变化。该 proposed SMB 由多个卷积神经网络(CNN)用于特征提取和马氏矩阵用于距离度量。使用不同的合成数据进行训练,使其协同作用使得 SMB 对光照变化具有鲁棒性。为了更准确地量化光照强度并提高合成图像的质量,我们介绍了基于GAN的图像合成新的三维虚拟人类数据集。从我们的实验中,该 proposed SMB 在多个重识别基准上比其他合成方法表现更好。

URL

https://arxiv.org/abs/2301.09702

PDF

https://arxiv.org/pdf/2301.09702.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot