Abstract
Current clothes-changing person re-identification (re-id) approaches usually perform retrieval based on clothes-irrelevant features, while neglecting the potential of clothes-relevant features. However, we observe that relying solely on clothes-irrelevant features for clothes-changing re-id is limited, since they often lack adequate identity information and suffer from large intra-class variations. On the contrary, clothes-relevant features can be used to discover same-clothes intermediaries that possess informative identity clues. Based on this observation, we propose a Feasibility-Aware Intermediary Matching (FAIM) framework to additionally utilize clothes-relevant features for retrieval. Firstly, an Intermediary Matching (IM) module is designed to perform an intermediary-assisted matching process. This process involves using clothes-relevant features to find informative intermediates, and then using clothes-irrelevant features of these intermediates to complete the matching. Secondly, in order to reduce the negative effect of low-quality intermediaries, an Intermediary-Based Feasibility Weighting (IBFW) module is designed to evaluate the feasibility of intermediary matching process by assessing the quality of intermediaries. Extensive experiments demonstrate that our method outperforms state-of-the-art methods on several widely-used clothes-changing re-id benchmarks.
Abstract (translated)
通常，基于衣物无关特征的当前人物识别（RE-ID）方法忽略了衣物相关特征的潜力。然而，我们观察到仅依赖衣物无关特征进行衣物RE-ID是有限的，因为它们通常缺乏足够的身份信息并受到类内变化的影响。相反，衣物相关特征可以用于发现具有有用身份提示的同款衣物中介。基于这一观察，我们提出了一个可行性感知的中介匹配（FAIM）框架，以进一步利用衣物相关特征进行检索。 首先，设计了一个中介匹配（IM）模块，执行中间人辅助匹配过程。这一过程涉及使用衣物相关特征找到有用的中介，然后使用这些中介的衣物无关特征完成匹配。 其次，为了减少低质量中介对匹配过程的负面影响，设计了一个基于中介的中性可行性加权（IBFW）模块，通过评估中介的质量来评估匹配过程的可行性。 丰富的实验证明，我们的方法在多个广泛使用的衣物RE-ID基准测试中超越了最先进的方法。
URL
https://arxiv.org/abs/2404.09507
