https://blog.csdn.net/NGUever15/article/details/110232271CSDN小样本学习与智能前沿微信公众号

【VSA】One-shot video-based person re-identification with variance subsampling algorithm

针对现有工作中存在的错误伪标签问题,文章通过优化样本间的相似性度量和伪标签置信度评估策略来改善这个问题,从而提供模型性能。具体地,文章提出了方差置信度的概念,并设计了方差二次采样算法将方差置信度和距离置信度结合起来作为采样准则,同时还提出了方差衰减策略来更好了优化选择出来的伪标签样本。最终,该方法将MARS数据集上的mAP和Rank1分别提高了 3.94%和4.55%。

文章目录

导言
针对现有工作中存在的错误伪标签问题,文章通过优化样本间的相似性度量和伪标签置信度评估策略来改善这个问题,从而提供模型性能。具体地,文章提出了方差置信度的概念,并设计了方差二次采样算法将方差置信度和距离置信度结合起来作为采样准则,同时还提出了方差衰减策略来更好了优化选择出来的伪标签样本。最终,该方法将MARS数据集上的mAP和Rank1分别提高了 3.94%和4.55%。

引用

@article{DBLP:journals/jvca/ZhaoYYHYZ20,
author = {Jing Zhao and
Wenjing Yang and
Mingliang Yang and
Wanrong Huang and
Qiong Yang and
Hongguang Zhang},
title = {One-shot video-based person re-identification with variance subsampling
algorithm},
journal = {Comput. Animat. Virtual Worlds},
volume = {31},
number = {4-5},
year = {2020}
}

解决了什么问题

Previous works propose the distance-based sampling for unlabeled datapoints to address the few-shot person re-identification task, however, many selected samples may be assigned with wrong labels due to poor feature quality in these works, which negatively affects the learning procedure.

主要贡献和创新点

在这里插入图片描述

  • We propose the variance confidence to measure the credibility of pseudo-labels, which can be widely used as a general similarity measurement.
  • We propose a novel VSA(variance subsampling algorithm) to improve the accuracy of pseudo-labels for selected samples. It combines distance confidence and variance confidence as the sampling criterion, and adopt a variance decay strategy as the sampling strategy.

创新点主要有三个:

  • 一是提出了方差置信度(variance confidence)的概念
  • 二是提出了VSA(方差二次采样算法)
  • 三是提出了方差衰减策略(variance decay strategy)。

基本框架

在这里插入图片描述
The dataset extension process. Both labeled and unlabeled samples are extracted into the feature space through the backbone network in step 1. As shown in feature space (a), the gray points indicate unlabeled samples, and the colored hollow points indicate labeled samples. Different colors indicate different person identity. Then label estimation is performed according to the criterion that the unlabeled sample has the same label as the nearest labeled sample in step 2. We call the sample after label estimation a pseudo-label sample, which is the colored solid point in the feature space (b). Finally, the pseudo-label samples with higher confidence are preferred, which are closer to the labeled samples in feature space ©

整体框架采用监督训练和数据扩展交叉迭代进行的模式。数据扩展的过程如上图所示,具体包括了特征提取、标签估计和伪标签样本采样三个环节。

提出的方法

01 variance confidence方差置信度

在这里插入图片描述A distribution situation in the feature space. U1 and U2 represent two unlabeled samples, and L1 and L2 are the two labeled samples with the closest distance to both U1 and U2 in the feature space. di,i∈[1,4], represent the Euclidean distance between samples and satisfy Equation (7). The solid line represents the distance between the unlabeled sample and its nearest labeled sample. While U1 is similar to L1, it is also similar to L2 with the same extent. On the contrary, although U2 is slightly similar to L1, it is very different from L2. Therefore, it is more believable that U2 is more likely than U1 to fall into the same category as L1

作者举例了特征空间中的一种分布情况。 U1和U2是无标注样本,L1和L2是距离U1和U2最近的带标注样本。di表示样本之间的欧几里得距离,且满足d 1 < d 2 < d 3 < d 4 d_1<d_2<d_3<d_4d1<d2<d3<d4。 如果仅根据距离来度量样本标签的可靠性的话,那U1优于U2(因为d1<d3)。 但作者认为,当一个样本(U1)同时和两个不同的样本(L1和L2)相似的时候(d1和d2相差很小),那这个样本就谁都不像了。

作者用无标签样本与其距离最近的两个带标注样本的距离方差来表示方差置信度,且方差越大,置信度越高。

02 Variance Subsampling Algorithm 方差二次采样算法

在这里插入图片描述

The sampling criterion of variance subsampling algorithm. Hollow points in the feature space represent labeled samples, and solid points represent pseudo-label samples. The first sampling is based on the distance confidence. The number of sampling is extended to e, corresponding to the range of the red squares and circles in the figure. The second sampling is based on the variance confidence, and the number of samples is restored to ns, which corresponds to the range of the yellow box and the circle in the figure.

作者通过二次采样的形式,将距离置信度和方差置信度结合了起来,作为采样准则。

03 Variance decay strategy 方差衰减策略

在这里插入图片描述
The partial distribution of the real feature space. Colors is used to distinguish different people identity, and shapes is used to distinguish the camera. Black dots in the center of the sample indicate that this is the original labeled sample. The distribution in the first iteration is relatively uniform, while the distribution after the seventh iteration has shown a clustering distribution

作者在实验过程中可视化了特征空间的真实分布情况。 发现模型训练到中后期时,提取出的特征空间已经呈现出了聚类分布。

Obviously, in the case of the feature distribution of model 7 in Figure 5, the situation described in Figure 3 will hardly occur. This shows that the situation described in Figure 3 is gradually reduced during the iteration process. Therefore, a variance decay strategy is proposed as the sampling strategy. A stopping factor 𝜂 is taken to control the number of steps in which the variance confidence is disabled. In addition, 𝜖 is also set to be variable and calculated by Equation (13).
在这里插入图片描述

聚类分布形成的情况下, 方差置信度将不再适用,因此作者提出了方差衰减策略

整体的算法:
在这里插入图片描述

实验

01 性能

在这里插入图片描述

Our method is evaluated on the MARS and DukeMTMC-VideoReID dataset, and compared with recent related works including the baseline work EUG.10 Table 1 reports the final results of different methods. One-shot refers to the experimental results obtained by supervised learning on the labeled dataset L only. DGM9 and SMP8 do not train their model in crossiterative manner. The results demonstrate that our method performs better than EUG on both the two datasets. Specifically, our mAP, Rank-1, Rank5, and Rank20 on the MARS dataset are 38.62%,62.17%,74.34%, and 83.43%, which surpasses the baseline10 by 3.94%, 4.55%, 4.70%, and 5.35%, respectively. Though we outperform10 on the four types of accuracy, the benefits of our method on DukeMTMC-VideoReID dataset is lower than the improvements on MARS dataset as the number of unlabeled samples in the DukeMTMC-VideoReID dataset is merely 1/5 of that in MARS dataset, which reduce the impacts of using sampling strategies.

02 Ablation - sampling criterions

在这里插入图片描述
We compared the number of error labels contained in the selected pseudo-label samples under different sampling strategies. Specifically, there are 1,494 unlabeled samples in the DukeMTMC-VideoReID dataset, of which 663 samples have correct labels after label estimation. As shown in Figure 7, the colored bar is where the wrong label is located. Among the 300 samples, 29 samples have error labels according to distance confidence only and 19 samples have error labels according to the variance confidence only, respectively. When we combine distance confidence and variance confidence as a two-round sampling criterion, the number of erroneous labels drops to 16, which means that the accuracy of selected sample labels is improved to 95% (90% with the distance confidence only). The result effectively illustrates that the VSA does effectively reduce the number of wrong labels in the selected samples.

将距离置信度和方差置信度结合起来,有效地提高了采样出来的为标签样本的标签准确率

小样本学习与智能前沿
小样本学习与智能前沿

专注于小样本学习、迁移学习、领域自适应等技术在自然语言处理、计算机视觉等人工智能领域中的应用分析。

理论Re-IDOne-shot
1
相关数据
欧几里得距离技术

在数学中,欧几里得距离或欧几里得度量是欧几里得空间中两点间“普通”(即直线)距离。 使用这个距离,欧氏空间成为度量空间。

准确率技术

分类模型的正确预测所占的比例。在多类别分类中,准确率的定义为:正确的预测数/样本总数。 在二元分类中,准确率的定义为:(真正例数+真负例数)/样本总数

聚类技术

将物理或抽象对象的集合分成由类似的对象组成的多个类的过程被称为聚类。由聚类所生成的簇是一组数据对象的集合,这些对象与同一个簇中的对象彼此相似,与其他簇中的对象相异。“物以类聚,人以群分”,在自然科学和社会科学中,存在着大量的分类问题。聚类分析又称群分析,它是研究(样品或指标)分类问题的一种统计分析方法。聚类分析起源于分类学,但是聚类不等于分类。聚类与分类的不同在于,聚类所要求划分的类是未知的。聚类分析内容非常丰富,有系统聚类法、有序样品聚类法、动态聚类法、模糊聚类法、图论聚类法、聚类预报法等。

推荐文章
暂无评论
暂无评论~