基于局部语义特征不变性的跨域行人重识别

doi:10.13700/j.bh.1001-5965.2020.0072

北京航空航天大学学报 ›› 2020, Vol. 46 ›› Issue (9): 1682-1690.doi: 10.13700/j.bh.1001-5965.2020.0072

基于局部语义特征不变性的跨域行人重识别

张晓伟, 吕明强, 李慧

青岛大学计算机科学技术学院, 青岛 266071

收稿日期:2020-03-02 发布日期:2020-09-22
通讯作者: 张晓伟 E-mail:by1306114@buaa.edu.cn
作者简介:张晓伟男,博士,讲师。主要研究方向:图像/视频分析和理解、计算机视觉和机器学习;吕明强男,本科生。主要研究方向:行人重识别;李慧女,硕士研究生。主要研究方向:行人重识别和计算机视觉。
基金资助:
国家自然科学基金（61902204）；山东省自然科学基金（ZR2019BF028）

Cross-domain person re-identification based on partial semantic feature invariance

ZHANG Xiaowei, LYU Mingqiang, LI hui

College of Computer Science and Technology, Qingdao University, Qingdao 266071, China

Received:2020-03-02 Published:2020-09-22
Supported by:
National Natural Science Foundation of China (61902204); Natural Science Foundation of Shandong Province of China (ZR2019BF028)

摘要/Abstract

摘要： 行人重识别是刑侦案件中重要的侦查手段，而跨域是行人重识别的主要挑战之一，也是制约其实际应用的瓶颈问题。在带标签的源域和无标签的目标域学习跨域行人局部语义不变性特征模型。首先，在源域上通过只含有行人标识无部件标签的监督学习方式学习行人的各部件特征，并在源域和目标域上采用无监督学习方式对齐行人部件。然后，基于对齐后的行人全局与局部特征，引入特征模板池存储对齐后的目标域全局和局部特征，并设计了跨域不变性损失函数进行特征不变性约束，提高行人重识别的跨域适应能力。最后，在Market-1501、DukeMTMC-reID和MSMT17数据集之间开展了跨域行人重识别验证实验，实验结果表明，所提方法在跨域行人重识别上取得了显著的性能提升。

关键词: 行人重识别, 全局特征, 局部特征, 语义对齐, 特征模板池, 跨域不变性

Abstract: Cross-domain is one of the main challenges of person re-identification which is an important investigative method in criminal investigation cases, and that restricts the practical application of re-identification. In this paper, cross-domain invariance feature model based on pedestrian partial semantics is learned from the labeled source domain and the unlabeled target domain. First, features of person parts are learned by supervised learning with only pedestrian signs without labels of parts, and pedestrian parts are aligned by unsupervised learning in the source and target domains. Second, based on the aligned global and local features, feature template pooling is introduced to store the aligned global and local partial features of the target domain, and cross-domain invariance loss function is designed for feature invariance constraints to improve the cross-domain adaptability of person re-identification. Finally, verification experiments of cross-domain person re-identification are conducted on the Market-1501, DukeMTMC-reID and MSMT17 datasets. The experiment results show that the proposed method achieves significant performance improvements in cross-domain person re-identification.

Key words: person re-identification, global feature, local feature, semantic alignment, feature template pooling, cross-domain invariance

中图分类号:

TP37
TP277

张晓伟, 吕明强, 李慧. 基于局部语义特征不变性的跨域行人重识别[J]. 北京航空航天大学学报, 2020, 46(9): 1682-1690.

ZHANG Xiaowei, LYU Mingqiang, LI hui. Cross-domain person re-identification based on partial semantic feature invariance[J]. Journal of Beijing University of Aeronautics and Astronautics, 2020, 46(9): 1682-1690.

参考文献

[1] ZHENG L,YANG Y,HAUPTMANN A G.Person re-identification:Past,present and future[EB/OL].(2016-10-10)[2020-03-01].https://arxiv.org/abs/1610.02984.
[2] 田萱,王亮,丁琪.基于深度学习的图像语义分割方法综述[J].软件学报,2019,30(2):440-468.TIAN X,WANG L,DING Q.Review of image semantic segmentation based on deep learning[J].Journal of Software,2019,30(2):440-468(in Chinese).
[3] HAN C C,YE J C,ZHONG Y S,et al.Re-ID driven localization refinement for person search[C]//IEEE International Conference on Computer Vision.Piscataway:IEEE Press,2019:9814-9823.
[4] VARIOR R R,HALOI M,WANG G.Gated Siamese convolutional neural network architecture for human re-identiflcation[C]//IEEE Conference on Computer Vision and Pattern Recognition.Piscataway:IEEE Press,2016:791-808.
[5] CHENG D,GONG Y H,ZHOU S P,et al.Person re-identiflcation by multi-channel parts-based CNN with improved triplet loss function[C]//IEEE Conference on Computer Vision and Pattern Recognition.Piscataway:IEEE Press,2016:1335-1344.
[6] ZHENG Z D,ZHENG L,YANG Y.Unlabeled samples generated by GAN improve the person re-identification baseline in vitro[C]//IEEE International Conference on Computer Vision.Piscataway:IEEE Press,2017:3754-3762.
[7] WEN Y,ZHANG K,LI Z F,et al.A discriminative feature learning approach for deep face recognition[C]//IEEE Conference on Computer Vision and Pattern Recognition.Piscataway:IEEE Press,2016:499-515.
[8] 蔡轶珩,王雪艳,胡绍斌,等.基于多源图像弱监督学习的3D人体姿态估计[J].北京航空航天大学学报,2019,45(12):2375-2384.CAI Y H,WANG X Y,HU S B,et al.Three-dimensional human pose estimation based on multi-source image weakly-supervised learning[J].Journal of Beijing University of Aeronautics and Astronautics,2019,45(12):2375-2384(in Chinese).
[9] CAO Z,SIMON T,WEI S E,et al.Realtime multi-person 2D pose estimation using part affinity fields[C]//IEEE Conference on Computer Vision and Pattern Recognition.Piscataway:IEEE Press,2017:7291-7299.
[10] WEI S E,RAMAKRISHNA V,KANADE T,et al.Convolutional pose machines[C]//IEEE Conference on Computer Vision and Pattern Recognition.Piscataway:IEEE Press,2016:4724-4732.
[11] 郭琳,秦世引.遥感图像飞机目标高效搜检深度学习优化算法[J].北京航空航天大学学报,2019,45(1):159-173.GUO L,QIN S Y.Deep learning and optimization algorithm for high efficient searching and detection of aircraft targets in remote sensing images[J].Journal of Beijing University of Aeronautics and Astronautics,2019,45(1):159-173(in Chinese).
[12] ZHENG L,HUANG Y,LU H,et al.Pose invariant embedding for deep person re-identification[J].IEEE Transactions on Image Processing,2019,28(9):4500-4509.
[13] SU C,LI J,ZHANG S,et al.Posedriven deep convolutional model for person re-identification[C]//IEEE International Conference on Computer Vision.Piscataway:IEEE Press,2017:3960-3969.
[14] WEI L,ZHANG S,YAO H,et al.GLAD:Global-local-alignment descriptor for pedestrian retrieval[C]//ACM International Conference on Multimedia.New York:ACM,2017:420-428.
[15] YAO H,ZHANG S,HONG R,et al.Deep representation learning with part loss for person re-identification[J].IEEE Transactions on Image Processing,2019,28(6):2860-2871.
[16] SUN Y F,XU Q,LI Y L,et al.Perceive where to focus:Learning visibility-aware part-level features for partial person re-identification[C]//IEEE Conference on Computer Vision and Pattern Recognition.Piscataway:IEEE Press,2019:393-402.
[17] SUN Y F,ZHENG L,YANG Y,et al.Beyond part models:Person retrieval with refined part pooling[C]//European Conference on Computer Vision.Berlin:Springer,2019:480-496.
[18] LIU X,ZHAO H,TIAN M,et al.HydraPlus-Net:Attentive deep features for pedestrian analysis[C]//IEEE International Conference on Computer Vision.Piscataway:IEEE Press,2017:350-359.
[19] ZHAO L,LI X,WANG J,et al.Deeply-learned part-aligned representations for person re-identification[C]//IEEE International Conference on Computer Vision.Piscataway:IEEE Press,2017:3219-3228.
[20] CHEN T L,DING S J,XIE J Y,et al.ABD-Net:Attentive but diverse person re-identification[C]//IEEE International Conference on Computer Vision.Piscataway:IEEE Press,2019:8351-8361.
[21] LI W,ZHU X T,GONG S G,et al.Harmonious attention network for person re-identification[C]//IEEE Conference on Computer Vision and Pattern Recognition.Piscataway:IEEE Press,2018:2285-2294.
[22] SUN X X,ZHENG L.Dissecting person re-identification from the viewpoint of viewpoint[C]//IEEE Conference on Computer Vision and Pattern Recognition.Piscataway:IEEE Press,2019:608-617.
[23] ZHENG Z D,YANG X D,YU Z D,et al.Joint discriminative and generative learning for person re-identification[C]//IEEE Conference on Computer Vision and Pattern Recognition.Piscataway:IEEE Press,2019:2138-2147.
[24] LUO Y W,ZHENG L,GUAN T,et al.Taking a closer look at domain shift:Category-level adversaries for semantics consistent domain adaptation[C]//IEEE Conference on Computer Vision and Pattern Recognition.Piscataway:IEEE Press,2019:2507-2516.
[25] HE K M,ZHANG X Y,REN S Q,et al.Deep residual learning for image recognition[C]//IEEE Conference on Computer Vision and Pattern Recognition.Piscataway:IEEE Press,2016:770-778.
[26] DONG X Y,YANG Y.Searching for a robust neural architecture in four GPU hours[C]//IEEE Conference on Computer Vision and Pattern Recognition.Piscataway:IEEE Press,2019:1761-1770.
[27] FAN H H,ZHENG L,YAN C G,et al.Unsupervised person re-identification:Clustering and finetuning[J].ACM Transactions on Multimedia Computing,Communications,and Applications,2018,14(4):1-18.
[28] YU H X,WU A C,ZHENG W S.Crossview asymmetric metric learning for unsupervised person re-identification[C]//IEEE International Conference on Computer Vision.Piscataway:IEEE Press,2017:994-1002.
[29] DENG W J,ZHENG L,YE Q X,et al.Image-image domain adaptation with preserved self-similarity and domain-dissimilarity for person re-identification[C]//IEEE Conference on Computer Vision and Pattern Recognition.Piscataway:IEEE Press,2018:994-1003.
[30] WEI L H,ZHANG S J,GAO W,et al.Person transfer GAN to bridge domain gap for person re-identification[C]//IEEE Conference on Computer Vision and Pattern Recognition.Piscataway:IEEE Press,2018:79-88.
[31] BAK S,CARR P,LALONDE J F.Domain adaptation through synthesis for unsupervised person re-identification[C]//European Conference on Computer Vision.Berlin:Springer,2018:189-205.
[32] WANG J Y,ZHU X T,GONG S G,et al.Transferable joint attribute-identity deep learning for unsupervised person re-identification[C]//IEEE Conference on Computer Vision and Pattern Recognition.Piscataway:IEEE Press,2018:2275-2284.
[33] LIN S,LI H L,LI C T,et al.Multi-task mid-level feature alignment network for unsupervised cross-dataset person re-identification[C]//British Machine Vision Conference.Berlin:Springer,2018:1-13.
[34] ZHONG Z,ZHENG L,ZHENG Z D,et al.Camera style adaptation for person re-identification[C]//IEEE Conference on Computer Vision and Pattern Recognition.Piscataway:IEEE Press,2018:5157-5166.
[35] YU H X,ZHENG W S,WU A C,et al.Unsupervised person re-identification by soft multilabel learning[C]//IEEE Conference on Computer Vision and Pattern Recognition.Piscataway:IEEE Press,2019:2148-2157.
[36] CHEN Y B,ZHU X T,GONG X T,et al.Instance-guided context rendering for cross-domain person re-identification[C]//IEEE International Conference on Computer Vision.Piscataway:IEEE Press,2019:232-242.
[37] HUANG H J,YANG W J,CHEN X T,et al.EANet:Enhancing alignment for cross domain person re-identification[EB/OL].(2018-12-29)[2020-03-01].https://arxiv.org/abs/1812.11369.
[38] DENG J,DONG W,SOCHER R,et al.ImageNet:A large-scale hierarchical image database[C]//IEEE Conference on Computer Vision and Pattern Recognition.Piscataway:IEEE Press,2009:248-255.
[39] ZHANG X,LUO H, FAN X,et al.AlignedReID:Surpassing human-level performance in person re-identification[EB/OL].(2017-11-22)[2020-03-01].https://arxiv.org/abs/1711.08184.
[40] CHOI Y,CHOI M,KIM M,et al.StarGAN:Unified generative adversarial networks for multi-domain image-to-image translation[C]//IEEE Conference on Computer Vision and Pattern Recognition.Piscataway:IEEE Press,2018:8789-8797.
[41] ZHENG L,SHEN L Y,TIAN L,et al.Scalable person re-identification:A benchmark[C]//IEEE International Conference on Computer Vision.Piscataway:IEEE Press,2015:1116-1124.
[42] RISTANI E,SOLERA F,ZOU R,et al.Performance measures and a data set for multi-target,multi-camera tracking[C]//European Conference on Computer Vision.Berlin:Springer,2016:17-35.
[43] RUSSAKOVSKY O,DENG J,SU H,et al.ImageNet large scale visual recognition challenge[J].International Journal of Computer Vision,2015,115:211-252.
[44] ZHONG Z,ZHENG L,LUO Z M,et al.Invariance matters:Exemplar memory for domain adaptive person re-identification[C]//IEEE Conference on Computer Vision and Pattern Recognition.Piscataway:IEEE Press,2019:598-607.
[45] ZHONG Z,ZHENG L,ZHENG Z D,et al.CamStyle:A novel data augmentation method for person re-identification[J].IEEE Transactions on Image Processing,2019,28(3):1176-1190.
[46] ZHONG Z,ZHENG L,LI S Z,et al.Generalizing a person retrieval model hetero-and homogeneously[C]//European Conference on Computer Vision.Berlin:Springer,2018:172-188.

基于局部语义特征不变性的跨域行人重识别

Cross-domain person re-identification based on partial semantic feature invariance

RichHTML

PDF (PC)

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 3

编辑推荐

Metrics

本文评价

[1]	窦鑫泽, 盛浩, 吕凯, 刘洋, 张洋, 吴玉彬, 柯韦. 基于高置信局部特征的车辆重识别优化算法[J]. 北京航空航天大学学报, 2020, 46(9): 1650-1659.
[2]	刘青, 孙军华. 基于局部径向二值模式的三维人脸识别[J]. 北京航空航天大学学报, 2015, 41(4): 732-736.
[3]	唐有宝, 卜巍, 张恩泽, 邬向前. 基于ASIFT的离线签名认证方法[J]. 北京航空航天大学学报, 2015, 41(1): 110-116.