Face Recognition and Tracking System of Photographic Robot #br# Based on YOLOv3 and ResNet50

doi:10.3969/j.issn.1006-2475.2020.04.006

Abstract

Abstract: In the virtual studio,aiming at the task that the photographic robot needs completing automatical face recognition and shot tracking of the host, a system of face recognition and shot tracking for the host based on YOLOv3 face detection and ResNet50 construction is proposed. In order to improve the accuracy of face recognition for photographic robots on open sets, a host face training set based on CASIA-FaceV5 and PubFig data sets is constructed, and the model is trained on modified ResNet50 with joint supervision. An experiment is carried out by combining with the motion control algorithm of photographic robot, the experiment shows that the face recognition tracking system has robust recognition accuracy and real-time performance, and can meet the requirements of face tracking of photographic robot in the virtual studio.

Key words: virtual studio, photographic robot, face recognition, YOLOv3, ResNet50

CLC Number:

TP24

CHEN Kai, ZU Li, OU Yi. Face Recognition and Tracking System of Photographic Robot #br# Based on YOLOv3 and ResNet50[J]. Computer and Modernization, doi: 10.3969/j.issn.1006-2475.2020.04.006.

References

［1］傅乐俭,廖欣叶. 虚拟演播室技术的实践应用［J］. 电视技术, 2011,35(16):95-97.
［2］苏楠. 人脸识别综合技术的发展［J］. 信息安全研究, 2016,2(1):33-39.
［3］ CINBIS R G, VERBEEK J J, SCHMID C. Unsupervised metric learning for face identication in TV video［C］// 2011 IEEE International Conference on Computer Vision. 2011:1559-1566.
［4］ LU C C, TANG X O. Surpassing human-level face verification performance on LFW with Gaussian face［C］// Proceedings of the National Conference on Artificial Intelligence. 2015:3811-3819.
［5］ SIVIC J, EVERINGHAM M, ZISSERMAN A. Person spotting: Video shot retrieval for face sets［C］// Proceedings of the 4th International Conference on Image and Video. 2005:226-236.
［6］〖KG-*3〗RAZAVIAN A S, AZIZPOUR H, SULLIVAN J, et al. CNN features off-the-shelf: An astounding baseline for recognition［C］// 2014 IEEE Conference on Computer Vision and Pattern Recognition. 2014:512-519.
［7］李彦冬,郝宗波,雷航. 卷积神经网络研究综述［J］. 计算机应用, 2016,36(9):2508-2515.
［8］ WANG F, CHENG J, LIU W Y, et al. Additive margin softmax for face verification［J］. IEEE Signal Processing Letters, 2018,25(7):926-930.
［9］ WEN Y D, ZHANG K P, LI Z F, et al. A discriminative feature learning approach for deep face recognition［C］// Computer Vision-ECCV 2016. 2016:499-515.
［10］LIU W Y, WEN Y D, YU Z D, et al. Sphereface: Deep hypersphere embedding for face recognition［C］// 2017 IEEE Conference on Computer Vision and Pattern Recognition. 2017:6738-6746.
［11］DENG J K, GUO J, ZAFEIRIOU S. ArcFace: Additive angular margin loss for deep face recognition［J］. Computer Vision and Pattern Recognition, 2018:arXiv:1801.07698.
［12］SZEGEDY C, LIU W, JIA Y Q, et al. Going deeper with convolutions［C］// 2015 IEEE Conference on Computer Vision and Pattern Recognition. 2015:1-9.
［13］HE K M, ZHANG X Y, REN S Q, et al. Deep residual learning for image recognition［C］// 2016 IEEE Conference on Computer Vision and Pattern Recognition. 2016:770-778.
［14］TAIGMAN Y, YANG M, RANZATO M, et al. Deepface: Closing the gap to human-level performance in face verication［C］// 2014 IEEE Conference on Computer Vision and Pattern Recognition. 2014:1701-1708.
［15］KUMAR N, BERG A C, BELHUMEUR P N, et al. Attribute and simile classifiers for face verification［C］// 2009 12th IEEE International Conference on Computer Vision. 2009:365-372.
［16］郑健,王志明,张宁. 一种基于深度学习的改进人脸识别算法［J］. 计算机与现代化, 2018(12):94-99.
［17］REDMON J, DIVVALA S, GIRSHICK R, et al. You only look once: Unified, real-time object detection［C］// 2016 IEEE Conference on Computer Vision and Pattern Recognition. 2016:779-788.
［18］REDMON J, FARHADI A. YOLOv3: An Incremental Improvement［EB/OL］.(2018-04-08)［2019-08-15］. https://arxiv.org/abs/1804.02767.
［19］IOFFE S, SZEGEDY C. Batch normalization: Accelerating deep network training by reducing internal covariate shift［J］. Machine Learning, 2015:arXiv:1502.03167.
［20］YU S, FALCK T, DAEMEN A, et al. L2-norm multiple kernel learning and its application to biomedical data fusion［J］. BMC Bioinformatics, 2010,11(1):309.
［21］赵峰. 基于SVM和HOG的人脸检测算法［J］. 信息技术与信息化, 2013(6):113-116.
［22］AMOS B, LUDWICZUK B, SATYANARAYANAN M. Openface: A general-purpose face recognition library with mobile applications［J］. Computer Vision, 2016:1-20.

[1]	WANG Xin, XIAO Tao-rui. GAN-based Adversarial Attacks on Face Recognition [J]. Computer and Modernization, 2023, 0(10): 115-120.
[2]	SHENG Jiang-an, CHEN Shu-rong. Mask-wearing Face Recognition Method Fused with Dual Attention Mechanism [J]. Computer and Modernization, 2023, 0(02): 72-77.
[3]	GUO Teng-fei, ZHANG Ze-yan, FU Hong-cai, WANG Ji-xuan, NIU Tian-bao. Lightweight Infrared HV Bushing Identification Algorithm Based on Attention Mechanism [J]. Computer and Modernization, 2022, 0(01): 70-76.
[4]	LI Guo-jin, RONG Yu. Face Mask Detection Algorithm Based on DCN-SERes-YOLOv3 [J]. Computer and Modernization, 2021, 0(09): 12-20.
[5]	LI Long, ZHANG Chong-yang. Vehicle Taillight Detection Method Based on Improved YOLOv3 [J]. Computer and Modernization, 2021, 0(07): 89-94.
[6]	ZHANG Lei, LANG Xian-li, WANG Le. Surface Defect Detection of Aluminum Profile Based on Image Fusion and YOLOv3 [J]. Computer and Modernization, 2020, 0(11): 8-15.
[7]	WANG Chun-hui, WANG Quan-min. Student Specific Behavior Recognition Based on Improved YOLOv3 Network [J]. Computer and Modernization, 2020, 0(07): 90-96.
[8]	QIN Jia, CAO Xue-hong, JIAO Liang-bao. Detection and Tracking of Hard Hat Wearing Based on Deep Learning [J]. Computer and Modernization, 2020, 0(06): 1-.
[9]	LIU Li-ran 1, CAO Jie2, YANG Lei1, QIU Nan-hao1. An Improved YOLOv3-Tiny Traffic Detection Algorithm [J]. Computer and Modernization, 2020, 0(03): 108-.
[10]	QU Wen-yi. Real-time Ship Monitoring and Recognition Based on YOLOv3 [J]. Computer and Modernization, 2020, 0(03): 115-.
[11]	LI Shuo1, BIAN Qing-shan2, LIU Chuan-wen2, LIU Ming-tao1, ZHANG Lin-tao1 . Face Verification and Application Research of ID Photos Based on DCNN [J]. Computer and Modernization, 2020, 0(02): 104-.
[12]	MO Bei-bei, WU Ke-he . Research on Intelligent Detection Technology for Illegal Wearing #br# in Power Operation by Introducing Self-Attention [J]. Computer and Modernization, 2020, 0(02): 115-.
[13]	CUI Juan-juan1, ZHANG Lei1, HOU Xie-lian2, CHEN Cai-kou2, ZHANG Hai-yan1. A Two-phase Face Recognition Algorithm Based on Discriminative Low-rank Representation [J]. Computer and Modernization, 2019, 0(12): 55-.
[14]	YANG Lei1, WANG Shao-yun2, LIU Li-ran1, GONG Yong-fu1. A Pedestrian Detection Method in Intelligent Video Monitoring System [J]. Computer and Modernization, 2019, 0(11): 69-.
[15]	LI Lei, REN Yue-mei. Face Recognition Based on Multi-task Joint Discrimination Sparse Representation [J]. Computer and Modernization, 2019, 0(10): 72-.