基于双相机协同的管制车型抓拍系统

doi:10.3969/j.issn.1006-2475.2019.03.005

计算机与现代化

基于双相机协同的管制车型抓拍系统

(上海工程技术大学机械与汽车工程学院，上海201620)

收稿日期:2018-07-20 出版日期:2019-04-08 发布日期:2019-04-10
作者简介:王喜龙（1992-），男，山东曹县人，硕士研究生，研究方向：机器学习,E-mail: 542745791@qq.com; 张伟伟（1987-），男，河南舞钢人，讲师，博士，研究方向：机器视觉，深度学习,E-mail: 452567119@qq.com。
基金资助:
国家自然科学基金资助项目(51675324, 51575169); 国家重点研发计划项目(2016YFC0800702-1); 上海高校青年教师培养资助计划项目(ZZGCD15102); 上海高校教师产学研计划项目(A3-0100-17-SDJH337); 上海市青年科技英才扬帆计划项目(18YF1409400)

Regulatory Vehicle Recognition Method Based on Dual Camera Collaboration

(School of Mechanical and Automotive Engineering, Shanghai University of Engineering Science, Shanghai 201620, China)

Received:2018-07-20 Online:2019-04-08 Published:2019-04-10

摘要/Abstract

摘要： 针对管制车型在城市交通监控难等问题，研究一种基于双相机协同的管制车型自动抓拍系统。首先依据管制车型侧面信息熵大而便于类内目标精细识别的特点，优选目标车辆的侧面图像为特征载体，采用卷积神经网络对不同管制车型侧面进行识别；其次建立相机间坐标映射模型，采用BP神经网络算法对目标车辆面部进行定位，有效简化相机协同标定工序，对目标车辆面部进行快速定位;最后基于目标车辆的面部图像对车牌进行识别。实验结果表明，该方法对管制车型的检测精度达到89.94%，定位面部区域与ground truth的纵向高度交并比达到0.912，系统整体性能达到较高精度。

关键词: 车辆侧面特征, 双相机协同, 车型识别

Abstract: Aiming at the difficult problem of urban traffic monitoring for regulated vehicles, an automatic capture system for regulated vehicles based on dual camera collaboration is studied. Firstly, according to the characteristics of the large side information entropy of the control model, which is easy to identify the inter-class target, the target side image is priorly selected as the feature carrier, and the convolutional neural network is used to identify the side of different models. Secondly, the coordinate mapping model between cameras is established. The BP neural network algorithm is used to locate the target vehicle’s face, which effectively simplifies the camera collaborative calibration process and quickly locates the target vehicle’s face. Finally, the license plate is identified based on the target vehicle’s facial image. The experimental results show that the detection accuracy of the proposed model is 89.94%, and the vertical height of the positioning face area and the ground truth is 0.912. The overall performance of the system reaches a high precision.

Key words: vehicle’s side features, dual camera collaboration, vehicle type identification

中图分类号:

TP391

王喜龙，张伟伟，吴训成 . 基于双相机协同的管制车型抓拍系统[J]. 计算机与现代化, doi: 10.3969/j.issn.1006-2475.2019.03.005.

WANG Xi-long, ZHANG Wei-wei, WU Xun-cheng . Regulatory Vehicle Recognition Method Based on Dual Camera Collaboration[J]. Computer and Modernization, doi: 10.3969/j.issn.1006-2475.2019.03.005.

参考文献

［1］张鹏,陈湘军,阮雅端,等. 采用稀疏SIFT特征的车型识别方法［J］. 西安交通大学学报, 2015,49(12):137-143.
［2］许庆,高峰,徐国艳. 基于Haar特征的前车识别算法［J］. 汽车工程, 2013,35(4):381-384.
［3］ WANG X C, ZHANG W W, WU X C, et al. Real-time vehicle type classification with deep convolutional neural networks［J］. Journal of Real-Time Image Processing, 2017, doi: 10.1007/s11554-017-0712-5.
［4］袁公萍,汤一平,韩旺明,等. 基于深度卷积神经网络的车型识别方法［J］. 浙江大学学报(工学版), 2018,52(4):694-702.
［5］ RUMELHART D E, HINTON G E, WILLIAMS R J. Learning representations by back-propagating errors［J］. Nature, 1986,323(6088):533-536.
［6］ SIMONYAN K, ZISSERMAN A. Very Deep Convolutional Networks for Large-scale Image Recognition［DB/OL］. (2015-04-10). https://arxiv.org/pdf/1409.1556v6.pdf.
［7］ ZEILER M D, FERGUS R. Visualizing and understanding convolutional networks［C］// Proceedings of 2014 European Conference on Computer Vision. 2014:818-833.
［8］ REDMON J, DIVVALA S, GIRSHICK R, et al. You only look once: Unified, real-time object detection［C］// Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition. 2016:779-788.
［9］ REN S Q, HE K M, GIRSHICK R, et al. Faster R-CNN: Towards real-time object detection with region proposal networks［C］// Proceedings of 2015 International Conference on Neural Information Processing Systems. 2015:91-99.
［10］GIRSHICK R. Fast R-CNN［C］// Proceedings of 2015 IEEE International Conference on Computer Vision. 2015:1440-1448.
［11］GIRSHICK R, DONAHUE J, DARRELL T, et al. Rich feature hierarchies for accurate object detection and semantic segmentation［C］// Proceedings of 2014 IEEE Conference on Computer Vision and Pattern Recognition. 2014:580-587.
［12］ZHANG Z Y. A flexible new technique for camera calibration［J］. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2000,22(11):1330-1334.
［13］刘艳,李腾飞. 对张正友相机标定法的改进研究［J］. 光学技术, 2014,40(6):565-570.
［14］谷飞飞,赵宏,卜鹏辉,等. 用于相机标定的球靶标投影误差分析与校正［J］. 光学学报, 2012,32(12):209-215.
［15］谭华春,夏红卫,李琴,等. 车载摄像机的立体标定方法［J］. 吉林大学学报(工学版), 2013,43(S1):352-356.
［16］杨瑞华. 多相机系统快速标定算法研究［D］. 合肥:合肥工业大学, 2017.
［17］张宇,严天峰,杨志飞. 基于BP神经网络拟合的二次相关时延估计［J］. 兰州交通大学学报, 2018,37(2):38-42.
［18］FUNAHASHI K I. On the approximate realization of continuous mappings by neural networks［J］. Neural networks, 1989,2(3):183-192.
［19］RUDER S. An Overview of Gradient Descent Optimization Algorithms［DB/OL］. (2016-09-15). https://arxiv.org/pdf/1609.04747v1.pdf.
［20］GLOROT X, BORDES A, BENGIO Y. Deep sparse rectifier neural networks［C］// Proceedings of the 14th International Conference on Artificial Intelligence and Statistics. 2011:315-323.
［21］GitHub. HyperLPR［DB/OL］. ［2018-07-03］. https://github.com/zeusees/HyperLPR.

[1]	胡耀民. 快速极坐标形状描述子研究与应用[J]. 计算机与现代化, 2015, 0(3): 91-95.
[2]	杜华英. 基于车型识别的BP算法Matlab实现[J]. 计算机与现代化, 2012, 1(201): 20-22.

基于双相机协同的管制车型抓拍系统

Regulatory Vehicle Recognition Method Based on Dual Camera Collaboration

PDF (PC)

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 2

编辑推荐

Metrics

本文评价