基于改进残差网络的交通标志识别算法

摘要/Abstract

摘要： 针对模型在下采样过程中不断损失图像的高层次信息，从而导致特征提取不足的问题，本文对ResNet网络结构进行改进，提出基于多尺度特征与注意力机制的交通标志识别方法。首先，通过特征融合的方式将模型各个层次的多尺度特征进行融合，丰富特征语义信息，增强网络的特征提取能力。然后，通过注意力机制强化不同通道特征，提升特征整体的表达能力。结合这2种方法可提升模型的交通标志识别准确率。在GTSRB和BelgiumTS交通标志数据集上的实验结果表明，所提出方法的准确率分别达到99.31%和98.96%，优于前沿的交通标志识别算法。

关键词: 深度学习, 交通标志识别, 卷积神经网络, 多尺度特征融合, 通道注意力机制

Abstract: For the problems of high-level information loss and insufficient feature extraction in sampling in network structure, the ResNet network structure is improved and a traffic sign recognition method based on multi-scale features and attention mechanism is put forward in this paper. Firstly, multi-scale features are used to fuse different levels of feature information to enrich feature semantic information and enhance the ability of feature extraction. Then, the features of different channels are strengthened through the attention mechanism to improve the overall presence of traffic signs for achieving more accurate traffic sign recognition. The experimental results on GTSRB and BelgiumTS traffic sign datasets show that the accuracies with the proposed methods reach 99.31% and 98.96% respectively, which achieves better results in traffic sign recognition.

Key words: deep learning, traffic sign recognition, convolutional neural network, multi-scale feature fusion, channel attention mechanism

梁正友, 耿经邦, 孙宇. 基于改进残差网络的交通标志识别算法[J]. 计算机与现代化, 2022, 0(04): 52-57.

LIANG Zheng-you, GENG Jing-bang, SUN Yu. Traffic Sign Recognition Algorithm Based on Improved Residual Network[J]. Computer and Modernization, 2022, 0(04): 52-57.

参考文献

［1］ SMIT S, TOMASCH E, KOLK H, et al. Evaluation of a momentum based impact model in frontal car collisions for the prospective assessment of ADAS［J］. European Transport Research Review, 2019,11. DOI: 10.1186/s12544-018-0343-3.
［2］ MOGELMOSE A, TRIVEDI M M, MOESLUND T B. Vision-based traffic sign detection and analysis for intelligent driver assistance systems: Perspectives and survey［J］. IEEE Transactions on Intelligent Transportation Systems, 2012,13(4):1484-1497.
［3］ GREENHALGH J, MIRMEHDI M. Real-time detection and recognition of road traffic signs［J］. IEEE Transactions on Intelligent Transportation Systems, 2012,13(4):1498-1506.
［4］ CIRESAN D, MEIER U, MASCI J, et al. Multi-column deep neural network for traffic sign classification［J］. Neural Networks, 2012,32:333-338.
［5］童英,杨会成. 基于改进卷积神经网络的实时交通标志检测方法［J］. 激光与光电子学进展, 2019,56(7):115-121.
［6］马永杰,李雪燕,宋晓凤. 基于改进深度卷积神经网络的交通标志识别［J］. 激光与光电子学进展, 2018,55(12):244-251.
［7］吴迪,屈宗顺,赵葵银,等. 基于HOGv-CLBP特征融合和ELM的交通标志识别［J］. 光电子·激光, 2020,31(6):621-627.
［8］ DALAL N, TRIGGS B. Histograms of oriented gradients for human detection［C］// Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05). 2005,1:886-893.
［9］ HUANG G B, ZHU Q Y, SIEW C K. Extreme learning machine: Theory and applications［J］. Neurocomputing, 2006,70(1-3):489-501.
［10］梁敏健,崔啸宇,宋青松,等. 基于HOG-Gabor特征融合与Softmax分类器的交通标志识别方法［J］. 交通运输工程学报, 2017,17(3):151-158.
［11］QIAN R Q, ZHANG B L, YUE Y, et al . Robust Chinese traffic sign detection and recognition with deep convolutional neural network［C］// Proceedings of the 2015 11th International Conference on Natural Computation (ICNC). 2015:791-796.
［12］孙伟,杜宏吉,张小瑞,等. 基于CNN多层特征和ELM的交通标志识别［J］. 电子科技大学学报, 2018,47(3):343-349.
［13］伍锡如,雪刚刚. 基于图像聚类的交通标志CNN快速识别算法［J］. 智能系统学报, 2019,14(4):670-678.
［14］PAL N R. A primer on cluster analysis: 4 basic methods that (usually) work ［book review］［J］. IEEE Computational Intelligence Magazine, 2017,12(4):98-100.
［15］何锐波,狄岚,梁久祯. 一种改进的深度学习的道路交通标识识别算法［J］. 智能系统学报, 2020,15(6):1121-1130.

［16］STALLKAMP J, SCHLIPSING M, SALMEN J, et al. The German traffic sign recognition benchmark: A multi-class classification competition［C］// Proceedings of the 2011 International Joint Conference on Neural Networks. 2011:1453-1460.

［17］MATHIAS M, TIMOFTE R, BENENSON R, et al. Traffic sign recognition: How far are we from the solution?［C］// Proceedings of the 2013 International Joint Conference on Neural Networks (IJCNN). 2013. DOI: 10.1109/IJCNN.2013.6707049.
［18］HE K M, ZHANG X Y, REN S Q, et al. Deep residual learning for image recognition［C］// Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2016:770-778.
［19］SIMONYAN K, ZISSERMAN A. Very deep convolutional networks for large-scale image recognition［J］. arXiv preprint arXiv:1409.1556, 2014.
［20］LIN T Y, DOLLAR P, GIRSHICK R, et al. Feature pyramid networks for object detection［C］// Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2017:936-944.
［21］WEI X S, LUO J H, WU J X, et al. Selective convolutional descriptor aggregation for fine-grained image retrieval［J］. IEEE Transactions on Image Processing, 2017,26(6):2868-2881.
［22］ROY A G, NAVAB N, WACHINGER C. Concurrent spatial and channel ‘squeeze & excitation’ in fully convolutional networks［C］// Proceedings of the 2018 International Conference on Medical Image Computing and Computer-assisted Intervention. 2018:421-429.
［23］HU J, SHEN L, ALBANIE S, et al. Squeeze-and-excitation networks［J］. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2020,42(8):2011-2023.
［24］XIE Y, LIU L F, LI C H, et al. Unifying visual saliency with HOG feature learning for traffic sign detection［C］// Proceedings of the 2009 IEEE Intelligent Vehicles Symposium. 2009:24-29.
［25］梁琳,何卫平,雷蕾,等. 光照不均图像增强方法综述［J］. 计算机应用研究, 2010,27(5):1625-1628.
［26］SANDLER M, HOWARD A, ZHU M L, et al. MobileNetV2: Inverted residuals and linear bottlenecks［C］// Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2018:4510-4520.
［27］CIRESAN D, MEIER U, MASCI J, et al. A committee of neural networks for traffic sign classification［C］// Proceedings of the 2011 International Joint Conference on Neural Networks. 2011:1918-1921.
［28］SERMANET P, LECUN Y. Traffic sign recognition with multi-scale convolutional networks［C］// Proceedings of the 2011 International Joint Conference on Neural Networks. 2011:2809-2813.

[1]	何思达, 陈平华. 基于意图的轻量级自注意力序列推荐模型[J]. 计算机与现代化, 2024, 0(12): 1-9.
[2]	张思敏, 刘新妹, 殷俊龄, 李宝玲. 基于YOLOv7改进的PCB缺陷检测方法[J]. 计算机与现代化, 2024, 0(12): 45-52.
[3]	张晓东1, 白广芝1, 李敏1, 李昊洋2. 基于经验小波变换的油气井产量预测模型 [J]. 计算机与现代化, 2024, 0(12): 53-58.
[4]	刘宝宝, 杨菁菁, 陶露, 王贺应. 基于注意力的DSMSC的遥感图像场景分类[J]. 计算机与现代化, 2024, 0(12): 72-77.
[5]	祁贤, 刘大铭, 常佳鑫. 基于改进自注意力机制的多视图三维重建[J]. 计算机与现代化, 2024, 0(11): 106-112.
[6]	陈凯1, 李宜汀1, 2, 全华凤1 . 基于改进YOLOv8的河道废弃瓶检测方法[J]. 计算机与现代化, 2024, 0(11): 113-120.
[7]	杨骏1, 胡为1, 朱文福2. 基于改进MobileNetV3的视觉SLAM回环检测算法[J]. 计算机与现代化, 2024, 0(10): 21-26.
[8]	王莹莹, 郝潇. 基于Res2Net和递归门控卷积的细粒度图像分类[J]. 计算机与现代化, 2024, 0(10): 74-79.
[9]	史星宇1, 李强2, 庄莉3, 梁懿3, 王秋琳3, 陈锴3, 伍臣周3, 常胜1. 一种面向工业部署的目标检测模型蒸馏技术[J]. 计算机与现代化, 2024, 0(10): 93-99.
[10]	陈雪松1, 李衡1, 王浩畅2. 结合注意力机制和Mengzi模型的短文本分类[J]. 计算机与现代化, 2024, 0(09): 101-106.
[11]	张泽1, 张建权2, 3, 周国鹏2, 3. 基于改进YOLOv8s的摄像头模组缺陷检测[J]. 计算机与现代化, 2024, 0(09): 107-113.
[12]	程亚子1, 雷亮1, 2, 陈瀚1, 赵毅然1. 基于转置注意力的多尺度深度融合单目深度估计[J]. 计算机与现代化, 2024, 0(09): 121-126.
[13]	程萌, 李浩. 改进YOLOv5s的落叶树鸟巢检测方法[J]. 计算机与现代化, 2024, 0(08): 24-29.
[14]	王梦溪, 李峻. 老年人跌倒检测技术研究综述[J]. 计算机与现代化, 2024, 0(08): 30-36.
[15]	时现伟1, 范鑫2. 基于轻量化的视频帧场景语义分割方法[J]. 计算机与现代化, 2024, 0(08): 49-53.