Pedestrian Tracking Algorithm Based on Improved YOLOv5s and DeepSORT

doi:10.3969/j.issn.1006-2475.2024.08.010

Abstract

Abstract: The study conducts focus on enhancing the detection accuracy of the YOLOv5s algorithm within the DeepSORT framework. The research work encompasses the integration of the attention mechanism called Convolutional Block Attention Module （CBAM） into the network structure of YOLOv5s， the refinement of the bidirectional feature fusion network Bi-directional Feature Pyramid Network （BiFPN）， and the adoption of Enhanced Intersection over Union （EIoU） as the bounding box loss function. Test results obtained from the VOC 2007 pedestrian dataset indicates improvements when compared to the original algorithm. Specifically， the proposed algorithm exhibits an increase of 0.3 percentage points in precision， 1.0 percentage points in recall， and 0.3 percentage points in average precision. Subsequently， the algorithm is evaluated on the MOT17 dataset， showcasing significant enhancements in multiple metrics. The MOTA metric experiences a 1.8 percentage points improvement， while IDF1， MT， and IDR see enhancements of 2.9 percentage points， 1， and 2.7， respectively. Moreover， the number of false negatives （FN） decreases by 4373， and the number of mostly lost targets （ML） decreases by 11. Overall， these empirical findings substantiate the efficacy of the improved YOLOv5s algorithm as a detector， effectively augmenting tracking precision in various scenarios.

Key words: , target tracking, YOLOv5s, DeepSORT, attention mechanism, feature fusion network

CLC Number:

TP391.4

ZHENG Shangpo1, CHEN Defu1, LI Jianli2, LIN Guoxian2, WANG Xingping3. Pedestrian Tracking Algorithm Based on Improved YOLOv5s and DeepSORT[J]. Computer and Modernization, 2024, 0(08): 54-58.

References

［1］ CHENG Y Z. Mean shift， mode seeking， and clustering［J］. IEEE Transactions on Pattern Analysis and Machine Intelligence， 1995，17（8）：790-799.
［2］ EXNER D， BRUNS E， KURZ D， et al. Fast and robust CAMShift tracking［C］// Proceedings of the 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition-Workshops. IEEE， 2010：9-16.
［3］卢锦，马令坤，吕春玲，等. 基于代价参考粒子滤波器组的多目标检测前跟踪算法［J］. 自动化学报， 2024，50（4）：851-861.
［4］ HORN B K P， SCHUNCK B G. Determining optical flow［J］. Artificial Intelligence， 1981，17（1-3）：185-203.
［5］ Ultralytics. YOLOv5［EB/OL］. ［2023-05-16］. https：//github.com/ultralytics/yolov5.
［6］ TAO X， ZHANG D P， WANG Z H， et al. Detection of power line insulator defects using aerial images analyzed with convolutional neural networks［J］. IEEE Transactions on Systems， Man， and Cybernetics： Systems， 2020，50（4）：1486-1498.
［7］ GIRSHICK R. Fast R-CNN［C］// Proceedings of the 2015 IEEE International Conference on Computer Vision. IEEE， 2015：1440-1448.
［8］ REN S Q， HE K M， GIRSHICK R， et a1. Faster R-CNN： Towards real-time object detection with region proposal networks［J］. IEEE Transactions on Pattern Analysis and Machine Intelligence， 2017，39（6）：1137-1149.
［9］任维民，钟国韵，朱伟东，等. 基于改进YOLOv5的行人检测算法［J］. 计算机与数字工程， 2022，50（11）：2404-2410.
［10］ WANG C Y， LIAO H Y M， WU Y H， et al. CSPNet： A new backbone that can enhance learning capability of CNN［C］// Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops （CVPRW）. IEEE， 2020：1571-1580.
［11］ HE K M， ZHANG X Y， REN S Q， et al. Spatial pyramid pooling in deep convolutional networks for visual recognition［J］. IEEE Transactions on Pattern Analysis and Machine Intelligence， 2015，37（9）：1904-1916.
［12］ LIU S， QI L， QIN H F， et al. Path aggregation network for instance segmentation［C］// Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition （CVPR）. IEEE， 2018：8759-8768.
［13］ ZHENG Z H， WANG P， LIU W， et al. Distance-IoU loss： Faster and better learning for bounding box regression［J］. Proceedings of the AAAI Conference on Artificial Intelligence， 2020，34（7）：12993-13000.
［14］邱天衡，王玲，王鹏，等. 基于改进YOLOv5的目标检测算法研究［J］. 计算机工程与应用， 2022，58（13）：63-73.
［15］ WOO S， PARK J， LEE J Y， et al. CBAM： Convolutional block attention module［C］// Proceedings of the 2018 European Conference on Computer Vision （ECCV）. Springer， 2018：3-19.
［16］李永上，马荣贵，张美月. 改进YOLOv5s+DeepSORT的监控视频车流量统计［J］. 计算机工程与应用， 2022，58（5）：271-279.
［17］ TAN M X， PANG R M， LE Q V. EfficientDet： Scalable and efficient object detection［C］// Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition （CVPR）. IEEE， 2020：10778-10787.
［18］王子豫，邵伟平，郝永平. 基于改进YOLOv5算法的零件表面缺陷检测［J］. 组合机床与自动化加工技术， 2023（4）：177-182.
［19］ ZHANG Y F， REN W Q， ZHANG Z， et al. Focal and efficient IOU loss for accurate bounding box regression［J］. Neurocomputing， 2022，506：146-157.
［20］ WOJKE N， BEWLEY A， PAULUS D. Simple online and realtime tracking with a deep association metric［C］// Proceedings of the 2017 IEEE International Conference on Image Processing. IEEE， 2017：3645-3649.
［21］ BEWLEY A， GE Z Y， OTT L， et al. Simple online and realtime tracking［C］// Proceedings of the 2016 IEEE International Conference on Image Processing. IEEE， 2016：3464-3468.
［22］丁正道，吴红兰，孙有朝. 基于YOLOv5+DeepSORT检测数据的车头时距混合分布模型研究［J/OL］. 测控技术：1-9（2022-05-10）［2023-05-19］. https：//doi.org/10.19708/j.ckjs.2022.03.238.
［23］ KUHN H W. The Hungarian method for the assignment problem［J］. Naval Research Logistics， 1955，2（1-2）：83-97.
［24］韩晓冰，王雨田，黄综浏，等. 改进YOLOv5+DeepSORT的行人跟踪算法［J/OL］. 现代电子技术：1-6（2023-04-01）［2023-05-19］. https：//doi.org/10.16652/j.issn.1004-373x.2023.07.008.
［25］白俊龙，王章琼，闫海涛. K-means聚类引导的无人机遥感图像阈值分类方法［J］. 自然资源遥感， 2021，33（3）：114-120.
［26］ EVERINGHAM M， ZISSERMAN A， WILIAMS C K I， et al. The PASCAL visual object classes challenge 2006 results［EB/OL］. ［2021-11-10］. http：//host.robots.ox.ac.uk/pascal/VOC/voc2007/guidelines.html.
［27］冉险生，张之云，陈卓，等. 基于改进DeepSORT算法的摩托车头盔佩戴检测［J］. 计算机工程与应用， 2023，59（5）：194-204.

[1]	HE Sida, CHEN Pinghua. Intent-based Lightweight Self-Attention Network for Sequential Recommendation [J]. Computer and Modernization, 2024, 0(12): 1-9.
[2]	ZHENG Jiuchao, ZHAO Xinyuan. Entity Linking Method Based on Topics and Description Information [J]. Computer and Modernization, 2024, 0(12): 10-14.
[3]	ZHAO Chenyang, XUE Tao, LIU Junhua. Fashion Clothing Pattern Generation Based on Improved Stable Diffusion [J]. Computer and Modernization, 2024, 0(12): 15-23.
[4]	WANG Xiaohang1, LI Yongjie1, YU Lei1, FAN Xiao2. A Method of Using Compound Event Probability Operation to Solve Problem of Negative Information Blocking Maximization [J]. Computer and Modernization, 2024, 0(12): 24-33.
[5]	HUANG Tingpei1, MA Lubiao1, LI Shibao2, LIU Jianhang1. Gesture Recognition Method Based on WiFi and Prototypical Network [J]. Computer and Modernization, 2024, 0(12): 34-39.
[6]	ZHANG Xiaodong1, BAI Guangzhi1, LI Min1, LI Haoyang2. Oil and Gas Well Production Prediction Model Based on Empirical Wavelet Transform [J]. Computer and Modernization, 2024, 0(12): 53-58.
[7]	LIU Yunhai1, Feng Guang1, WU Xiaoting2, YANG Qun2 . Safety Helmet Wearing Detection Algorithm for Complex Construction Scenes [J]. Computer and Modernization, 2024, 0(12): 66-71.
[8]	LIU Baobao, YANG Jingjing, TAO Lu, WANG Heying . DSMSC Based on Attention Mechanism for Remote Sensing Image Scene Classification [J]. Computer and Modernization, 2024, 0(12): 72-77.
[9]	GU Yue, DENG Songfeng, SHEN Ji, MU Wentao, ZHAO Enqi. SAR Ship Detection Algorithm Based on Improved YOLOv8 [J]. Computer and Modernization, 2024, 0(12): 78-83.
[10]	WANG Yanyuan, MAO Zhengchong. Detection and Recognition Algorithms for Chinese and English Scene Text Images [J]. Computer and Modernization, 2024, 0(12): 84-90.
[11]	WU Xiuling1, ZHOU Sheng1, WANG Chunjuan1, YU Cuizhuo2, LIU Hao3. Research Progress in Ultra Short-term Power Load Forecasting Technology [J]. Computer and Modernization, 2024, 0(12): 108-115.
[12]	LI Deyou1, 2, YU Jinsongdi1, 2, WEI Dandan1, 2, LUO Yuan1, 2, TONG Ruiju3. Abstract Tree Model for Gridded Cube Metadata [J]. Computer and Modernization, 2024, 0(11): 1-6.
[13]	GONG Yicheng1, 2, LIU Qing1, 2. Beijing Opera Binary Classification Based on RF-LCE-BiLSTM-Attention-AMSSA Model [J]. Computer and Modernization, 2024, 0(11): 7-12.
[14]	LI Taoying, LI Meng, WU Mengqiao. Taxi Passenger Flow Prediction Based on Heterogeneous Spatiotemporal Graph#br# Convolutional Networks [J]. Computer and Modernization, 2024, 0(11): 13-18.
[15]	ZHANG Tai1, YAN Zihao2, DUAN Jie2, ZHANG Zhihong2. Information Forwarding Strategy of Internet of Vehicles in Named Data Network [J]. Computer and Modernization, 2024, 0(11): 19-27.