ProgressofPerformanceEvaluationMethodologyforTrackers

doi:10.3969/j.issn.1006-2475.2018.06.018

Abstract

Abstract: Thenormativeevaluationmethodcanaccuratelyfeedbackalgorithmperformance,comparedifferentalgorithms,promotethedevelopmentoftrackingalgorithmandguideengineeringapplicationonthebasisofobjectivityandfairness.Thispapersummarizedtheresearchprogressoftheperformanceevaluationmethodsfromthreeaspects:evaluationmethods,commonlyuseddatasetsandexistingevaluationprograms.Thispaperbrieflyexplainedthetypeofevaluationmethodsandthedifferenceoftrackingevaluationbetweensingletargetandmulti-targets,gavedetailedanalysisofthecommonlyusedmeasurementindicatorsanditscharacteristics,introducedrepresentativedatasetsandassessmentprojects.Finally,thispaperexploredthedevelopmentofevaluationmethods.

Key words: trackingalgorithm, performanceevaluation, dataset, evaluationproject

CLC Number:

TP391.4

WANGQuan-ning1,2,ZHOUJin1,LEITao1，TANGZi-li3. ProgressofPerformanceEvaluationMethodologyforTrackers[J]. Computer and Modernization, doi: 10.3969/j.issn.1006-2475.2018.06.018.

References ［24］

［1］	张泽旭,李金宗,李冬冬.一种鲁棒性的光流算法研究［J］.电子学报,2003,31(12):1851-1855.
［2］	NouarOD,AliG,RaphaelC.ImprovedobjecttrackingwithCamshiftalgorithm［C］//IEEEInternationalConferenceonAcoustics,SpeechandSignalProcessing.2006,2.
［3］	AntaniS,CrandallD,NarasimhamurthyA,etal.Evaluationofmethodsfordetectionandlocalizationoftextinvideo［C］//Proc.Int’lWorkshopDocumentAnalysisSystems.2000:507-514.
［4］	HuaXiansheng,LiuWenyin,ZhangHongjiang.Automaticperformanceevaluationforvideotextdetection［C］//IEEEInternationalConferenceonDocumentAnalysisandRecognition.2001:545-550.
［5］	〖JP2〗SmithK,Gatica-PerezD,OdobezJ,etal.Evaluatingmulti-objecttracking［C］//IEEEComputerSocietyConferenceonComputerVisionandPatternRecognition(CVPR).2005,3:36.〖JP〗
［6］	CollinsR,ZhouXuhui,SengKT.AnopensourcetrackingtestbedandevaluationWebsite［C］//IEEEInternationalWorkshoponPerformanceEvaluationofTrackingandSurveillance.2005:17-24.
［7］	BlackJ,EllisT,RosinP.Anovelmethodforvideotrackingperformanceevaluation［C］//IEEEJointInt.WorkshoponVisualSurveillanceandPerformanceEvaluationofTrackingandSurveillance.2003:125-132.
［8］	HanB,HammJ.Qualitativetrackingperformanceevaluationwithoutground-truth［C］//2015IEEEWinterConferenceonApplicationsofComputerVision(WACV).2015:55-62.
［9］	SanmiguelJC,CavallaroA,MartinezJM.Adaptiveonlineperformanceevaluationofvideotrackers［J］.IEEETransactionsonImageProcessing,2012,21(5):2812-2823.〖JP〗
［10］	SpampinatoC,PalazzoS,GiordanoD.Evaluationoftrackingalgorithmperformancewithoutground-truthdata［C］//IEEEInternationalConferenceonImageProcessing.2012:1345-1348.
［11］	WuHao,SankaranarayananAC,ChellappaR.InSituevaluationoftrackingalgorithmsusingtimereversedchains［C］//2007IEEEConferenceonComputerVisionandPatternRecognition.2007:1-8.
［12］	KasturiR,GoldgofD,SoundararajanP,etal.Frameworkforperformanceevaluationofface,text,andvehicledetectionandtrackinginvideo:Data,metrics,andprotocol［J］.IEEETransactionsonPatternAnalysis&MachineIntelligence,2008,31(2):319-336.
［13］	RossDA,LimJ,LinRS,etal.Incrementallearningforrobustvisualtracking［J］.InternationalJournalofComputerVision,2008,77(1-3):125-141.
［14］	BabenkoB,YangMH,BelongieS.Robustobjecttrackingwithonlinemultipleinstancelearning［J］.IEEETransactionsonPatternAnalysis&MachineIntelligence,2011,33(8):1619-1632.
［15］	JiHui,LingHaibin,WuYi,etal.RealtimerobustL1trackerusingacceleratedproximalgradientapproach［C］//IEEEConferenceonComputerVisionandPatternRecognition.IEEEComputerSociety.2012:1830-1837.
［16］	EveringhamM,GoolL,WilliamsCK,etal.ThePascalvisualobjectclasses(VOC)challenge［J］.InternationalJournalofComputerVision,2010,88(2):303-338.
［17］	ZhangKaihua,ZhangLei,YangMing-Hsuan.Real-timecompressivetracking［C］//EuropeanConferenceonComputerVision.Springer-Verlag,2012:864-877.
［18］	Lazarevic-McmanusN,RennoJR,MakrisD,etal.Anobject-basedcomparativemethodologyformotiondetectionbasedontheF-measure［J］.ComputerVision&ImageUnderstanding,2008,111(1):74-85.
［19］	KwonJ,LeeKM.Trackingofanon-rigidobjectviapatch-baseddynamicappearancemodelingandadaptiveBasinHoppingMonteCarlosampling［C］//2009IEEEComputerSocietyConferenceonComputerVisionandPatternRecognition(CVPR2009).2009:1208-1215.
［20］	HallD,NascimentoJ,RibeiroP,etal.Comparisonoftargetdetectionalgorithmsusingadaptivebackgroundmodels［C］//IEEEInternationalWorkshoponVisualSurveillanceandPerformanceEvaluationofTrackingandSurveillance.2005:113-120.
［21］	WuYi,LimJ,YangMH.Onlineobjecttracking:Abenchmark［C］//IEEEConferenceonComputerVisionandPatternRecognition.2013:2411-2418.
［22］	EC’sInformationSocietyTechnology.CAVIAR:ContextAwareVisionUsingImage-basedActiveRecognition［EB/OL］.http://homepages.inf.ed.ac.uk/rbf/CAVIAR,2017-〖JP〗12-04.
［23］	YoungDP,FerrymanJM.PETSmetrics:Onlineperformanceevaluationservice［C］//IEEEInternationalConferenceonComputerCommunicationsandNetworks.2005:317-324.
［24］	NghiemAT,BremondF,ThonnatM,etal.ETISEO,performanceevaluationforvideosurveillancesystems［C］//IEEEConferenceonAdvancedVideoandSignalBasedSurveillance.2007:476-481.

[1]	SHEN Jia-wei, LU Yi-ming, CHEN Xiao-yi, QIAN Mei-ling, LU Wei-zhong, . Review of Research on Human Behavior Detection Methods Based on Deep Learning [J]. Computer and Modernization, 2023, 0(09): 1-9.
[2]	QIU Di-fa, YU Shu-fang, LIU Jin-hui, BI Meng-zhao. Improved YOLOv5s for Small Vehicle Object Detection on Remote Sensing Image [J]. Computer and Modernization, 2023, 0(05): 122-126.
[3]	JIN Du-liang, FAN Yong-sheng, ZHANG Qi. Semantic Loss Degree of Text Summarization Evaluation Method [J]. Computer and Modernization, 2023, 0(03): 84-89.
[4]	ZHANG Zi-yun, WANG Wen-fa, MA Le-rong, DING Cang-feng. Research Progress of Text Summarization Model [J]. Computer and Modernization, 2022, 0(06): 56-66.
[5]	XU Long. Short Text Sentiment Analysis Based on Self-attention and Capsule Network [J]. Computer and Modernization, 2020, 0(07): 61-64.
[6]	YANG Lei1, WANG Shao-yun2, LIU Li-ran1, GONG Yong-fu1. A Pedestrian Detection Method in Intelligent Video Monitoring System [J]. Computer and Modernization, 2019, 0(11): 69-.
[7]	QIN Ying-bo1, CAO Bu-qing2, DENG Chun-hui1. A Data Clustering Method Based on Competitive Swarm Optimizer [J]. Computer and Modernization, 2019, 0(01): 75-.
[8]	YI Wei1, MAO Li1, SUN Jun1, WU Lin-hai2,3. Research on Classification of Improved Smote Algorithm on Imbalanced Datasets [J]. Computer and Modernization, 2018, 0(03): 83-.
[9]	QIU Hai-bo1， QIAN Zhong-min1， QIAN Mo-shu2. Used-car Recommendation Based on Synthetic Minority Over-sampling Technique Filter [J]. Computer and Modernization, 2016, 251(07): 118-123.
[10]	ZHANG Guiping. General Form Dynamic Generation Technology Based on Metadata [J]. Computer and Modernization, 2013, 1(11): 196-198.
[11]	WANG Jin;TAO Qian;CHEN Hong. Analysis of Datasets Model in IEC61850 [J]. Computer and Modernization, 2012, 203(7): 202-205.
[12]	ZHOU Zhi-peng;JIANG Yu-fang. Design and Implementation of Course Management System Based on Typed Dataset [J]. Computer and Modernization, 2012, 198(2): 95-97.
[13]	LI Jin-hua;LIANG Yong-quan;LÜFang-fang. An Incremental Learning Model of Weighted Naive Bayesian Classification [J]. Computer and Modernization, 2010, 1(5): 30-32.