A Simplex Coding Multi-class Boosting Optimizing Algorithm

doi:10.3969/j.issn.1006-2475.2015.08.025

Abstract

Abstract: The multi-classification problem was divided into multiple independent binary problems in existing image classification mechanism, numbers of class directly influenced demand sizes of binary classifier. The number of classes in image classification problem was very large, which led to long training time, high computing demand and high test cost. In order to effectively solve these problems, this paper designed a multi-class boosting optimizing algorithm based on simplex coding(SCOBoost). Firstly, based on simplex coding, combining with the least squares support vector machine (LS-SVM) objective function, this paper proposed multi-classification improvement goal based on simplex coding; secondly, selected the weak classifiers which are not associated with the number of classes as the kernel function, and used iterative methods of boosting to solve. Experiment results on different data sets showed, SCOBoost not only had higher classification performance, but also had lower algorithm complexity, fast test speed and training time which is not affected by the number of classes and so on.


CLC Number:

TP393

ZHAO Chun-lan. A Simplex Coding Multi-class Boosting Optimizing Algorithm[J]. Computer and Modernization, doi: 10.3969/j.issn.1006-2475.2015.08.025.

References

［1］ Mroueh Y, Poggio T, Rosasco L, et al. Multiclass learning with simplex coding［C］// Proceedings of Annual Conference on Neural Information Processing Systems, 2012. 2012:2798-2806.
［2］ Li Fei-fei, Fergus R, Perona P. Learning generative visual models from few training examples: An incremental Bayesian approach tested on 101 object categories ［J］. Computer Vision and Image Understanding, 2007,106(1):59-70.
［3］罗磊. 形状分解和基于机器学习的图像检索技术研究［D］. 长沙:国防科学技术大学, 2013.
［4］王宇,林成德. 非局部二值模式人脸表示与识别方法［J］. 厦门大学学报(自然科学版), 2009,48(2):207-211.
［5］ Zhang Jianguo, Marszalek M, Lazebnik S, et al. Local features and kernels for classification of texture and object categories: A comprehensive study［J］. International Journal of Computer Vision, 2007,73(2):213-238.
［6］ Coifman R R, Lafon S. Diffusion maps［J］. Applied and Computational Harmonic Analysis, 2006,21(1):5-30.
［7］邓乃扬,田英杰. 数据挖掘中的新方法:支持向量机［M］. 北京:科学出版社, 2004.
［8］ Zhang Jing, Li Guili, He Seok-wun. Texture-based image retrieval by edge detection matching GLCM［C］// Proceedings of the 10th IEEE Intemational Conference on High Performance Computing and Communications. 2008:782-787.
［9］ Lazebnik S, Schmid C, Ponce J. Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories［C］// Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. 2006:2169-2178.
［10］Frey B, Dueck D. Clustering bypassing messages between data points［J］. Science, 2007,315(5814):972-976.
［11］张磊. 基于机器学习的图像检索若干问题研究［D］. 济南:山东大学, 2011.
［12］Steinwart I. Sparseness of support vector machines［J］. The Journal of Machine Learning Research, 2003,4:1071-1105.
［13］Zhu Feng, Zhang Xian-da, Hu Ya-feng. Gabor filter approach to joint feature extraction and target recgnition［J］. IEEE Transactions on Aerospace and Electronic Systems, 2009,45(1):17-30.
［14］Opelt A, Fussenegger M, Pinz A, et al. Weak hypotheses and boosting for generic object detection and recognition［C］// Lecture Notes in Computer Science 2004. 2004, 3022:71-84.



[1]	WANG Hong-jie, XU Sheng-chao, YANG Bo, MAO Ming-yang, JIANG Jin-ling. Automatic Arrangement Method of Cloud Network Security Service Chain Based on SRv6 Technology [J]. Computer and Modernization, 2024, 0(01): 1-5.
[2]	HU Chong-jia, LIU Jin-zhou, FANG Li. Unsupervised Domain Adaptation for Outdoor Point Cloud Semantic Segmentation [J]. Computer and Modernization, 2024, 0(01): 74-79.
[3]	HUANG Yu-ting, CHEN Lin, LIN Hong-gang, . An Importance Assessment Method of Network Assets in Critical Information Infrastructure Based on Percolation Theory [J]. Computer and Modernization, 2023, 0(11): 51-56.
[4]	CHEN Chen, ZHUANG Yi, GAO Zeng. QoE-driven High-availability Transmission Framework for SDN [J]. Computer and Modernization, 2023, 0(11): 62-68.
[5]	LI Xiang, ZHUANG Yi. Critical Fault Point Identification Method for Routing Algorithms Using XGBoost [J]. Computer and Modernization, 2023, 0(11): 75-81.
[6]	JIANG Hou-hai, ZHUANG Yi, CAO Zi-ning. A Fast Failure Recovery Scheme for SDN Based on Flow Aggregation and Congestion Avoidance [J]. Computer and Modernization, 2023, 0(10): 77-83.
[7]	WANG Hong-jie, XU Sheng-chao. Clustering Method of Cloud Platform Abnormal Transmission Data Based on Hilbert Similarity [J]. Computer and Modernization, 2023, 0(09): 27-31.
[8]	YANG Liu-qing, WANG Chong. Personalized Recommendation Method of Web Service Resources Based on Maximum Entropy [J]. Computer and Modernization, 2023, 0(09): 32-37.
[9]	JIANG Hou-hai, ZHUANG Yi, CAO Zi-ning. SDN Reliability Evaluation Algorithm Based on Improved BDD [J]. Computer and Modernization, 2023, 0(09): 64-69.
[10]	XIAO Hang, LI Peng, MA Hui-ping, ZHU Feng, . RFID System Security Analysis Model Based on Stochastic Petri Net [J]. Computer and Modernization, 2023, 0(09): 105-114.
[11]	CHEN Gang, WANG Zhi-jian, XU Sheng-chao. Mobile Edge Computing Task Offloading Based on Feasible Point Tracking Continuous#br# Convex Approximation [J]. Computer and Modernization, 2023, 0(08): 93-97.
[12]	YANG Bo, XU Sheng-chao. Security Protection Method of Cloud Network Special Line Scenarios Based on SRv6#br# Service Chain [J]. Computer and Modernization, 2023, 0(08): 107-111.
[13]	LEI Yi-han, CAO Li-feng, HAN Meng-da, HAN Xue. Security Handover Architecture and Method for Software Defined Space-ground#br# Integration Network [J]. Computer and Modernization, 2023, 0(08): 119-126.
[14]	WANG Liu, ZHU Yi-xin, HAN Li-ying. Opinion Leaders Mining Method Based on Improved Hits Algorithm [J]. Computer and Modernization, 2023, 0(06): 39-42.
[15]	LI Jin-hai, HU Xu. Analysis of Hot Topics of College Online Public Opinion Based on Baidu Tieba [J]. Computer and Modernization, 2020, 0(09): 12-18.