Optimizing Web Page Classification Algorithm by Using Hyperlinks

doi:10.3969/j.issn.1006-2475.2014.05.004

Abstract

Abstract: There is a problem in the Web page classification algorithm by using hyperlinks, the noise neighbors interfere with the results of the classification. To solve the problem an optimization method was presented, which utilizes the similarities between pages. If neighbors meet the thresholds, they are set different weights for different relationships. The results of classification by support vector machine are also used. Experiment shows that it increases in precision, recall and F1 value.


Key words: Web page classification, neighboring page, similarity, support vector machine

CLC Number:

TP391

JIANG Zong-li, SHI Fu-lin. Optimizing Web Page Classification Algorithm by Using Hyperlinks[J]. Computer and Modernization, 2014, 0(5): 14-17,23.

References

［1］中国互联网络中心(CNNIC). 第33次中国互联网络发展状况统计报告［EB/OL］. http://www.cnnic.net.cn/hlwfzyj/hlwxzbg/hlwtjbg/201403/t20140305_46240.htm, 2014-03-05. 
［2］ Fiol-Roig G, Miró-Julià M, Herraiz E. Data mining techniques for Web page classification［J］. Highlights in Practical Applications of Agents and Multiagent Systems, 2011,89:61-68.
［3］〖JP2〗Baykan E, Henzinger M, Marian L, et al. A comprehensive study of features and algorithms for URL-based topic classification［J］. ACM Transactions on the Web (TWEB), 2011,5(3):No 15.
［4］ Sriurai W, Meesad P, Haruechaiyasak C. Improving Web page classification by integrating neighboring pages via a topic model［C］// Proceedings of IICS, 2010. 2010:238-246.
［5］ Qi X, Davison B D. Classifiers without borders: Incorporating fielded text from neighboring Web pages［C］// Proceedings of the 31st Annual International ACM SIGIR Conference on Research & Development on Information Retrieval. 2008:643-650.
［6］ Croft W B, Metzler D, Strohman T. Search engines: Information Retrieval in Practice ［M］. Addison-Wesley, 2010:351-358.
［7］姚旭,王晓丹,张玉玺,等. 特征选择方法综述［J］. 控制与决策, 2012, 27(2):161-166,192.
［8］ Issac B, Jap W J. Implementing spam detection using Bayesian and Porter Stemmer keyword stripping approaches［C］// IEEE Region 10 Conference on TENCON 2009-2009. 2009:1-5.
［9］施聪莺,徐朝军,杨晓江. TFIDF 算法研究综述［J］. 计算机应用, 2009,29(S1):167-170,180.
［10］任永功,杨荣杰,尹明飞,等. 基于信息增益的文本特征选择方法［J］. 计算机科学, 2012,39(11):127-130.
［11］AOL Inc.. The Open Directory Project(ODP)［EB/OL］. http://www.dmoz.org/, 2013-03-01.
［12］Jagarlamudi J, Bennett P N, Svore K M. Leveraging interlingual classification to improve Web search［C］// Proceedings of the 21st International Conference Companion on World Wide Web. 2012:535-536.
［13］何忠秀,王霜,安礼成. 基于向量空间的网页内容相似度计算方法研究［J］. 计算机与现代化, 2010(9):53-55,58.
［14］郭庆琳, 李艳梅, 唐琦. 基于 VSM 的文本相似度计算的研究［J］. 计算机应用研究, 2008, 25(11):3256-3258.
［15］Menon A K. Large-Scale Support Vector Machines: Algorithms and Theory［R］. Research Exam, University of California, San Diego, 2009.
［16］Chang C C, Lin C J. LIBSVM: A library for support vector machines ［J］. ACM Transactions on Intelligent Systems and Technology (TIST), 2011,2(3):27-53.
［17］奉国和. 文本分类性能评价研究［J］. 情报杂志, 2011, 30(8):66-70.

[1]	YANG Jun1, HU Wei1, ZHU Wenfu2. Visual SLAM Loop Closure Detection Algorithm Based on Improved MobileNetV3 [J]. Computer and Modernization, 2024, 0(10): 21-26.
[2]	LIU Wenliang1, WU Fei1, HE Deming1, ZHAO Weiwei2, PAN Jianhong3. Text Clustering Method for Fragmented Reply Based on Dissimilarity Matrix [J]. Computer and Modernization, 2024, 0(09): 56-60.
[3]	CAO Ning1, YAN Xin’e1, XU Genqi2, XU Youwen1, ZHANG Zhengbo2, DU Qianyun2. Prediction Model of Hydraulic Engineering Slope Mechanical Parameters Based on DEFA-LSSAR [J]. Computer and Modernization, 2024, 0(07): 106-111.
[4]	WANG Zhiqiang, ZHENG Shuang. Semi-supervised Image Generation Model Based on StyleGAN [J]. Computer and Modernization, 2024, 0(06): 14-18.
[5]	Renqingzhuoma1, 2, 3, Yongcuo1, 2, 3, TANG Chaochao1, 2, 3. Data Filtering Strategies for Tibetan-Chinese Neural Machine Translation [J]. Computer and Modernization, 2024, 0(06): 19-24.
[6]	CAO Ning1, XU Genqi2, ZHANG Wen3, XU Youwen1, HE Panqing1. Prediction Method of Mountain Flood Disaster Based on AFSPSO-ν-SVM [J]. Computer and Modernization, 2024, 0(05): 33-37.
[7]	YANG Bo, ZHUANG Yi. Fault Detection Method of Control Cluster Based on AOA-MSVM [J]. Computer and Modernization, 2023, 0(12): 112-116.
[8]	WANG Hong-jie, XU Sheng-chao. Clustering Method of Cloud Platform Abnormal Transmission Data Based on Hilbert Similarity [J]. Computer and Modernization, 2023, 0(09): 27-31.
[9]	WANG Hong, GE Hong. Cross Modal Hash Retrieval Based on Attention Mechanism and Semantic Similarity [J]. Computer and Modernization, 2023, 0(08): 44-53.
[10]	SHEN Zhi, LI Yuan. Nonlinear Process Fault Detection Based on KPCA and SSA Optimized SVM [J]. Computer and Modernization, 2023, 0(06): 15-20.
[11]	YIN Jian-feng, WEI Xin, GU Xiong-wei, HUANG Kai, WEI Min-jie. Digital Identification of Electric Meter Based on Image Threshold Optimization and Improved SVM [J]. Computer and Modernization, 2023, 0(05): 106-110.
[12]	LIU Guo-li, XU Hong-nan, TAN You-qian. Collaborative Filtering Recommendation Algorithm Combined with Expert Trust [J]. Computer and Modernization, 2022, 0(11): 60-68.
[13]	TIAN Feng, DENG Xiao-ping, ZHANG Gui-qing, WANG Bao-yi. A Non-intrusive Load Monitoring Method Based on Improved kNN Algorithm and Transient Steady State Features [J]. Computer and Modernization, 2022, 0(10): 29-35.
[14]	ZENG Yi-bin, GE Hong. Cross-modal Retrieval Based on Context Fusion and Multi-similarity Learning [J]. Computer and Modernization, 2022, 0(08): 50-56.
[15]	ZOU Meng-yuan, FAN Zhi-qiang, XU Luo, LIU Jie, LIANG Wan-lu. Similarity Measurement Method of Inf-ProA Information Activity Process Model [J]. Computer and Modernization, 2022, 0(02): 26-32.