Image Semantic Segmentation Based on Region Proposal Network

doi:10.3969/j.issn.1006-2475.2018.02.025

Abstract

Abstract: In order to improve the problems of roughness and lack of detail in the semantic segmentation of image, a joint network structure is proposed, which combines the regional proposal network and realizes the convolution layer sharing. The regional proposal network is used to generate some regional proposal boxes which contain category information. The regional proposal boxes are used to correct the segmentation results of the fully convolutional semantic segmentation network. Experiments show that this method can effectively improve the classification accuracy of pixels and get better segmentation results.

Key words: computer vision, semantic segmentation, region proposal, fully convolution network

CLC Number:

TP391

YANG Zhi-yao1,2, PENG Zhao-yi1,2, WEN Zhi-qiang1,2. Image Semantic Segmentation Based on Region Proposal Network[J]. Computer and Modernization, doi: 10.3969/j.issn.1006-2475.2018.02.025.

References

［1］ Ostu N. A threshold selection method from gray-level histograms ［J］. IEEE Transactions on Systems Man & Cybernetics, 1979,9(1):62-66.
［2］ Muthukrishnan R, Radha M. Edge detection techniques for image segmentation［J］. International Journal of Computer Science & Information Technology, 2011,3(6):259-267.
［3］ Adams R, Bischof L. Seeded region growing［J］. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1994,16(6):641-647.
［4］魏云超,赵耀. 基于DCNN的图像语义分割综述［J］. 北京交通大学学报, 2016,40(4):82-91.
［5］姜枫,顾庆,郝慧珍,等. 基于内容的图像分割方法综述［J］. 软件学报, 2017,28(1):160-183.
［6］ Ren Xiaofeng, Malik J. Learning a classification model for segmentation［C］// Proceedings of the 9th IEEE International Conference on Computer Vision. 2003:10.
［7］ Otha Y, Kanade T, Sakai T. An analysis system for scenes containing objects with substructures［C］// Proceedings of the 4th International Joint Conference on Pattern Recognitions. 1978:752-754.
［8］张继昊. 基于SOFM自组织特征映射网络的图像语义分割与标识［D］. 上海:上海交通大学, 2010.
［9］ Krizhevsky A, Sutskever I, Hinton G E. ImageNet classification with deep convolutional neural networks［C］// Proceedings of the 25th International Conference on Neural Information Processing Systems. 2012:1097-1105.
［10］Sermanet P, Eigen D, Zhang Xiang, et al. Overfeat: Integrated recognition, localization and detection using convolutional networks［J］. Computer Science, 2013:arXiv:1312.6229.
［11］Girshick R, Donahue J, Darrell T, et al. Rich feature hierarchies for accurate object detection and semantic segmentation［C］// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2014:580-587.
［12］He Kaiming, Zhang Xiangyu, Ren Shaoqing, et al. Spatial pyramid pooling in deep convolutional networks for visual recognition［J］. IEEE Transactions on Pattern Analysis & Machine Intelligence, 2015,37(9):1904-1916.
［13］Ren Shaoqing, He Kaiming, Girshick R, et al. Faster R-CNN: Towards real-time object detection with region proposal networks［J］. IEEE Transactions on Pattern Analysis & Machine Intelligence, 2017,39(6):1137-1149.
［14］Shelhamer E, Long J, Darrell T. Fully convolutional networks for semantic segmentation［J］. IEEE Transactions on Pattern Analysis & Machine Intelligence, 2014,39(4):640-651.
［15］Zeiler M D, Fergus R. Visualizing and understanding convolutional networks［C］// European Conference on Computer Vision. 2014:818-833.
［16］Baydin A G, Pearlmutter B A, Radul A A, et al. Automatic differentiation in machine learning: A survey［J］. Computer Science, 2015.
［17］Bottou L. Large-scale machine learning with stochastic gradient descent［C］// Proceedings of COMPSTAT2010. 2010:177-186.
［18］Girshick R, Donahue J, Darrell T, et al. Rich feature hierarchies for accurate object detection and semantic segmentation［C］// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2014:580-587.

[1]	HU Chong-jia, LIU Jin-zhou, FANG Li. Unsupervised Domain Adaptation for Outdoor Point Cloud Semantic Segmentation [J]. Computer and Modernization, 2024, 0(01): 74-79.
[2]	LIANG Tian-kai, HUANG Kang-hua, LIU Kai-hang, LAN Lan, ZENG Bi. Deep Federated Image Classification Method Based on Bilateral Homomorphic Encryption [J]. Computer and Modernization, 2023, 0(12): 36-40.
[3]	XU Hong-kui, LI Zhen-ye, GUO Wen-tao, ZHAO Jing-zheng, GUO Xu-bin. Real-time Detection of Arbitrary Shape Scene Text Based on Segmentation [J]. Computer and Modernization, 2023, 0(11): 95-100.
[4]	YE Si-jia, WEI Yan, DU Han-yu, DENG Jin-zhi. HRNet Image Semantic Segmentation Algorithm Combined with Attention Mechanism [J]. Computer and Modernization, 2023, 0(10): 65-69.
[5]	LIU Xu, ZHA Ke-ke. An Environmental Target Recognition Method for Airport Special Vehicle Operation [J]. Computer and Modernization, 2023, 0(08): 18-24.
[6]	NIU Yu-heng, LI Yong-ke, CHEN Yan-hong, JANG Ping-an. Image Segmentation Method of Residual Film on Cotton Field Surface Based on Improved SegFormer Model#br# [J]. Computer and Modernization, 2023, 0(07): 93-98.
[7]	YE Li-ming, CHEN Wei-wen. A Cascaded Insulator Defect Detection Model Combining Semantic Segmentation and Object Detection [J]. Computer and Modernization, 2023, 0(06): 82-88.
[8]	WU Song-lin, ZHANG Guo-wei, LU Qiu-hong, SHI Jian-zhuang, HUANG Wei. Laser SLAM Mapping Method Based on Visual Information [J]. Computer and Modernization, 2023, 0(02): 17-23.
[9]	HUANG Yan-hui, LAN Hai, WEI Xian. Lightweight Vision Transformer Based on Separable Structured Transformations [J]. Computer and Modernization, 2022, 0(10): 75-81.
[10]	LI Wei-qiang, WANG Dong, NING Zheng-tong, LU Ming-liang, QIN Peng-fei. Survey of Fruit Object Detection Algorithms in Computer Vision [J]. Computer and Modernization, 2022, 0(06): 87-95.
[11]	WANG Tian-xing, YUAN Jia-bin, LIU Xin. Approach for Visual Question Answering Based on Equal Attention Graph Networks [J]. Computer and Modernization, 2021, 0(11): 1-6.
[12]	TANG Shu-fang, WANG Zhi-sheng. Semantic Segmentation of Street Scenes Based on Double Attention Mechanism [J]. Computer and Modernization, 2021, 0(10): 69-74.
[13]	ZHOU Jing-wei, HAN Li-xin, LI Xiao-shuang. Target Tracking Algorithm Based on Multimodal Data [J]. Computer and Modernization, 2020, 0(11): 16-22.
[14]	ZHOU Xian-lai. Big Data Mining Algorithm of Heterogeneous Multi-core Platform Based on Semantic Segmentation [J]. Computer and Modernization, 2020, 0(10): 40-43.
[15]	ZHU Da-qing, CAO Guo. Particle Size Detection of Sandstone Images Based on Full Convolutional Network [J]. Computer and Modernization, 2020, 0(07): 111-116.