Computer and Modernization

Previous Articles     Next Articles

Unsupervised Video Object Segmentation with Fully Convolutional Network

  

  1. (College of Computer and Communication Engineering, China University of Petroleum, Qingdao 266580, China)
  • Received:2018-12-13 Online:2019-06-14 Published:2019-06-14

Abstract: Pixel-level object segmentation in videos is a research hotspot in the field of computer vision. Unsupervised video segmentation without user annotation imposes higher requirements on segmentation algorithms. In recent years, the modeling methods based on inter-frame motion information are often used, that is, the motion information such as optical flow is used to predict the target contour, and the model is built based on features such as color for segmentation. Concerning the problems such as confusion of foreground and background and the rough edges caused by these methods, this paper proposes a video object segmentation method that combines fully convolutional neural network features. Firstly, the contour of the salient object in the video sequence is predicted through fully convolutional network and modified combining with motion saliency label obtained by optical flow. Then a time-space diagram model is established, the final segmentation result is obtained by using the graph cut method. The proposed method is evaluated on SegTrack v2 and DAVIS general datasets. The results show that the proposed method has better segmentation performance than the method based on inter-frame motion information.

Key words: video segmentation, object segmentation, deep feature, unsupervised, fully convolutional network

CLC Number: