计算机与现代化 ›› 2021, Vol. 0 ›› Issue (05): 26-30.

• 图像处理 • 上一篇    下一篇

基于深度图像增益的RGB-D显著性物体检测

  

  1. (青岛大学计算机科学技术学院,山东青岛266000)
  • 出版日期:2021-06-03 发布日期:2021-06-03
  • 作者简介:魏计鹏(1995—),男,山东济宁人,硕士研究生,研究方向:深度学习,计算机视觉,E-mail: qdu1995@163.com; 秦国峰(1995—),男,硕士研究生, 研究方向:机器学习,图像聚类,E-mail: guofeng_qin@yeah.net。

RGB-D Salient Object Detection Based on Depth Image Gain

  1. (College of Computer Science and Technology, Qingdao University, Qingdao 266000, China)
  • Online:2021-06-03 Published:2021-06-03

摘要: 深度信息已被证明在显著性物体检测中是一个实用信息,但是深度信息和RGB信息如何更好地实现互补从而达到更高的性能仍是一个值得探究的事情。为此,本文提出一种基于深度图像增益的RGB-D显著性物体检测方法。在双分支的网络结构中增加一个增益子网,采用显著图作差的方法获得深度图片为显著性检测带来的增益,作为增益子网预训练的伪GT。三分支网络分别获取RGB特征、深度特征和深度增益信息,最终将三分支的特征进行融合得到最终的显著性物体检测的结果,增益信息为双分支特征融合提供融合依据。基于深度图像增益的显著性物体检测实验结果表明,该方法得到的显著性物体前景物体更加突出,在多个实验数据集上也有着更优秀的表现。

关键词: 深度信息; 显著性物体检测, 图像增益

Abstract: Depth information has been proved to be practical information for salient object detection, but it is still a matter worth exploring that how can the depth information and RGB information complement each other better so as to achieve higher performance. To this end, this paper proposes a RGB-D salient object detection method based on depth image gain. A gain subnet is added to the double-branch network structure, and the gain of the depth image for saliency detection is obtained by the method of saliency map difference, which is used as a pseudo GT for the gain subnet pre-training. The three-branch network separately obtains RGB features, depth features, and depth gain information, and finally fuses the features of the three branches to obtain the final salient object detection result, the gain information provides the fusion basis for the two branch feature fusion. The experimental results of salient object detection based on depth image gain show that the salient object foreground object obtained by this method is more prominent, and it has better performance on multiple experimental datasets.

Key words: depth information, salient object detection, image gain