基于双目视觉去除附着噪声的改进算法

doi:10.3969/j.issn.1006-2475.2023.06.011

计算机与现代化 ›› 2023, Vol. 0 ›› Issue (06): 62-68.doi: 10.3969/j.issn.1006-2475.2023.06.011

基于双目视觉去除附着噪声的改进算法

彭明康, 冯成德

四川大学机械工程学院,四川成都 610065

收稿日期:2022-05-08 修回日期:2022-08-28 出版日期:2023-06-28 发布日期:2023-06-28
通讯作者: 冯成德（1962—）,男,江苏启东人,副教授,硕士,研究方向：机器视觉,数字图像处理,E-mail： fcd98@sina.com。
作者简介:彭明康（1997—）,男,四川达州人,硕士研究生,研究方向：机器视觉,E-mail： 1286636089@qq.com。
基金资助:
四川省科技计划项目（重点研发项目）（2020YFN0010）

An Improved Algorithm of Removing Adherent Noise Based on Binocular Vision

PENG Ming-kang, FENG Cheng-de

School of Mechanical Engineering, Sichuan University, Sichuan 610065, China

Received:2022-05-08 Revised:2022-08-28 Online:2023-06-28 Published:2023-06-28

摘要/Abstract

摘要： 为去除因镜头或保护镜面上的附着物引起的图像噪声,提出一种基于双目视觉的快速去噪算法。首先通过引入分步匹配与积分图,实现实际视差图的快速计算。其次,利用双目相机与附着物所在镜面的间距计算附着噪声的理论视差,并结合实际视差图完成噪声定位。接着利用图像修复对噪声区域视差进行估计,得到被附着噪声所遮挡像素的视差。最后针对左图噪声像素,利用估计视差找到右图对应干净像素并替换,完成附着噪声去除。实验对比本文算法与现有的基于双目视觉去噪算法,结果表明,该算法在保证较好去噪效果的同时,去噪速度得到显著提升。本文方法对比学习类去噪算法,具有去噪效果稳定,不易误识别的优势。

关键词: 附着噪声, 双目视觉, 分步匹配, 积分图像

Abstract: In order to remove the image noise caused by the attachments on the lens or protective glass, a fast denoising algorithm based on binocular vision is proposed. Firstly, by introducing the step-by-step matching and integral map, the fast calculation of the real disparity map is realized. Secondly, the theoretical disparity of the attached noise is calculated by using the distance between the binocular camera and the glass where the attachment is located, and the noise localization is completed in combination with the actual disparity map. Then, image inpainting is used to estimate the disparities of the noise area, and the disparities of the pixels occluded by the attached noise is obtained. Finally, for the noise pixels in the left image, the estimated disparity is used to find the corresponding clean pixels in the right image and replace them to complete the removal of attached noise. The experiment compares the algorithm with the existing binocular vision-based denoising algorithm, and the results show that the algorithm can significantly improve the denoising speed while ensuring similar denoising effect. Compared with the learning-based denoising algorithm, this method has the advantages of stable denoising effect and will not identify other areas as noise.

Key words: adherent noise, binocular vision, step by step matching, integral image

中图分类号:

TP391.4

彭明康, 冯成德. 基于双目视觉去除附着噪声的改进算法[J]. 计算机与现代化, 2023, 0(06): 62-68.

PENG Ming-kang, FENG Cheng-de. An Improved Algorithm of Removing Adherent Noise Based on Binocular Vision[J]. Computer and Modernization, 2023, 0(06): 62-68.

参考文献

[1] JIAN C, GAO J, AO Y.Automatic surface defect detection for mobile phone screen glass based on machine vision[J]. Applied Soft Computing, 2017,52:348-358.
[2] ZHU H.An efficient lane line detection method based on computer vision[J]. Journal of Physics Conference Series, 2021,1802(3):109-118.
[3] ARAKERI M P, LAKSHMANA. Computer vision based fruit grading system for quality evaluation of tomato in agriculture industry[J]. Procedia Computer Science, 2016,79:426-433.
[4] NARASIMHAN S G, NAYAR S K.Contrast restoration of weather degraded images[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2003,25(6):713-724.
[5] REN W, TIAN J, HAN Z, et al.Video desnowing and deraining based on matrix decomposition[C]// 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2017:2838-2847.
[6] VAZ JUNIOR E S, DREWS JUNIOR P J L, STEFFENS C R. Restoration of images affected by welding fume[C]// 2018 31st SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI). 2018:72-78.
[7] HAMZEH Y, RAWASHDEH S A.A review of detection and removal of raindrops in automotive vision systems[J]. Journal of Imaging, 2021,7(3):202-257.
[8] FOUAD E, SALMA A, ABDELHAK E.Modelisation of raindrops based on declivity principle[C]// 2016 13th International Conference on Computer Graphics, Imaging and Visualization (CGiV). 2016:249-252.
[9] KURIHATA H, TAKAHASHI T, IDE I, et al.Rainy weather recognition from in-vehicle camera images for driver assistance[C]// 2005 IEEE Intelligent Vehicles Symposium. 2005:205-210.
[10] HALIMEH J C, ROSER M.Raindrop detection on car windshields using geometric-photometric environment construction and intensity-based correlation[C]// 2009 IEEE Intelligent Vehicles Symposium. 2009:610-615.
[11] ROSER M, GEIGER A.Video-based raindrop detection for improved image registration[C]// 2009 IEEE 12th International Conference on Computer Vision Workshops. 2009:570-577.
[12] WU Q, ZHANG W, KUMAR B V K V. Raindrop detection and removal using salient visual features[C]// 2012 19th IEEE International Conference on Image Processing. 2012:941-944.
[13] CORD A, GIMONET N.Detecting unfocused raindrops: In-vehicle multipurpose cameras[J]. IEEE Robotics & Automation Magazine, 2014,21(1):49-56.
[14] LIAO H, WANG D, YANG C, et al.Video-based water drop detection and removal method for a moving vehicle[J]. Information Technology Journal, 2013,12(4):569-583.
[15] YAMASHITA A, KANEKO T, MIURA K T.A virtual wiper-restoration of deteriorated images by using a pan-tilt camera[C]// 2004 IEEE International Conference on Robotics and Automation. 2004:4724-4729.
[16] YAMASHITA A, TANAKA Y, KANEKO T.Removal of adherent waterdrops from images acquired with stereo camera[C]// 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems. 2005:400-405.
[17] VOULODIMOS A, DOULAMIS N, DOULAMIS A, et al.Deep learning for computer vision: A brief review[J]. Computational Intelligence and Neuroscience, 2018,2018:1-13.
[18] GUO Y, LIU Y, OERLEMANS A, et al.Deep learning for visual understanding: A review[J]. Neurocomputing, 2016,187:27-48.
[19] EIGEN D, KRISHNAN D, FERGUS R.Restoring an image taken through a window covered with dirt or rain[C]// 2013 IEEE International Conference on Computer Vision. 2013:633-640.
[20] QIAN R, TAN R T, YANG W, et al.Attentive generative adversarial network for raindrop removal from a single image[C]// 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2018:2482-2491.
[21] YANG P, CHEN L, TIAN J, et al.Dust particle detection in surveillance video using salient visual descriptors[J]. Computers & Electrical Engineering, 2017,62:224-231.
[22] GU J, RAMAMOORTHI R, BELHUMEUR P, et al.Removing image artifacts due to dirty camera lenses and thin occluders[J]. ACM Transactions on Graphics, 2009,28(5):1-10.
[23] HAO Z, YOU S, LI Y, et al.Learning from synthetic photorealistic raindrop for single image raindrop removal[C]// 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW). 2019:4340-4349.
[24] PORAV H, BRULS T, NEWMAN P.I can see clearly now: Image restoration via de-raining[C]// 2019 International Conference on Robotics and Automation (ICRA). 2019:7087-7093.
[25] QUAN Y, DENG S, CHEN Y, et al.Deep learning for seeing through window with raindrops[C]// 2019 IEEE/CVF International Conference on Computer Vision (ICCV). 2019:2463-2471.
[26] SCHARSTEIN D, SZELISKI R, ZABIH R.A taxonomy and evaluation of dense two-frame stereo correspondence algorithms[C]// Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001). 2001:131-140.
[27] VIOLA P, JONES M.Rapid object detection using a boosted cascade of simple features[C]// Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. 2001:511-518.
[28] 邵平,杨路明. 基于模板分解和积分图像的快速Kirsch边缘检测[J]. 自动化学报, 2007,33(8):795-800.
[29] 欧阳鑫玉,张娟娟,赵楠楠,等. 基于NCC的改进立体匹配算法[J]. 微型机与应用, 2015,34(3):54-57.
[30] TELEA A.An image inpainting technique based on the fast marching method[J]. Journal of Graphics Tools, 2004,9(1):23-34.

基于双目视觉去除附着噪声的改进算法

An Improved Algorithm of Removing Adherent Noise Based on Binocular Vision

PDF (PC)

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 2

编辑推荐

Metrics

本文评价

[1]	郭兆明, 周庆华, 曾小为. 基于双目视觉的缺陷药片检测[J]. 计算机与现代化, 2021, 0(11): 56-60.
[2]	化春键1,2，方程骏1,2，陈莹3. 基于改进Census变换的自由曲面立体匹配方法[J]. 计算机与现代化, 2015, 0(7): 44-.