一种结合语义分割和目标检测的级联式绝缘子缺陷检测方法

doi:10.3969/j.issn.1006-2475.2023.06.014

计算机与现代化 ›› 2023, Vol. 0 ›› Issue (06): 82-88.doi: 10.3969/j.issn.1006-2475.2023.06.014

一种结合语义分割和目标检测的级联式绝缘子缺陷检测方法

叶力鸣, 陈蔚文

北京师范大学香港浸会大学联合国际学院,广东珠海 519087

收稿日期:2022-05-13 修回日期:2022-09-09 出版日期:2023-06-28 发布日期:2023-06-28
作者简介:叶力鸣（2000—）,男,广东佛山人,本科生,研究方向：数据科学,E-mail： 764471948@qq.com; 陈蔚文（2001—）,男,广东惠州人,本科生,研究方向：数据科学,E-mail： 845726269@qq.com。

A Cascaded Insulator Defect Detection Model Combining Semantic Segmentation and Object Detection

YE Li-ming, CHEN Wei-wen

Beijing Normal University-Hong Kong Baptist University United International College, Zhuhai 519087, China

Received:2022-05-13 Revised:2022-09-09 Online:2023-06-28 Published:2023-06-28

摘要/Abstract

摘要： 绝缘子缺陷检测是变电站日常巡检的重要部分。由于变电站内环境复杂,绝缘子缺陷检测易受到背景因素干扰。因此,本文提出一种结合语义分割和目标检测的级联式绝缘子缺陷检测模型。该模型由绝缘子分割、绝缘子裁减、缺陷检测3个模块组成。绝缘子分割模块将绝缘子从复杂的环境中分离并提出一种边缘增强的损失函数;绝缘子裁减模块利用图像处理方法获得轴对齐的绝缘子区域;缺陷检测模块完成缺陷的检测。实验结果表明,级联式绝缘子缺陷检测模型的整体准确率为60.63%。其中,边缘加权的Unet对绝缘子的分割准确率达到83.99%,锚框改进的RetinaNet对缺陷的检测准确率达到63.32%。与单级绝缘子缺陷检测模型对比分析,所提出的级联式绝缘子缺陷检测模型可有效地去除环境因素干扰,检测出大部分的绝缘子缺陷区域。

关键词: 级联式绝缘子缺陷检测模型, 图像处理, 语义分割, 目标检测

Abstract: Insulator defect detection is an important part of the routine inspection of substations. Using the video surveillance images in the substation, we propose a cascaded insulator defect detection model that combines semantic segmentation with object detection aiming at the low detection accuracy of the insulator defect detection model. The model consists of three modules： Insulator segmentation, insulator cutting and defect detection. The insulator segmentation module separates the insulator from the complex environment and proposes an edge enhancement loss function. The insulator cutting module uses the image processing method to obtain the insulator region aligned with the axis. The defect detection module completes the defect detection. Experiment results show that the accuracy of edge-enhanced Unet for insulator segmentation reaches 83.99%, and the accuracy of RetinaNet with improved anchor generation method for defect detection reaches 63.32%. Compared with the single-stage insulator defect detection model, the proposed cascade insulator defect detection model can effectively eliminate the interference of environment, detecting most of the insulator defects.

Key words: cascaded insulator defect detection model, image processing, semantic segmentation, object detection

中图分类号:

TP309

叶力鸣, 陈蔚文. 一种结合语义分割和目标检测的级联式绝缘子缺陷检测方法[J]. 计算机与现代化, 2023, 0(06): 82-88.

YE Li-ming, CHEN Wei-wen. A Cascaded Insulator Defect Detection Model Combining Semantic Segmentation and Object Detection[J]. Computer and Modernization, 2023, 0(06): 82-88.

参考文献 27

[1]	张晶晶,韩军,赵亚博,等. 形状感知的绝缘子识别与缺陷诊断[J]. 中国图象图形学报, 2014,19(8):1194-1201.
[2]	姜浩然,金立军,闫书佳. 航拍图像中绝缘子的识别与故障诊断[J]. 机电工程, 2015,32(2):274-278.
[3]	ZHAI Y J, WANG D, ZHANG M L, et al.Fault detection of insulator based on saliency and adaptive morphology[J]. Multimedia Tools and Applications, 2017,76(9):12051-12064.
[4]	CHENG H, ZHAI Y, CHEN R, et al.Self-shattering defect detection of glass insulators based on spatial features[J]. Energies, 2019,12(3):543-547.
[5]	周莉莉,姜枫. 图像分割方法综述研究[J]. 计算机应用研究, 2017,34(7):1921-1928.
[6]	LI S, ZHOU H, WANG G, et al.Cracked insulator detection based on R-FCN[J]. Journal of Physics Conference Series, 2018,1069(1). DOI:10.1088/1742-6596/1069/1/012147.
[7]	DAI J F, LI Y, HE K M, et al.R-FCN: Object detection via region-based fully convolutional networks[C]// Proceedings of the 30th International Conference on Neural Information Processing Systems. 2016:379-387.
[8]	SHRIVASTAVA A, GUPTA A, GIRSHICK R.Training region-based object detectors with online hard example mining[C]// 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2016:761-769.
[9]	RONNEBERGER O, FISCHER P, BROX T. U-Net: Convolutional networks for biomedical image segmentation[J]. arxiv preprint arxiv:1505.04597,2015.
[10]	田萱,王子亚,王建新.基于语义分割的食品标签文本检测[J].农业机械学报,2020,51(08):336-343.
[11]	司垒,王忠宾,熊祥祥,等. 基于改进U-net网络模型的综采工作面煤岩识别方法[J]. 煤炭学报, 2021,46(S1):578-589.
[12]	LONG J, SHELHAMER E, DARRELL T.Fully convolutional networks for semantic segmentation[C]// 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2015:3431-3440.
[13]	ZHANG J, LIN S, DING L, et al.Multi-scale context aggregation for semantic segmentation of remote sensing images[J]. Remote Sensing, 2020,12(4):701.
[14]	ASGARI T S, ABHISHEK K, COHEN J P, et al.Deep semantic segmentation of natural and medical images: A review[J]. Artificial Intelligence Review, 2021,54(1):137-178.
[15]	CANNY J.A computational approach to edge detection[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1986(6):679-698.
[16]	REN S Q, HE K M, GIRSHICK R, et al.Faster R-CNN: Towards real-time object detection with region proposal networks[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017,39(6):1137-1149.
[17]	LIU W, ANGUELOV D, ERHAN D, et al.SSD: Single shot multiBox detector[C]// Computer Vision - ECCV 2016. 2016:21-37.
[18]	REDMON J, DIVVALA S, GIRSHICK R, et al.You only look once: Unified, real-time object detection[C]// 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2016:779-788.
[19]	LIN T Y, GOYAL P, GIRSHICK R, et al.Focal loss for dense object detection[C]// 2017 IEEE International Conference on Computer Vision (ICCV). 2017:2999-3007.
[20]	HAN J M, YANG Z, ZHANG Q Y, et al.A method of insulator faults detection in aerial images for high-voltage transmission lines inspection[J]. Applied Sciences, 2019,9(10):2009.
[21]	HE K M, ZHANG X Y, REN S Q, et al.Deep residual learning for image recognition[C]// 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2016:770-778.
[22]	LIN T Y, DOLLÁR P, GIRSHICK R, et al. Feature pyramid networks for object detection[C]// 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2017:936-944.
[23]	MACQUEEN J.Some methods for classification and analysis of multivariate observations[C]// Proceedings of the 5th Berkeley Symposium on Mathematical Statistics and Probability. 1967,1(14):281-297.
[24]	OTSU N.A threshold selection method from gray-level histograms[J]. IEEE Transactions on Systems, Man, and Cybernetics, 1979,9(1):62-66.
[25]	张莉,贾永红,程刚. 基于数学形态学的遥感影像边缘检测研究[J]. 地理空间信息, 2006(4):52-54.
[26]	REDMON J, FARHADI A.YOLO9000: Better, faster, stronger[C]// 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2017:6517-6525.
[27]	REDMON J, FARHADI A. YOLOv3: An incremental improvement[J]. arXiv preprint arXiv:1804.02767, 2018.

一种结合语义分割和目标检测的级联式绝缘子缺陷检测方法

A Cascaded Insulator Defect Detection Model Combining Semantic Segmentation and Object Detection

PDF (PC)

可视化

摘要/Abstract

引用本文

使用本文

参考文献 27

相关文章 15

编辑推荐

Metrics

本文评价

[1]	王秋忆, 周浩, 郑婷婷. 改进RetinaNet的电力设备目标检测方法[J]. 计算机与现代化, 2024, 0(01): 47-52.
[2]	胡崇佳, 刘金洲, 方立. 基于无监督域适应的室外点云语义分割[J]. 计算机与现代化, 2024, 0(01): 74-79.
[3]	许鸿奎, 李振业, 郭文涛, 赵京政, 郭旭斌. 基于分割的任意形状场景文本实时检测[J]. 计算机与现代化, 2023, 0(11): 95-100.
[4]	欧嘉城, 曾安, 金亮. 基于CP-YOLOX的冷冻电镜图像蛋白质目标检测算法[J]. 计算机与现代化, 2023, 0(11): 113-119.
[5]	闫子贤, 董宝良, 唐思谜. 针对复杂背景下低分辨率舰船目标的改进YOLOv7算法[J]. 计算机与现代化, 2023, 0(11): 120-126.
[6]	叶思佳, 魏延, 杜韩宇, 邓金枝. 结合注意力机制的HRNet图像语义分割算法[J]. 计算机与现代化, 2023, 0(10): 65-69.
[7]	顾成伟, 丁勇, 李登华. 基于计算机视觉的工业厂区人员安全警戒系统[J]. 计算机与现代化, 2023, 0(09): 20-26.
[8]	刘续, 查可可. 一种用于机场特种车辆作业的环境目标识别方法[J]. 计算机与现代化, 2023, 0(08): 18-24.
[9]	刘昱杉, 刘卫康, 刘庆华, 者甜甜, 王家晨. 基于YOLOX结合DeepSort的船载车辆行人检测算法[J]. 计算机与现代化, 2023, 0(08): 60-67.
[10]	欧阳飞, 吴旭, 向东升. 基于改进YOLOX的垃圾分类检测方法[J]. 计算机与现代化, 2023, 0(08): 68-73.
[11]	胡睿杰, 车逗. 红外小目标检测方法综述[J]. 计算机与现代化, 2023, 0(08): 79-86.
[12]	牛玉珩, 李永可, 陈燕红, 蒋平安. 基于改进SegFormer模型的棉田地表残膜图像分割方法[J]. 计算机与现代化, 2023, 0(07): 93-98.
[13]	罗伟, 刘思远, 徐健祥, 董天培. 基于改进YOLOv5s的太阳能电池缺陷检测算法[J]. 计算机与现代化, 2023, 0(07): 119-126.
[14]	王艺成, 张国良, 张自杰, . 基于改进YOLOv5的小目标检测方法[J]. 计算机与现代化, 2023, 0(05): 100-105.
[15]	邱地发, 于淑芳, 刘锦辉, 毕梦昭. 基于YOLOv5s的遥感图像的车辆小目标检测[J]. 计算机与现代化, 2023, 0(05): 122-126.