Infrared and Visible Images Registration Method for Electric Power Inspection

Abstract

Abstract: The failure of power equipment may cause power outages and affect the safe and stable operation of power grid. According to the characteristics of heat generated by power equipment during operation, an infrared and visible images registration method for power equipment is proposed to facilitate detection of abnormal heating faults. Firstly, the Sobel edge detection operator extracts edge information from infrared and visible images of power equipment to obtain edge images. Then the feature points of two edge images are detected by the SuperPoint algorithm and the descriptors are calculated, and the feature points are matched by the SuperGlue algorithm. Finally, the affine transformation model parameters are calculated by the least square method to realize the infrared and visible image registration of power equipment. The experimental results show that the method in this paper can achieve high-precision registration of infrared and visible images of power equipment.

Key words: image registration, power equipment, edge image, deep learning, neural network

LIU Xiao-kang, XIA Tian-lei, WU Chen-yuan, JIANG Xiong-biao, ZHOU Ming-yu, WANG Qing-hua. Infrared and Visible Images Registration Method for Electric Power Inspection[J]. Computer and Modernization, 2021, 0(09): 31-36.

References

［1］刘晓康,万曦,涂文超,等. 基于红外可见光图像配准的电力设备分割算法［J］. 计算机与现代化, 2020(8):26-30.
［2］王鲲鹏,徐一丹,于起峰. 红外与可见光图像配准方法分类及现状［J］. 红外技术, 2009,31(5):270-274.
［3］苑津莎,赵振兵,高强,等. 红外与可见光图像配准研究现状与展望［J］. 激光与红外, 2009,39(7):693-699.
［4］赵洪山,张则言. 基于文化狼群算法的电力设备红外和可见光图像配准［J］. 光学学报, 2020,40(16):1-14.
［5］ MA J Y, JIANG X Y, FAN A X, et al. Image matching from handcrafted to deep features: A survey［J］. International Journal of Computer Vision, 2021,129(1):23-79.
［6］ ZITOVA B, FLUSSER J. Image registration methods: A survey［J］. Image and Vision Computing, 2003,21(11):977-1000.
［7］刘小军,杨杰,孙坚伟,等. 基于SIFT的图像配准方法［J］. 红外与激光工程, 2008(1):156-160.
［8］田阿灵,赵振兵,高强. 基于SIFT的电力设备红外/可见光图像配准方法［J］. 电力科学与工程, 2008(2):13-15.
［9］李晖晖,郑平,杨宁,等. 基于SIFT特征和角度相对距离的图像配准算法［J］. 西北工业大学学报, 2017,35(2):280-285.
［10］李冬梅,张惊雷. 基于SURF算法的可见光与红外图像的匹配［C］// 中国仪器仪表学会.第九届全国信息获取与处理学术会议论文集Ⅱ. 2011:4.
［11］李寒,王库,刘韶军. 基于灰度冗余和SURF算法的电气设备红外和可见光图像配准［J］. 电力系统保护与控制, 2011,39(11):111-115.
［12］许金鑫,李庆武,马云鹏,等. 基于斜率一致性的电气设备红外与可见光图像配准方法［J］. 光电子·激光, 2017,28(7):794-802.

［13］江泽涛,刘小艳,王琦. 基于显著性和ORB的红外和可见光图像配准算法［J］. 激光与红外, 2019,49(2):251-256.

［14］周锋飞,陈卫东,李良福. 一种基于Canny边缘的红外与可见光图像配准算法［J］. 应用光学, 2009,30(4):605-609.
［15］DETONE D, MALISIEWICZ T, RABINOVICH A. Superpoint: Self-supervised interest point detection and description［C］// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops. 2018:224-236.
［16］DETONE D, MALISIEWICZ T, RABINOVICH A. Toward geometric deep slam［J］. Computer Vision and Pattern Recognition, 2017，arXiv:1707.07410.
［17］SIMONYAN K, ZISSERMAN A. Very deep convolutional networks for large-scale image recognition［J］. Computer Vision and Pattern Recognition, 2014，arXiv:1409.1556.
［18］CHOY C B, GWAK J Y, SAVARESE S, et al. Universal correspondence network［J］. Computer Vision and Pattern Recognition, 2016，arXiv:1606.03558.
［19］SARLIN P E, DETONE D, MALISIEWICZ T, et al. Superglue: Learning feature matching with graph neural networks［C］// Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2020:4938-4947.
［20］金斌英. 基于改进的SURF图像配准算法研究［J］. 计算机测量与控制, 2019,27(11):228-232.
［21］ALCANTARILLA P F, BARTOLI A, DAVISON A J. KAZE features［C］// European Conference on Computer Vision. 2012:214-227.
［22］AGUILERA C, BARRERA F, LUMBRERAS F, et al. Multispectral image feature points［J］. Sensors, 2012,12(9):12661-12672.
［23］NUNES C F G, PDUA F L C. A local feature descriptor based on log-Gabor filters for keypoint matching in multispectral images［J］. IEEE Geoscience and Remote Sensing Letters, 2017,14(10):1850-1854.

[1]	HE Sida, CHEN Pinghua. Intent-based Lightweight Self-Attention Network for Sequential Recommendation [J]. Computer and Modernization, 2024, 0(12): 1-9.
[2]	ZHANG Xiaodong1, BAI Guangzhi1, LI Min1, LI Haoyang2. Oil and Gas Well Production Prediction Model Based on Empirical Wavelet Transform [J]. Computer and Modernization, 2024, 0(12): 53-58.
[3]	LIU Baobao, YANG Jingjing, TAO Lu, WANG Heying . DSMSC Based on Attention Mechanism for Remote Sensing Image Scene Classification [J]. Computer and Modernization, 2024, 0(12): 72-77.
[4]	CHEN Liang, LI Cheng, YI Wei, XIONG Wei, WANG Xiaofan, TANG Haidong. Helmet Wearing Detection in Electric Power Field Based on#br# Millimeter-wave Radar and Visual Fusion [J]. Computer and Modernization, 2024, 0(12): 100-107.
[5]	QI Xian, LIU Daming, CHANG Jiaxin. Multi-view 3D Reconstruction Based on Improved Self-attention Mechanism [J]. Computer and Modernization, 2024, 0(11): 106-112.
[6]	CHEN Kai1, LI Yiting1, 2, QUAN Huafeng1. A River Discarded Bottles Detection Method Based on Improved YOLOv8 [J]. Computer and Modernization, 2024, 0(11): 113-120.
[7]	YANG Jun1, HU Wei1, ZHU Wenfu2. Visual SLAM Loop Closure Detection Algorithm Based on Improved MobileNetV3 [J]. Computer and Modernization, 2024, 0(10): 21-26.
[8]	WANG Yingying, HAO Xiao. Fine-grained Image Classification Based on Res2Net and Recursive Gated Convolution [J]. Computer and Modernization, 2024, 0(10): 74-79.
[9]	SHI Xingyu1, LI Qiang2, ZHUANG Li3, LIANG Yi3, WANG Qiulin3, CHEN Kai3, WU Chenzhou3, CHANG Sheng1. Object Detection Models Distillation Technique for Industrial Deployment [J]. Computer and Modernization, 2024, 0(10): 93-99.
[10]	MA Yu, YANG Yong, REN Ge, Palidan Tuerxun. Automated Essay Scoring Method Based on GCN and Fine Tuned BERT [J]. Computer and Modernization, 2024, 0(09): 33-37.
[11]	ZHANG Ze1, ZHANG Jianquan2, 3, ZHOU Guopeng2, 3. Camera Module Defect Detection Based on Improved YOLOv8s [J]. Computer and Modernization, 2024, 0(09): 107-113.
[12]	CHENG Yazi1, LEI Liang1, 2, CHEN Han1, ZHAO Yiran1. Multi-scale Depth Fusion Monocular Depth Estimation Based on Transposed Attention [J]. Computer and Modernization, 2024, 0(09): 121-126.
[13]	CHENG Meng, LI Hao. Improved Deciduous Tree Nest Detection Method Based on YOLOv5s [J]. Computer and Modernization, 2024, 0(08): 24-29.
[14]	WANG Mengxi, LI Jun. Review of Fall Detection Technologies for Elderly [J]. Computer and Modernization, 2024, 0(08): 30-36.
[15]	SHI Xianwei1, FAN Xin2. Semantic Segmentation of Video Frame Scene Based on Lightweight [J]. Computer and Modernization, 2024, 0(08): 49-53.