Infrared and Visible Images Registration Method for Electric Power Inspection

Abstract

Abstract: The failure of power equipment may cause power outages and affect the safe and stable operation of power grid. According to the characteristics of heat generated by power equipment during operation, an infrared and visible images registration method for power equipment is proposed to facilitate detection of abnormal heating faults. Firstly, the Sobel edge detection operator extracts edge information from infrared and visible images of power equipment to obtain edge images. Then the feature points of two edge images are detected by the SuperPoint algorithm and the descriptors are calculated, and the feature points are matched by the SuperGlue algorithm. Finally, the affine transformation model parameters are calculated by the least square method to realize the infrared and visible image registration of power equipment. The experimental results show that the method in this paper can achieve high-precision registration of infrared and visible images of power equipment.

Key words: image registration, power equipment, edge image, deep learning, neural network

LIU Xiao-kang, XIA Tian-lei, WU Chen-yuan, JIANG Xiong-biao, ZHOU Ming-yu, WANG Qing-hua. Infrared and Visible Images Registration Method for Electric Power Inspection[J]. Computer and Modernization, 2021, 0(09): 31-36.

References ［23］

［1］	刘晓康,万曦,涂文超,等. 基于红外可见光图像配准的电力设备分割算法［J］. 计算机与现代化, 2020(8):26-30.
［2］	王鲲鹏,徐一丹,于起峰. 红外与可见光图像配准方法分类及现状［J］. 红外技术, 2009,31(5):270-274.
［3］	苑津莎,赵振兵,高强,等. 红外与可见光图像配准研究现状与展望［J］. 激光与红外, 2009,39(7):693-699.
［4］	赵洪山,张则言. 基于文化狼群算法的电力设备红外和可见光图像配准［J］. 光学学报, 2020,40(16):1-14.
［5］	MA J Y, JIANG X Y, FAN A X, et al. Image matching from handcrafted to deep features: A survey［J］. International Journal of Computer Vision, 2021,129(1):23-79.
［6］	ZITOVA B, FLUSSER J. Image registration methods: A survey［J］. Image and Vision Computing, 2003,21(11):977-1000.
［7］	刘小军,杨杰,孙坚伟,等. 基于SIFT的图像配准方法［J］. 红外与激光工程, 2008(1):156-160.
［8］	田阿灵,赵振兵,高强. 基于SIFT的电力设备红外/可见光图像配准方法［J］. 电力科学与工程, 2008(2):13-15.
［9］	李晖晖,郑平,杨宁,等. 基于SIFT特征和角度相对距离的图像配准算法［J］. 西北工业大学学报, 2017,35(2):280-285.
［10］	李冬梅,张惊雷. 基于SURF算法的可见光与红外图像的匹配［C］// 中国仪器仪表学会.第九届全国信息获取与处理学术会议论文集Ⅱ. 2011:4.
［11］	李寒,王库,刘韶军. 基于灰度冗余和SURF算法的电气设备红外和可见光图像配准［J］. 电力系统保护与控制, 2011,39(11):111-115.
［12］	许金鑫,李庆武,马云鹏,等. 基于斜率一致性的电气设备红外与可见光图像配准方法［J］. 光电子·激光, 2017,28(7):794-802.
［13］	江泽涛,刘小艳,王琦. 基于显著性和ORB的红外和可见光图像配准算法［J］. 激光与红外, 2019,49(2):251-256.
［14］	周锋飞,陈卫东,李良福. 一种基于Canny边缘的红外与可见光图像配准算法［J］. 应用光学, 2009,30(4):605-609.
［15］	DETONE D, MALISIEWICZ T, RABINOVICH A. Superpoint: Self-supervised interest point detection and description［C］// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops. 2018:224-236.
［16］	DETONE D, MALISIEWICZ T, RABINOVICH A. Toward geometric deep slam［J］. Computer Vision and Pattern Recognition, 2017，arXiv:1707.07410.
［17］	SIMONYAN K, ZISSERMAN A. Very deep convolutional networks for large-scale image recognition［J］. Computer Vision and Pattern Recognition, 2014，arXiv:1409.1556.
［18］	CHOY C B, GWAK J Y, SAVARESE S, et al. Universal correspondence network［J］. Computer Vision and Pattern Recognition, 2016，arXiv:1606.03558.
［19］	SARLIN P E, DETONE D, MALISIEWICZ T, et al. Superglue: Learning feature matching with graph neural networks［C］// Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2020:4938-4947.
［20］	金斌英. 基于改进的SURF图像配准算法研究［J］. 计算机测量与控制, 2019,27(11):228-232.
［21］	ALCANTARILLA P F, BARTOLI A, DAVISON A J. KAZE features［C］// European Conference on Computer Vision. 2012:214-227.
［22］	AGUILERA C, BARRERA F, LUMBRERAS F, et al. Multispectral image feature points［J］. Sensors, 2012,12(9):12661-12672.
［23］	NUNES C F G, PDUA F L C. A local feature descriptor based on log-Gabor filters for keypoint matching in multispectral images［J］. IEEE Geoscience and Remote Sensing Letters, 2017,14(10):1850-1854.

[1]	WANG Qiu-yi, ZHOU Hao, ZHENG Ting-ting. Improved RetinaNet Target Detection Method for Power Equipment [J]. Computer and Modernization, 2024, 0(01): 47-52.
[2]	HU Chong-jia, LIU Jin-zhou, FANG Li. Unsupervised Domain Adaptation for Outdoor Point Cloud Semantic Segmentation [J]. Computer and Modernization, 2024, 0(01): 74-79.
[3]	LIN Wei. Incremental News Recommendation Method Based on Self-supervised Learning and Data Replay [J]. Computer and Modernization, 2023, 0(12): 1-6.
[4]	SONG Tao-tao, LI Yan-ping, LI Hong-gang, HAN Chun-xue. Sliding Mode Control System of Manipulator Based on Improved#br# Variable Structure Reaching Law#br# [J]. Computer and Modernization, 2023, 0(12): 14-18.
[5]	ZHOU Cheng-cheng, ZENG Qing-jun, YANG Kang, HU Jia-ming, HAN Chun-wei. EEG Recognition of Motor Imagination Based on Efficiency Channel Attention Module [J]. Computer and Modernization, 2023, 0(12): 19-23.
[6]	LIANG Tian-kai, HUANG Kang-hua, LIU Kai-hang, LAN Lan, ZENG Bi. Deep Federated Image Classification Method Based on Bilateral Homomorphic Encryption [J]. Computer and Modernization, 2023, 0(12): 36-40.
[7]	QIU Kai-xing, FENG Guang. A Multi-label Image Classification Model Based on Dual Feature Attention [J]. Computer and Modernization, 2023, 0(12): 41-47.
[8]	ZHANG Bo-quan, MAI Hai-peng, CHEN Jia-min, Pang Jin-ju. White Matter Hyperintensities Segmentation Based on High Gray Value#br# Attention Mechanism [J]. Computer and Modernization, 2023, 0(12): 67-75.
[9]	WANG Yu-hang, DONG Bao-liang, GONG Chao, SHANG Zhen-zhen, YAO Kang-ning. Dynamic Threat Assessment of Air Swarm Targets Based on Intent Recognition [J]. Computer and Modernization, 2023, 0(12): 100-104.
[10]	GU Ming-xuan, FAN Bing-bing. Feature-level Multimodal Fusion for Depression Recognition [J]. Computer and Modernization, 2023, 0(10): 17-22.
[11]	CHEN Jun-yi. Health Event Prediction Model Based on Dynamic and Static Features of Graph Nodes [J]. Computer and Modernization, 2023, 0(10): 39-44.
[12]	LI Yan-man, WANG Bi-heng, ZHAO Ling-yan. Safety Helmet Detection Based on Lightweight YOLOv5 [J]. Computer and Modernization, 2023, 0(10): 59-64.
[13]	LI Shi-da, XIANG Jian-wen. A Weakened Joint Reinforcement Method to Improve Robustness of Image Recognition Models [J]. Computer and Modernization, 2023, 0(10): 70-76.
[14]	CHEN Zi-jian, DUAN Chun-hong. Automatic Epistemic Emotion Recognition Based on Facial Expression in E-learning [J]. Computer and Modernization, 2023, 0(10): 92-98.
[15]	SHEN Jia-wei, LU Yi-ming, CHEN Xiao-yi, QIAN Mei-ling, LU Wei-zhong, . Review of Research on Human Behavior Detection Methods Based on Deep Learning [J]. Computer and Modernization, 2023, 0(09): 1-9.