Cloud Removal Algorithm of Remote Sensing Image Based on GANs

doi:10.3969/j.issn.1006-2475.2019.11.003

Abstract

Abstract: Many problems in computer vision can be abstracted as “converting” an input image into a corresponding output image, which is a general solution to many computer vision problems, such as semantic segmentation, image style transfer, etc. In this paper, the remote sensing image cloud removal is used as the special case of image conversion, and the image conversion algorithm based on Generative Adversarial Networks (GANs) is studied. The GANs based on the residual module is proposed to remove the thick cloud and thin cloud from single remote sensing image. At the same time, the proposed multi-scale discriminator and VGG loss function can effectively deal with the cloud occlusion problem of complex scenes. The experimental results show that the proposed image conversion algorithm increases the peak signal-to-noise ratio on the remote sensing image thin cloud dataset by 1.64 dB and increases the peak signal-to-noise ratio by 1.92 dB on the thick cloud dataset. At the same time, the generated cloud-free remote sensing images have high structural similarity with the real cloud-free images.

Key words: image-to-image translation, generative adversarial networks, remote sensing image cloud removal, VGG loss function

CLC Number:

TP391

LI Hua-ying1, LIN Dao-yu2, ZHANG Jie1, LIU Bi-xin1 . Cloud Removal Algorithm of Remote Sensing Image Based on GANs[J]. Computer and Modernization, doi: 10.3969/j.issn.1006-2475.2019.11.003.

References

［1］王润,刘洪斌,宫瑞. 多光谱遥感图像去云方法［J］. 计算机与现代化, 2005(6):13-15.
［2］陆婉芸,王继周,曹萌. 变序字典学习AO-DL的资源三号遥感影像云去除［J］. 测绘学报, 2017,46(5):623-630.
［3］李超炜,邓新蒲,赵昊宸. 基于小波分析的遥感影像薄云去除算法研究［J］. 数字技术与应用, 2017(6):137-139.
［4］吴峰,朱锡芳,相入喜,等. 基于双树复小波变换的遥感图像去云雾系统设计［J］. 应用光学, 2018,39(1):64-70.
［5］石晓旭,夏克文,王宝珠,等. 采用改进RPCA的遥感影像去云算法［J］. 计算机工程与设计, 2018,39(6):1653-1658.
［6］傅天驹,郑嫦娥,田野,等. 复杂背景下基于深度卷积神经网络的森林火灾识别［J］. 计算机与现代化, 2016(3):52-57.
［7］陈柏立,林楠. 基于卷积神经网络的交通路标识别［J］. 计算机与现代化, 2018(7):103-107.
［8］ GOODFELLOW I J, POUGET-ABADIE J, MIRZA M, et al. Generative adversarial nets［C］// Proceedings of the 27th International Conference on Neural Information Processing Systems. 2014:2672-2680.
［9］ MIRZA M, SIMON O. Conditional generative adversarial nets［J］. Machine Learning, 2014:arXiv:1411.1784.
［10］HE K M, ZHANG X Y, REN S Q, et al. Deep residual learning for image recognition［C］// Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2016,1:770-778
［11］NOH H, HONG S, HAN B. Learning deconvolution network for semantic segmentation［C］// Proceedings of 2015 IEEE International Conference on Computer Vision (ICCV). 2015:1520-1528.
［12］ULYANOV D, VEDALDI A, LEMPITSKY V. Instance normalization: The missing ingredient for fast stylization［J］. Computer Vision and Pattern Recognition, 2017:arXiv:1607.08022.
［13］NAIR V, HINTON G E. Rectified linear units improve restricted Boltzmann machines［C］// Proceedings of the 27th International Conference on Machine Learning. 2010:807-814.
［14］XU B, WANG N Y, CHEN T Q, et al. Empirical evaluation of rectified activations in convolutional network［J］. Machine Learning, 2015:arXiv:1505.00853.
［15］SIMONYAN K, ANDREW Z. Very deep convolutional networks for large-scale image recognition［J］. Computer Vision and Pattern Recognition, 2014:arXiv:1409.1556.
［16］LIN D Y, XU G L, WANG X K, et al. A remote sensing image dataset for cloud removal［J］. Computer Vision and Pattern Recognition, 2019:arXiv:1901.00600.
［17］KINGMA D P, BA J. Adam: A method for stochastic optimization［J］. Machine Learning, 2014:arXiv:1412.6980.
［18］WANG Z, BOVIK A C, SHEIKH H R, et al. Image quality assessment: From error visibility to structural similarity［J］. IEEE Transactions on Image Processing, 2004,13(4):600-612.
［19］ISOLA P, ZHU J Y, ZHOU T H, et al. Image-to-image translation with conditional adversarial networks［J］. Computer Vision and Pattern Recognition, 2017:arXiv:1611.07004.

[1]	FU Hong-lin, ZHANG Tai-hong, YANG Ya-ting, Aizimaiti Aiwanier, MA Bo. Scenes Text Modification Network for Uyghur Based on Generative Adversarial Network [J]. Computer and Modernization, 2024, 0(01): 41-46.
[2]	WANG Xin, XIAO Tao-rui. GAN-based Adversarial Attacks on Face Recognition [J]. Computer and Modernization, 2023, 0(10): 115-120.
[3]	LI Hai-tao, HU Ze-tao, ZHANG Jun-hu. Method of Fish Image Expansion Based on NS-StyleGAN2 Network [J]. Computer and Modernization, 2023, 0(01): 13-17.
[4]	ZHAI Hui-cong, ZHANG Ming, DENG Xing, WANG Li-qun. Image Animation Based on Generative Adversarial Networks [J]. Computer and Modernization, 2022, 0(07): 21-26.
[5]	LI Yang-yang, YANG Ying-guang. Social Bots Detection Based on Generative Adversarial Networks [J]. Computer and Modernization, 2022, 0(03): 1-6.
[6]	LIU Yi-hao. A Method to Generate Features of Mimicry Honeypot Based on Generative Adversarial Networks [J]. Computer and Modernization, 2021, 0(07): 120-126.
[7]	CHEN Yuan-yuan, LIU Hui-yi. Damaged Old Photos Inpainting Based on Generative Adversarial Networks [J]. Computer and Modernization, 2021, 0(04): 42-47.
[8]	MA Yue. Smoke Removal Algorithm of Medical Operation Image Based on Conditional Generative Adversarial Network [J]. Computer and Modernization, 2021, 0(01): 50-55.
[9]	ZHOU Li1,2, SHEN Guo-wei1,2, ZHAO Wen-bo1,2, ZHOU Xue-mei1,2. A Heterogeneous Information Network Represention Learning Method Based on GAN [J]. Computer and Modernization, 2020, 0(05): 89-.