计算机与现代化

• 图像处理 • 上一篇    下一篇

基于生成对抗网络的遥感图像去云算法

  

  1. (1.军事科学院,北京100091;2.中国科学院电子学研究所,北京100190)
  • 收稿日期:2019-06-14 出版日期:2019-11-15 发布日期:2019-11-15
  • 作者简介:李华莹(1981-),女,河南信阳人,助理研究员,硕士,研究方向:软件工程,E-mail: huayinglee@126.com; 林道玉(1994-),男,湖南邵阳人,研究实习员,硕士,研究方向:图像处理; 张捷(1967-),男,北京人,高级工程师,本科,研究方向:软件工程; 通信作者:刘必欣(1977-),女,副研究员,博士,研究方向:数据库。
  • 基金资助:
    国家自然科学基金资助项目(61807034)

Cloud Removal Algorithm of Remote Sensing Image Based on GANs

  1. (1. Academy of Military Sciences, Beijing 100091, China; 
    2. Institute of Electronics, Chinese Academy of Sciences, Beijing 100190, China)
  • Received:2019-06-14 Online:2019-11-15 Published:2019-11-15

摘要: 计算机视觉中的许多问题可以抽象为将输入图像“转换”成对应的输出图像,图像转换算法是许多计算机视觉问题的通用解决方案,例如语义分割、风格转换等。本文将以遥感图像去云作为图像转换的特例,研究基于生成对抗网络的图像转换算法。提出基于残差模块的生成模型可以对单幅遥感图像进行厚云和薄云的去除;同时提出的多尺度判别网络以及VGG损失函数,有效地解决了复杂场景的云雾遮挡问题。实验结果表明,本文提出的图像转换算法在遥感图像薄云数据集上峰值信噪比提升了1.64 dB,在厚云数据集上峰值信噪比提升了1.92 dB,同时生成的无云遥感图像和真实的无云图像具有较高的结构相似性。

关键词: 图像转换算法, 生成对抗网络, 遥感图像去云, VGG损失函数

Abstract: Many problems in computer vision can be abstracted as “converting” an input image into a corresponding output image, which is a general solution to many computer vision problems, such as semantic segmentation, image style transfer, etc. In this paper, the remote sensing image cloud removal is used as the special case of image conversion, and the image conversion algorithm based on Generative Adversarial Networks (GANs) is studied. The GANs based on the residual module is proposed to remove the thick cloud and thin cloud from single remote sensing image. At the same time, the proposed multi-scale discriminator and VGG loss function can effectively deal with the cloud occlusion problem of complex scenes. The experimental results show that the proposed image conversion algorithm increases the peak signal-to-noise ratio on the remote sensing image thin cloud dataset by 1.64 dB and increases the peak signal-to-noise ratio by 1.92 dB on the thick cloud dataset. At the same time, the generated cloud-free remote sensing images have high structural similarity with the real cloud-free images.

Key words: image-to-image translation, generative adversarial networks, remote sensing image cloud removal, VGG loss function

中图分类号: