计算机与现代化 ›› 2023, Vol. 0 ›› Issue (01): 1-6.

• 图像处理 •    下一篇

基于生成对抗网络的高照度可见光图像生成

  

  1. (航天工程大学航天信息学院,北京 101416)
  • 出版日期:2023-03-02 发布日期:2023-03-02
  • 作者简介:庄文华(1995—),男,山东潍坊人,硕士研究生,研究方向:计算机视觉,E-mail: 1439960394@qq.com; 通信作者:唐晓刚(1977—),男,副教授,博士,研究方向:人工智能与模式识别,E-mail: titantxg@163.com; 张斌权(1991—),男,讲师,博士,研究方向:智能机器人及机电系统控制,E-mail: bqzhang@stu.xjtu.edu.cn; 原光明(1993—),男,硕士研究生,研究方向:智能信息处理,E-mail: ygm20200101@163.com。
  • 基金资助:
    国家自然科学基金资助项目(62027801)

High Illumination Visible Image Generation Based on Generative Adversarial Networks

  1. (School of Aerospace Information, University of Aerospace Engineering, Beijing 101416, China)
  • Online:2023-03-02 Published:2023-03-02

摘要: 为解决夜间低照度条件下目标检测准确率偏低的问题,提出一种基于循环生成对抗网络的高照度可见光图像生成方法。为提高生成器提取特征的能力,在转换器模块引入CBAM注意力模块;为避免在生成图像中产生伪影的噪声干扰,把生成器解码器的反卷积方式改为最近邻插值加卷积层的上采样方式;为了提高网络训练的稳定性,把对抗损失函数由交叉熵函数换为最小二乘函数。生成的可见光图像与红外图像、夜间可见光图像相比,在光谱信息、细节信息丰富和可视性方面取得好的优势提升,能够有效地获取目标和场景的信息。分别通过图像生成指标和目标检测指标验证该方法的有效性,其中对生成可见光图像测试得到的mAP较红外图像和真实可见光图像分别提高了11.7个百分点和30.2个百分点,可以有效提高对夜间目标的检测准确率和抗干扰能力。

关键词: 图像生成, 生成对抗网络, 注意力机制, 目标检测

Abstract: To solve the problem of low accuracy of target detection under low illumination conditions at night, this paper proposes a generative adversarial network-based algorithm for high illumination visible light image generation. To improve the ability of the generator to extract features, a CBAM attention module is introduced in the converter module; To avoid the noise interference of artifacts in the generated images, the decoder of the generator is changed from the deconvolution method to the up-sampling method of nearest neighbour interpolation plus convolution layer; to improve the stability of the network training, the adversarial loss function is replaced from the cross-entropy function to the least-squares function. The generated visible images have the advantages of spectral information, rich detail information and good visibility enhancement compared with infrared images and night visible images, which can effectively obtain information about the target and scene. We verified the effectiveness of the method by image generation metrics and target detection metrics respectively, in which the mAP obtained from the test on the generated visible image improved by 11.7 percentage points and 30.2 percentage points respectively compared to the infrared image and the real visible image, which can effectively improve the detection accuracy and anti-interference capability of nighttime targets.

Key words: image generation, generative adversarial network, attention mechanism, object detection