计算机与现代化 ›› 2022, Vol. 0 ›› Issue (11): 89-94.

• 图像处理 • 上一篇    下一篇

基于改进残差特征蒸馏的轻量级超分辨率网络

  

  1. (福州大学物理与信息工程学院,福建福州350108)
  • 出版日期:2022-11-30 发布日期:2022-11-30
  • 作者简介:吴丽君(1984—),女,福建泉州人,副教授,博士,研究方向:计算机视觉,E-mail: lijun.wu@fzu.edu.cn; 通信作者: 蔡周威(1997—),男,福建莆田人,硕士研究生,研究方向:图像处理,E-mail: 13850207081@163.com; 陈志聪(1983—),男,福建泉州人,副教授,博士,研究方向:智能信号处理,E-mail: zhicong.chen@fzu.edu.cn.
  • 基金资助:
    福建省科技厅引导性项目(2019H0006)

Lightweight Super-resolution Networks Based on Improved Residual Feature Distillation

  1. (College of Physics and Information Engineering, Fuzhou University, Fuzhou 350108, China)
  • Online:2022-11-30 Published:2022-11-30

摘要: 基于深度学习的图像超分辨率算法通常采用递归的方式或参数共享的策略来减少网络参数,这将增加网络的深度,使得运行网络花费大量的时间,从而很难将模型部署到现实生活中。为了解决上述问题,本文设计一种轻量级超分辨率网络,对中间特征的关联性及重要性进行学习,且在重建部分结合高分辨率图像的特征信息。首先,引入层间注意力模块,通过考虑层与层之间的相关性,自适应地分配重要层次特征的权重。其次,使用增强重建模块提取高分辨率图像中更精细的特征信息,以此得到更加清晰的重建图片。通过大量的对比实验表明,本文设计的网络与其他轻量级模型相比,有更小的网络参数量,并且在重建精度和视觉效果上都有一定的提升。

关键词: 图像超分辨率, 层间注意力, 中间特征, 增强重建块, 轻量级

Abstract: Deep learning-based image super-resolution algorithms often use recursive approaches or parameter sharing strategies to reduce network parameters, which increases the depth of the network and makes running the network time consuming, making it difficult to deploy the model to real-life situations. To solve the above problems, this paper designs a lightweight super-resolution network, which learns the correlation and importance of intermediate features, and combines the feature information of high-resolution images in the reconstruction part. First, the layer attention module is introduced to adaptively assign the weights of important hierarchical features by considering the correlation among layers. Next, finer feature information of the high-resolution image are extracted using an enhanced reconstruction block to obtain a clearer reconstructed image. A large number of comparative experiments show that the network designed in this paper has a smaller amount of network parameters compared with other lightweight models, and has a certain improvement in reconstruction accuracy and visual effects.

Key words: image super resolution, layer attention, intermediate features, enhanced reconstruction block, lightweight