计算机与现代化 ›› 2021, Vol. 0 ›› Issue (10): 81-87.

• 图像处理 • 上一篇    下一篇

一种多方向感知的高实时性视频融合算法

  

  1. (1.长沙理工大学物理与电子科学学院,湖南长沙410114;2.中国人民解放军第3303工厂,湖北武汉430200)
  • 出版日期:2021-10-14 发布日期:2021-10-14
  • 作者简介:莫维(1997—),男,湖南长沙人,硕士研究生,研究方向:模式识别,图像处理,E-mail: 1511767366@qq.com; 通信作者:唐清善(1977—),男,湖南永州人,讲师,硕士生导师,博士,研究方向:模式识别,数字信号处理,E-mail: cstqs001@126.com。

A High Real-time Video Fusion Algorithm Based on Multi Direction Perception

  1. (1.School of Physics and Electronic Science, Changsha University of Science and Technology, Changsha 410114, China;
    2. No.3303 Factory of the Chinese People’s Liberation Army, Wuhan 430200, China)
  • Online:2021-10-14 Published:2021-10-14

摘要: 针对多路视频融合阶段拼缝线两侧范围内出现的虚影、色彩亮度差异以及高分辨率下无法实时拼接等问题,本文提出一种多方向感知的视频融合算法。首先,在图像配准阶段,采用SIFT提取特征点与特征描述子对图像进行配准;然后,在图像融合阶段,使用指数函数构建的权值查找表指导融合过渡,结合视频帧投影位置与拼接缝之间的距离,利用形态学操作自适应地融合图像拼缝;最后,利用GPU平台大量多线程并行运算,整合投影与融合等矩阵运算从而掩盖延时达到实时目的。实验结果表明,该算法能消除重叠区域内出现的虚影、模糊现象,并且具有良好的实时拼接效果。

关键词: CUDA, 视频拼接, 图像融合, 形态学方法

Abstract: Aiming at the problems of virtual shadow, color brightness difference on both sides of the stitching line and the inability of real-time stitching at high resolution in the multi-channel video fusion stage, this paper proposes a multi-directional perception video fusion algorithm. Firstly, in the stage of image registration, SIFT is used to extract feature points and feature descriptors to register the image. Then, in the image fusion stage, the weight lookup table constructed by exponential function is used to guide the fusion transition. Combined with the distance between the projection position of video frame and the seam, the image seam is fused adaptively by morphological operation. Finally, a large number of multi-threaded parallel operations on GPU platform are used to integrate matrix operations such as projection and fusion, so as to cover the delay and achieve the purpose of real-time. Experimental results show that the algorithm can eliminate the virtual shadow and blur in the overlapping area, and has a good real-time stitching effect.

Key words: CUDA, video stitching, image fusion, morphological method