基于四叉树分解和自适应焦点测度的多聚焦图像融合

计算机与现代化 ›› 2022, Vol. 0 ›› Issue (08): 106-113.

基于四叉树分解和自适应焦点测度的多聚焦图像融合

（山东建筑大学信息与电气工程学院，山东济南250101）

出版日期:2022-08-22 发布日期:2022-08-22
作者简介:王纪委（1993—）,男,河南周口人,硕士研究生,研究方向:图像融合，模式识别,E-mail: 2363271096@qq.com; 曲怀敬（1965—）,男,山东烟台人,教授,硕士生导师,博士，研究方向:模式识别,图像处理,E-mail: quhuaijing@sdjzu.edu.cn。
基金资助:
国家自然科学基金资助项目（62003191）；山东省自然科学基金资助项目（ZR2014FM016）; 山东省重大科技创新工程项目（2019JZZY010120）

Multi-focus Image Fusion Based on Quadtree Decomposition and Adaptive Focus Measure

（School of Information & Electric Engineering, Shandong Jianzhu University, Jinan 250101, China）

Online:2022-08-22 Published:2022-08-22

摘要/Abstract

摘要： 为了克服基于块的融合方法对块的大小敏感以及融合图像中存在伪影等问题，提出一种新的基于四叉树分解和自适应焦点测度的多聚焦图像融合方法。首先，设计一种新的基于修正拉普拉斯能量和（SML）和导向滤波的自适应焦点测度，用于获得源图像的焦点图。然后，采用一种新的四叉树分解策略，并结合已经得到的焦点图，进一步将源图像分解成最优大小的树块；同时，从树块中检测出聚焦区域，并构成决策图。最后，对决策图进行优化和一致性验证，并重构出一幅全聚焦图像。通过公共多聚焦图像数据集进行实验，与11种先进的融合方法进行视觉质量和客观指标比较。实验结果表明，本文所提出的融合方法取得了更好的性能。

关键词: 多聚焦图像融合, 焦点测度, 四叉树分解, 导向滤波, 修正拉普拉斯能量和

Abstract: In order to overcome the problem that the block-based fusion method is sensitive to the size of the block and the artifacts in the fused image, a new multi-focus image fusion method based on quadtree decomposition and adaptive focus measurement is proposed. Firstly, according to a new adaptive focus measure based on the sum of modified Laplacian （SML） and guided filtering, it is used to obtain the focus map of the source image. Then, using a new quadtree decomposition strategy and combining the obtained focus map, the source image is further decomposed into tree blocks of optimal size, the focus area is detected from the tree blocks, and a decision map is formed. Finally, the consistency of the decision graph is optimized and verified, and a fully focused image is reconstructed. Through experiments on public multi-focus image data sets, visual quality and objective indicators are compared with 9 advanced fusion methods. The experimental results show that the fusion method proposed in this paper has achieved better performance.

Key words: multi-focus image fusion, focus measure, quadtree decomposition, guided filtering, sum of modified Laplacian.

王纪委, 曲怀敬, 魏亚南, 谢明, 徐佳, 张志升, 张汉元. 基于四叉树分解和自适应焦点测度的多聚焦图像融合[J]. 计算机与现代化, 2022, 0(08): 106-113.

WANG Ji-wei, QU Huai-jing, WEI Ya-nan, XIE Ming, XU Jia, ZHANG Zhi-sheng, ZHANG Han-yuan. Multi-focus Image Fusion Based on Quadtree Decomposition and Adaptive Focus Measure[J]. Computer and Modernization, 2022, 0(08): 106-113.

参考文献［28］

［1］	ZHANG X. Deep learning-based multi-focus image fusion: A survey and a comparative study［J］. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2021:1.
［2］	LIU W, ZHENG Z, WANG Z. Robust multi-focus image fusion using lazy random walks with multiscale focus measures［J］. Signal Processing, 2021,179（6）:107850.
［3］	BANHARNSAKUN A. Multi-focus image fusion using best-so-far ABC strategies［J］. Neural Computing and Applications, 2019,31（7）:2025-2040.
［4］	ZHANG Y, BAI X X, WANG T. Boundary finding based multi-focus image fusion through multi-scale morphological focus-measure［J］. Information Fusion, 2017,35:81-101.
［5］	LIU Y, WANG Z F. Simultaneous image fusion and denoising with adaptive sparse representation［J］. Image Processing IET, 2015,9（5）:347-357.
［6］	LIU Y, CHEN X, RABAB K, et al. Image fusion with convolutional sparse representation［J］. IEEE Signal Processing Letters, 2016,23（12）:1882-1886.
［7］	MA X, HU S, LIU S, et al. Multi-focus image fusion based on joint sparse representation and optimum theory［J］. Signal Processing: Image Communication, 2019,78:125-134.
［8］	HILL P, CANAGARAJAH C, BULL D. Image fusion using complex wavelets［C］// Proceedings of British Machine Vision Conference（BMVC）. 2002:487-496.
［9］	YANG B, LI S, SUN F. Image fusion using nonsubsampled contourlet transform［C］// Proceedings of International Conference on Image and Graphics （ICIG）.2007:719-724. 〖HJ0.95mm〗
［10］	LI S, KANG X, HU J. Image fusion with guided filtering［J］. IEEE Transaction. Image Process. 2013,22（7）:2864-2875.
［11］	ZHOU Z, LI S, WANG B. Multi-scale weighted gradient-based fusion for multi-focus images［J］. Information Fusion, 2014,20:60-72.
［12］	LIU Y, LIU S, WANG Z. A general framework for image fusion based on multi-scale transform and sparse representation［J］. Information Fusion, 2015,24 （1）:147-164.
［13］	LIU Y, CHEN X, PENG H, et al. Multi-focus image fusion with a deep convolutional neural network［J］. Information Fusion, 2017,36:191-207.
［14］	LAI R, LI Y, GUAN J, et al. Multi-scale visual attention deep convolutional neural network for multi-focus image fusion［J］. IEEE Access, 2019,7:114385-114399.
［15］	LI J, GUO X, LU G, et al. DRPL: Deep regression pair learning for multi-focus image fusion［J］. IEEE Transactions Image Process. 2020,29:4816-4831.
［16］	XU H, MA J, JIANG J, et al. U2Fusion: A unified unsupervised image fusion network［J］. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2020,44（1）:502-518.
［17］	ZHANG H, LE Z L, SHAO Z F, et al. MFF-GAN: An unsupervised generative adversarial network with adaptive and gradient joint constraints for multi-focus image fusion［J］. Information Fusion, 2021,66:40-53.
［18］	MA B, ZHU Y, YIN X, et al. SESF-Fuse: An unsupervised deep model for multi-focus image fusion［J］. Neural Computing and Applications, 2021,33（12）:5793-5804.
［19］	HE K M,SUN J, TANG X O. Guided image filtering［J］. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2013,35（6）:1397-1409.
［20］	HUANG W, JING Z L. Evaluation of focus measures in multi-focus image fusion［J］. Pattern Recognition Letters, 2007,28（4）:493-500.
［21］	NAYAR S, NAKAGAWA Y. Shape from focus［J］. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1994,16 （8）:824-831.
［22］	MITIANOUDIS N, STATHAKI T. Pixel-based and region-based image fusion schemes using ica bases［J］. Information Fusion, 2007,8（2）:131-142.
［23］	NEJATI M, SAMAVI S, SHIRANI S. Multi-focus image fusion using dictionary-based sparse representation［J］. Information Fusion, 2015,25:72-84.
［24］	HOSSNY M, NAHAVANDI S, CREIGHTON D. Comments on ′Information measure for performance of image fusion′［J］. Electronics Letters, 2008,44（18）:1066-1067.
［25］	WANG Q, SHEN Y, ZHANG J Q. A nonlinear correlation measure for multivariable data set［J］. Physica D: Nonlinear Phenomena, 2005,200 （3-4）:287-295.
［26］	XYDEAS C, PETROVIC V. Objective image fusion performance measure［J］. Electronics Letters, 2000,36 （4）:308-309.
［27］	YANG C, ZHANG J Q, WANG X R, et al. A novel similarity based quality metric for image fusion［J］. Information Fusion, 2008,9（2）:156-160.
［28］	CHEN Y, BLUM R, A new automated quality assessment algorithm for image fusion［J］. Image and Vision Computing, 2009,27（10）:1421-1432.