An Edge Adaptive Up-sampling Scheme Based on Depth Map Compression

doi:10.3969/j.issn.1006-2475.2014.05.019

Abstract

Abstract: In 3D video system, in order to better preserve the edge sharpness of depth maps and improve the rendering quality of virtual views, the paper proposed a novel two-step edge adaptive up-sampling scheme to recover the lost information due to down-sampling operation prior to encoding. We detected the horizontal and vertical edges of low resolution (LR) depth map and high resolution (HR) texture map by Sobel operation. Then, we utilized the texture information to direct the reconstruction of accurate HR depth map according to the characteristic of different areas of depth map. Experimental results show that the proposed method improves both depth map coding efficiency and perceptual quality of rendered views.


Key words: D video, depth map up-sampling, edge detection, view synthesis

CLC Number:

TP391

ZUO Yu-peng1,2. An Edge Adaptive Up-sampling Scheme Based on Depth Map Compression[J]. Computer and Modernization, doi: 10.3969/j.issn.1006-2475.2014.05.019.

References ［17］

［1］	Merkle P, Smolic A, Muller K, et al. Multi-view video plus depth representation and coding［C］// IEEE International Conference on Image Processing. 2007,1:I-201-I-204.
［2］	ISO/IEC JTC1/SC29/WG11, M16758, Influence of Views and Depth Compression onto Quality of Synthesized Views［S］.
［3］	Yang Q, Yang R, Davis J, et al. Spatial-depth super resolution for range images［C］// IEEE Conference on Computer Vision and Pattern Recognition. 2007:1-8.
［4］	Oh K J, Yea S, Vetro A, et al. Depth reconstruction filter and down/up sampling for depth coding in 3-D video［J］. IEEE Signal Processing Letters, 2009,16(9):747-750.
［5］	Wildeboer M O, Yendo T, Tehrani M P, et al. Color based depth up-sampling for depth compression［C］// IEEE Conference on Picture Coding Symposium. 2010:170-173.
［6］	Wildeboer M O, Yendo T, Panahpour Tehrani M, et al. Depth up-sampling for depth coding using view information［C］// 3DTV Conference: The True Vision-Capture, Transmission and Display of 3D Video. 2011:1-4.
［7］	Kopf J, Cohen M F, Lischinski D, et al. Joint Bilateral upsampling［J］. ACM Transactions on Graphics, 2007,26(3):No 96.
［8］	Li Yanjie, Sun Lifeng. A novel upsampling scheme for depth map compression in 3DTV system［C］// IEEE Picture Coding Symposium, 2010. 2010:186-189.
［9］	Graziosi D B, Tian D, Vetro A. Depth Map Up-sampling Based on Edge Layers［DB/OL］. http://www.merl.com/publications/docs/TR2012-065.pdf, 2012-12-10.
［10］	ISO/IEC JTC1/SC29/WG1, View Synthesis Algorithm in View Synthesis Reference Software 2.0 (VSRS2.0) ［S］.
［11］	Deng H, Yu L, Qiu J, et al. A joint texture/depth edge-directed up-sampling algorithm for depth map coding［C］// IEEE International Conference on Multimedia and Expo. 2012:646-650.
［12］	Xing Y, Zhao Y, Lin C, et al. Depth down/up-sampling using hybrid correlation for depth coding［C］// IEEE 11th IVMSP Workshop. 2013:1-4.
［13］	Kauff P, Atzpadin N, Fehn C,et al. Depth map creation and image-based rendering for advanced 3-D TV services providing interoperability and scalability［J］. Signal Processing: Image Communication, 2007,22(2):217-234.
［14］	Maitre M, Do M N. Depth and depth-color coding using shape-adaptive wavelets［J］. Journal of Visual Communication and Image Representation, 2010,21(5-6):513-522.
［15］	De Silva D V S X, Fernando W A C, Yasakethu S L P. Object based coding of the depth maps for 3D video coding［J］. IEEE Transactions on Consumer Electronics, 2009,55(3):1699-1706.
［16］	Ekmekcioglu E, Mrak M, Worrall S, et al. Utilisation of edge adaptive upsampling in compression of depth map videos for enhanced Free-Viewpoint rendering［C］// IEEE International Conference on Image Processing. 2009:733-736.
［17］	Fehn C. Depth-Image-Based rendering (DIBR), compression and transmission for a new approach on 3D-TV［C］// Proceedings of the SPIE. 2004,5291:93-104.

[1]	ZHAO Qi-wen, XU Kun, XU Yuan. Fast Paper Edge Detection Method Based on HED Network [J]. Computer and Modernization, 2021, 0(05): 1-5.
[2]	LI Rui, WANG De-zhong. Target Detection Algorithm of Gaussian Mixture Model Combined with HED Network and Double Threshold Segmentation [J]. Computer and Modernization, 2020, 0(06): 7-.
[3]	ZHOU Hong-yu1, MA Qian-li1, MA Peng-bo2 . Detecting Method for Workpiece Size and Symmetry of Blower Rotor [J]. Computer and Modernization, 2019, 0(11): 55-.
[4]	LIU Bo-ping1,2, MENG Sha-sha1,2, RAO Lan-xiang1,2, FU Kang1,2. Color Image Edge Detection Algorithm Based on K-means and Improved Ant Colony Optimization [J]. Computer and Modernization, 2016, 0(9): 60-63.
[5]	LIU Zhan. Image Edge Detection Algorithm Based on Local Expectation Threshold Segmentation [J]. Computer and Modernization, 2016, 0(8): 52-55.
[6]	DU Mo1,2, WANG Qing-li2. Target Location Based on Double-edge Detection [J]. Computer and Modernization, 2016, 0(8): 56-59.
[7]	DUAN Shan-shan1, LI Xin2. An Adaptive Visual Odometry Algorithm Based on RGBD Sensors [J]. Computer and Modernization, 2016, 0(12): 73-77.
[8]	ZHU Hai-yang1, XU Gen-jiu2, LI Yuan-chen1, ZHANG Meng-qi2. Dynamic Threshold Selection of Local Region Based on Image Partition [J]. Computer and Modernization, 2016, 0(11): 53-57.
[9]	HAO Hongzhuan, ZHANG Weiqiang. Noise Image Edge Detection Algorithm Based on Wavelet Transform [J]. Computer and Modernization, 2015, 0(2): 80-.
[10]	ZHAO Xing-wang, LI Tian-yang, WANG Liang, ZHOU Jing. Second-generation ID Number Recognition System Based on Digital Devices [J]. Computer and Modernization, 2014, 0(6): 132-136.
[11]	LIU Ru-yi. Inter-view Prediction Based on Virtual-view and Low-rank Matrix Recovery [J]. Computer and Modernization, 2013, 1(8): 19-22.
[12]	ZHANG Yan-hong;LI Ying;ZHANG Yan-ning;WANG Feng-qin. Research and Realization of Cell Image Segmentation Method Based on Mathematical Morphology [J]. Computer and Modernization, 2013, 1(7): 135-137,.
[13]	ZHAO Boyi;ZHANG Ke. Research on a SAR Image Matching Method Based on Improved SIFT Algorithm [J]. Computer and Modernization, 2013, 1(6): 108-112.
[14]	CHEN Wei-qing;TIAN Pei-yun;ZHENG Bi-bo. Edge Detection of Color Image Based on Quaternion and LOG Operator [J]. Computer and Modernization, 2013, 1(4): 95-98,1.
[15]	GOU Rong. Image Edge Detection Based on GL Fractional Differential [J]. Computer and Modernization, 2013, 1(11): 17-19.