Method of Human Dynamic Modeling Based on RGB-D Sequences

Abstract

Abstract:

Human modeling is an important research topic in the field of computer vision research. Human modeling has a very broad application prospects in the field of

scientific research, animation, games, costume design, industry, etc. The traditional modeling methods can restore the body’s posture in general, but there will be deviations

details. This paper presents a method based on RGB-D sequences. When human activities in the scene, we could capture the data of the human skeleton and three-dimensional point

cloud by cheap equipment Kinect. First, we transform the template human modeling to the target location by the skeleton data captured. Next, the ICP algorithm is adopted to make

the model point cloud acquired by Kinect more accurate registration. Finally, we obtain TPS to make the human modeling smooth deformation.

Key words: human modeling, depth camera, skeleton

LIU Yang. Method of Human Dynamic Modeling Based on RGB-D Sequences[J]. Computer and Modernization.

References

［1］
Tong Jing, Zhang Ming-min, Xiang Xue-qin, et al. 3D body scanning with hairstyle using one time-of-flight camera ［J］. Computer Animation and Virtual Worlds, 2011,22(2-3):203-

211.
［2］ Rosenhahn B, Schmaltz C, Brox T, et al. Markerless motion capture of man-machine interaction［C］// IEEE Conference on Computer Vision and Pattern Recognition.

2008:1-8.
［3］ Gerard Pons-Moll, Andreas Baak, Juergen Gall, et al. Outdoor human motion capture using inverse kinematics and von mises-fisher sampling［C］// Proceedings of the IEEE

International Conference on Computer Vision. 2011:1243-1250.
［4］ Balan A O, Sigal L, Black M J, et al. Detailed human shape and pose from images［C］// Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern

Recognition. 2007:1-8.
［5］ Dimitrios S Alexiadis, Dimitrios Zarpalas, Petros Daras. Real-time, full 3-D reconstruction of moving foreground objects from multiple consumer depth cameras［J］. IEEE

Transactions on Multimedia, 2013,15(2): 339-358.
［6］ Jang In Yeop, Cho Ji-Ho, Lee Kwan H. 3D human modeling from a single depth image dealing with self-occlusion ［J］. Multimedia Tools and Applications, 2012,58

(1):267-288.
［7］ Tong J, Zhou J, Liu L, et al. Scanning 3D full human bodies using kinects ［J］. Visualization and Computer Graphics, IEEE Transactions on, 2012,18(4): 643-650.
［8］ Shotton J, Girshick R, Fitzgibbon A, et al. Efficient human pose estimation from single depth images［J］. IEEE Transactions on Pattern Analysis and Machine Intelligence,

2013,35(12):2821-2840.
［9］ Shotton J, Sharp T, Kipman A, et al. Real-time human pose recognition in parts from single depth images ［J］. Communications of the ACM, 2013,56(1):116-124.

［10］ Javier G, Zeev Z. Range mapping using speckle decorrelation ［P］. United States: 7433024, 2008-10-07.
［11］Michael Van den Bergh, Daniel Carton, Luc Van Gool. Depth SEEDS: Recovering incomplete depth data using superpixels ［C］// Proceedings of IEEE Workshop on Applications

of Computer Vision. 2013:363-368.
［12］Liu J, Gong X, Liu J.Guided inpainting and filtering for Kinect depth maps［C］// Proceedings of the International Conference on Pattern Recognition. 2012:2055-2058.
［13］Abdul D, Ammar H. Recovering Missing Depth Information from Microsoft’s Kinect ［DB/OL］. http://www.andrew.cmu.edu/user/ammarh/projects/vis_project.pdf, 2014-03-24.
［14］Peng K, Chen X,Zhou D, et al. 3-D reconstruction using image sequences based on projective depth and simplified iterative closest point ［J］. Optical Engineering,

2012,51(2): 021110.
［15］Paul J Besl, Neil D McKay. A method for registration of 3-D shapes［J］. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1992,14(2): 239-256.
［16］Eric T, Yves B J. Elastic registration of MRI scans using fast DCT［C］// Proceedings of the 22nd Annual EMBS International Conference. 2000:2854-2856.
［17］Mattes D, Haynor D R, Vesselle H. PET-CT image registration in the chest using free-form deformations［J］. IEEE Transactions on Medical Imaging, 2003,22(1):120-128.
［18］Krinidis S, Nikou S, Pitas I. Reconstruction of serially acquired slices using physics-based modeling ［J］. IEEE Transactions on Information Technology in Biomedicine,

2003,7(4):394-403.
［19］Hu Yongli, Zhu Xianghui, Sun Yanfeng, et al. Multi-sample 3D face registration based on TPS transformation and linear combination model ［C］// Proceedings of the 4th

International Congress on Image and Signal Processing. 2011:1343-1348.

[1]	SU Chen-yao, LIU Xiang-yang. Skeleton Extraction Algorithm Based on Heat Method [J]. Computer and Modernization, 2022, 0(03): 59-63.
[2]	TONG Jing, CHEN Zheng-ming, LIU Jing, XU Xin . Key Technologies of Low-cost Individuation Manufacturing Prototype System [J]. Computer and Modernization, 2014, 0(2): 98-101.
[3]	MA Jun. Object Tracking Algorithm Based on Image and Depth Fusion [J]. Computer and Modernization, 2013, 1(9): 91-94.
[4]	XU Chun;;WAN Jian-yi;;YAN Fei-bo. Application of XML in Parallel Skeleton Specification [J]. Computer and Modernization, 2009, 5(5): 51-0.