手势识别与交互综述

doi:10.3969/j.issn.1006-2475.2024.08.012

摘要/Abstract

摘要： 手势识别与交互技术是人机交互技术与人工智能技术前沿研究的基石任务。该任务以计算机和设备协同工作识别、处理手势信息并给出与手势相对应的机器操作为主要目标，融合应用了动作捕捉、图像处理、图像分类、多端协同交互工作等多项技术，是支撑指挥控制系统、机器人交互、医疗操作等当下前沿智能交互工作与人机交互工作的有力保障。目前，手势识别与交互的相关研究已经日渐成熟，应用领域广泛、应用场景丰富。本文主要对手势识别与交互的相关技术和硬件发展做出综述。首先，全面梳理手势识别与交互技术的研究进展，同时对手势识别的关键步骤进行归类描述；其次，分类阐述用于三维手势交互的当前主流手势识别深度传感器的相关工作；随后，对三维手势识别的真实感识别技术进行剖析和讨论；最后，分析手势识别与交互技术中存在的不足与亟待改进的问题，提出融合深度学习、模式识别等前沿技术与有可行性的研究思路和方法，对该领域未来的研究方向、技术发展和应用领域做出预测和展望。

关键词: 手势识别, 手势交互, 人机交互, 多模态智能交互, 计算机视觉

Abstract: Gesture recognition and interaction technology is the cornerstone task of frontier research in human-computer interaction technology and artificial intelligence technology. This task takes the collaborative work of computers and devices to recognize and process gesture information and give machine operations corresponding to gestures as the main goal， and integrates a number of technologies such as motion capture， image processing， image classification， and multi-terminal collaborative interaction， which is a powerful guarantee to support the command and control system， robot interaction， medical operation and other cutting-edge intelligent interaction and human-computer interaction work nowadays. At present， the research on gesture recognition and interaction has become more and more mature with a wide range of application fields and rich application scenarios. This paper mainly provides a review of the gesture recognition development and interaction related technologies and hardware. Firstly， it sorts the research progress of gesture recognition and interaction technology out comprehensively， and categories the key steps of gesture recognition at the same time. Secondly， it classifies and elaborates the related work of the current mainstream gesture recognition depth sensors used for 3D gesture interaction. Subsequently， it analyses and discusses the real sense recognition technology for 3D gesture recognition. Finally， it analyses the deficiencies and urgent problems in gesture recognition and interaction technology， proposes the integration of such cutting-edge technologies as deep learning， pattern recognition and other feasible research ideas and methods， and makes predictions and prospects for the future research direction， technology development and application areas in this field.

Key words: gesture recognition, gesture interaction, human-computer interaction, multimodal intelligent interaction, computer vision

中图分类号:

TP391

魏嘉焜, 王家润. 手势识别与交互综述[J]. 计算机与现代化, 2024, 0(08): 67-76.

WEI Jiakun, WANG Jiarun. Survey on Gesture Recognition and Interaction[J]. Computer and Modernization, 2024, 0(08): 67-76.

参考文献

［1］ DIEDERICH S， BRENDEL A B， MORANA S， et al. On the design of and interaction with conversational agents： An organizing and assessing review of human-computer interaction research［J］. Journal of the Association for Information Systems， 2022，23（1）：96-138.
［2］ MITRA S， ACHARYA T. Gesture recognition： A survey［J］. IEEE Transactions on Systems， Man， and Cybernetics， 2007，37（3）：311-324.
［3］ AIGNER R， WIGDOR D， BENKO H， et al. Understanding Mid-air Hand Gestures： A Study of Human Preferences in Usage of Gesture Types for HCI［R］. Microsoft Research Technical Report MSR-TR-2012-111， 2012.
［4］ TUNG Y C， HSU C Y， WANG H Y， et al. User-defined game input for smart glasses in public space［C］// Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM， 2015：3327-3336.
［5］ GADEKALLU T R， SRIVASTAVA G， LIYANAGE M， et al. Hand gesture recognition based on a Harris hawks optimized convolution neural network［J］. Computers and Electrical Engineering， 2022，100. DOI： 10.1016/j.compeleceng.2022.107836.
［6］ CHENG H， YANG L， LIU Z C. Survey on 3D hand gesture recognition［J］. IEEE Transactions on Circuits and Systems for Video Technology， 2016，26（9）：1659-1673.
［7］赵小川，赵继鹏，范炳远，等. 手势识别技术研究综述与应用展望［C］// 第十一届全国信号和智能信息处理与应用学术会议论文集. 中国高科技产业化研究会， 2017：294-297.
［8］ STURMAN D J， ZELTZER D. A survey of glove-based input［J］. IEEE Computer Graphics and Applications， 1994，14（1）：30-39.
［9］ BACE M， LEPPANEN T， DE GOMEZ D G， et al. UbiGaze： Ubiquitous augmented reality messaging using gaze gestures［C］// Proceedings of the SIGGRAPH Asia 2016 Mobile Graphics and Interactive Applications. ACM， 2016. DOI： 10.1145/2999508.2999530.
［10］ HAQUE F， NANCEL M， VOGEL D. Myopoint： Pointing and clicking using forearm mounted electromyography and inertial motion sensors［C］// Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM， 2015：3653-3656.
［11］ HSIEH Y T， JYLHA A， JACUCCI G. Pointing and selecting with tactile glove in 3D environment［C］// Proceedings of the 3rd International Workshop on Symbiotic Interaction. Springer， 2014：133-137.
［12］ ROSENBERG R， SLATER M. The chording glove： A glove-based text input device［J］. IEEE Transactions on System， Man， and Cybernetics， 1999，29（2）：186-191.
［13］ MARKUSSEN A， JAKOBSEN M R， HORNBAEK K. Vulture： A mid air word-gesture keyboard［C］// Proceedings of the 2014 SIGCHI Conference on Human Factors in Computing Systems. ACM， 2014：1073-1082.
［14］ FELS S S， HINTON G E. Glove-talk Ⅱ： A neural-network interface which maps gestures to parallel formant speech synthesizer controls［J］. IEEE Transactions on Neural Networks， 1998，9（1）：205-212.
［15］ PHI L T， NGUYEN H D， BUI T T Q， et al. A glove-based gesture recognition system for Vietnamese sign language［C］// Proceedings of the 2015 15th International Conference on Control， Automation and Systems. IEEE， 2015：1555-1559.
［16］ KIM J H， THANG N D， KIM T S. 3-D hand motion tracking and gesture recognition using a data glove［C］// Proceedings of the 2009 IEEE International Symposium on Industrial Electronics. IEEE， 2009：1013-1018.
［17］ KADOUS M W. Machine recognition of Auslan signs using powerGloves： Towards large-lexicon recognition of sign language［C］// Proceedings of the 1996 Workshop on the Integration of Gesture in Language. Springer， 1996：165-174.
［18］ LIANG R H， OUHYOUNG M. A real-time continuous alphabetic sign language to speech conversion VR system［J］. Computer Graphics Forum， 1995，14（3）：67-76.
［19］ WANG R Y， POPOVIC J. Real-time hand-tracking with a color glove［J］. ACM Transactions on Graphics， 2009，28（3）. DOI： 10.1145/1531326.1531369.
［20］ IBM Systems and Technology Group. User Interface Enhancement with Cell［EB/OL］. （2008-03-04）［2023-04-20］. http：//eiusys.denayer.wenk.be/Tcell/Presentaties/Austin/IBM_Gesture_Interface_Recognition_with_Cell_BE_March_4.pdf.
［21］ MARTINS T， SOMMERER C， MIGNONNEAU L， et al. Gauntlet： A wearable interface for ubiquitous gaming［C］// Proceedings of the 10th International Conference on Human Computer Interaction with Mobile Devices and Services. ACM， 2008：367-370.
［22］ HSIEH Y T， JYLHA A， ORSO V， et al. Designing a willing-to-use-in-public hand gestural interaction technique for smart glasses［C］// Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM， 2016：4203-4215.
［23］ GUINNESS D， JUDE A， POOR G M， et al. Models for rested touchless gestural interaction［C］// Proceedings of the 3rd ACM Symposium on Spatial User Interaction. ACM， 2015：34-43.
［24］ SIMON T M， SMITH R T， THOMAS B， et al. Merging tangible buttons and spatial augmented reality to support ubiquitous prototype designs［C］// Proceedings of the 13th Australasian User Interface Conference. ACM， 2012，126：29-38.
［25］ BAILLY G， MULLER J， ROHS M， et al. ShoeSense： A new perspective on gestural interaction and wearable applications［C］// Proceedings of the 2012 SIGCHI Conference on Human Factors in Computing Systems， ACM， 2012：1239-1248.
［26］ CHAN L W， CHEN Y L， HSIEH C H， et al. CyclopsRing： Enabling whole-hand and context-aware interactions through a fisheye ring［C］// Proceedings of the 28th Annual ACM Symposium on User Interface Software and Technology. ACM， 2015：549-556.
［27］ KOLSCH M， TURK M， HOLLERER T. Vision-based interfaces for mobility［C］// Proceedings of the 1st Annual International Conference on Mobile and Ubiquitous Systems： Networking and Services. IEEE， 2004：86-94.
［28］ HUANG Z P， LI W K， HUI P. Ubii： Towards seamless interaction between digital and physical worlds［C］// Proceedings of the 23rd ACM International Conference on Multimedia. ACM， 2015：341-350.
［29］ LEE T， HOLLERER T. Handy AR： Markerless inspection of augmented reality objects using fingertip tracking［C］// Proceedings of the 2007 11th IEEE International Symposium on Wearable Computers. IEEE， 2007：83-90.
［30］ GUIMBRETIERE F， NGUYEN C. Bimanual marking menu for near surface interactions［C］// Proceedings of the 2012 SIGCHI Conference on Human Factors in Computing Systems， ACM， 2012：825-828.
［31］ HA T， FEINER S， WOO W. WeARHand： Head-worn， RGB-D camera-based， bare-hand user interface with visually enhanced depth perception［C］// Proceedings of the 2014 IEEE International Symposium on Mixed and Augmented Reality. IEEE， 2014：219-228.
［32］ REKIMOTO J. GestureWrist and gesturePad： Unobtrusive wearable interaction devices［C］// Proceedings of the 5th International Symposium on Wearable Computers. IEEE， 2001：21-27.
［33］李博男，林凡. 基于曲率的指尖检测方法［J］. 南京航空航天大学学报， 2012，44（4）：587-591.
［34］杨端端，金连文，尹俊勋. 手指书写汉字识别系统中的指尖检测方法［J］. 华南理工大学学报（自然科学版）， 2007，35（1）：58-63.
［35］翁汉良，战荫伟. 基于视觉的多特征手势识别［J］. 计算机工程与科学， 2012，34（2）：123-127.
［36］苑玮琦，方婷，魏明月. 自然摆放的手图像指根点提取方法［J］. 光电子·激光， 2013，24（6）：1191-1197.
［37］张毅，刘钰然，罗元. 基于视觉的手势识别方法及其在数字信号处理器上的实现［J］. 计算机应用， 2014，34（3）：833-836.
［38］ VEZHNEVETS V， SAZONOV V， ANDREEVA A. A survey on pixel-based skin color detection techniques［C］// Proceedings of GraphiCon 2003. GraphiCon， 2003：85-92.
［39］廖赟. 基于祼手的自然人机交互关键算法研究［D］. 昆明：云南大学， 2012.
［40］ HAN J G， SHAO L， XU D， et al. Enhanced computer vision with Microsoft Kinect sensor： A review［J］. IEEE Transactions on Cybernetics， 2013，43（5）：1318-1334.
［41］岳昊恩，袁亮，吕凯. 结合帧差法与Mean Shift的抗遮挡跟踪算法［J］. 现代电子技术， 2019，42（12）：180-182.
［42］ GUO Y H， SENGUR A， AKBULUT Y， et al. An effective color image segmentation approach using neutrosophic adaptive mean shift clustering［J］. Measurement， 2018，119：28-40.
［43］ ORON S， BAR-HILLEL A， LEVI D， et al. Locally orderless tracking［J］. International Journal of Computer Vision， 2015，111（2）：213-228.
［44］ ROSS D A， LIM J， LIN R S， et al. Incremental learning for robust visual tracking［J］. International Journal of Computer Vision， 2008，77（1-3）：125-141.
［45］ KWON J， LEE K M. Tracking by sampling trackers［C］// Proceedings of the 2011 International Conference on Computer Vision. IEEE， 2011：1195-1202.
［46］林燕，冯志全，朱德良，等. 以多模型融合为特征的三维手势跟踪算法［J］. 计算机辅助设计与图形学学报， 2013，25（4）：450-459.
［47］ QIAN X Y， HAN L， ZHANG Y L， et al. An object tracking method using deep learning and adaptive particle filter for night fusion image［C］// Proceedings of the 2017 International Conference on Progress in Informatics and Computing. IEEE， 2017：138-142.
［48］王彩红，沈燕飞，王毅，等. 基于时空上下文的手势跟踪与识别［J］. 计算机工程与应用， 2016，52（9）：202-207.
［49］王修辉，鲍虎军. 基于自适应遗传算法的手势识别［J］. 计算机辅助设计与图形学学报， 2007，19（8）：1056-1062.
［50］ KOFMAN J， VERMA S， WU X H. Robot-manipulator teleoperation by markerless vision-based hand-arm tracking［J］. International Journal of Optomechatronics， 2007，1（3）：331-357.
［51］ DARDAS N H， GEORGANAS N D. Real-time hand gesture detection and recognition using bag-of-features and support vector machine techniques［J］. IEEE Transactions on Instrumentation and Measurement， 2011，60（11）：3592-3607.
［52］隋云衡，郭元术. 融合Hu矩与BoF-SURF支持向量机的手势识别［J］. 计算机应用研究， 2014，31（3）：953-956.
［53］ TAN W J， BIAN Z J， YANG J Z， et al. Hand gesture shape descriptor based on energy-ratio and normalized Fourier transform coefficients［C］// Proceedings of the 5th International Conference on Swarm Intelligence. Springer， 2014：34-41.
［54］王原，汤勇明，王保平. 基于混合高斯模型的非固定握持姿势手势识别［J］. 东南大学学报（自然科学版）， 2014，44（2）：239-243.
［55］ ALNAIM N， ABBOD M， ALBAR A. Hand gesture recognition using convolutional neural network for people who have experienced a stroke［C］// Proceedings of the 2019 3rd International Symposium on Multidisciplinary Studies and Innovative Technologies. IEEE， 2019. DOI： 10.1109/ISMSIT.2019.8932739.
［56］ CHUNG H Y， CHUNG Y L， TSAI W F. An efficient hand gesture recognition system based on deep CNN［C］// Proceedings of the 2019 IEEE International Conference on Industrial Technology. IEEE， 2019：853-858.
［57］ LI G F， TANG H， SUN Y， et al. Hand gesture recognition based on convolution neural network［J］. Cluster Computing， 2019，22（S2）：2719-2729.
［58］ LIN H I， HSU M H， CHEN W K. Human hand gesture recognition using a convolution neural network［C］// Proceedings of the 2014 IEEE International Conference on Automation Science and Engineering. IEEE， 2014：1038-1043.
［59］ WU X Y. A hand gesture recognition algorithm based on DC-CNN［J］. Multimedia Tools and Applications， 2020，79（13-14）：9193-9205.
［60］崔虎，黄仁婧，陈青梅，等. 基于异步多时域特征的动态手势识别方法［J］. 计算机工程与应用， 2022，58（21）：163-171.
［61］王粉花，张强，黄超，等. 融合双流三维卷积和注意力机制的动态手势识别［J］. 电子与信息学报， 2021，43（5）：1389-1396.
［62］ GRATZEL C， FONG T， GRANGE S， et al. A non-contact mouse for surgeon-computer interaction［J］. Technology and Health Care， 2004，12（3）：245-257.
［63］姚远，张林剑，乔文豹. RGB-D图像中手部样本标记与手势识别［J］. 计算机辅助设计与图形学学报， 2013，25（12）：1810-1817.
［64］李红波，丁林建，吴渝，等. 基于Kinect骨骼数据的静态三维手势识别［J］. 计算机应用与软件， 2015，32（9）：161-165.
［65］ BATABYAL T， CHATTOPADHYAY T， MUKHEIJEE D P. Action recognition using joint coordinates of 3D skeleton data［C］// Proceedings of the 2015 IEEE International Conference on Image Processing. IEEE， 2015：4107-4111.
［66］ ZHU H M， PUN C M. Human action recognition with skeletal information from depth camera［C］// Proceedings of the 2013 IEEE International Conference on Information and Automation. IEEE， 2013：1082-1085.
［67］ ZHANG Z Y. Microsoft Kinect sensor and its effect［J］. IEEE MultiMedia， 2012，19（2）：4-10.
［68］ NAIR， R， RUHL K， LENZEN F， et al. A survey on time-of-flight stereo fusion［M］// Time-of-Flight and Depth Imaging： Sensors， Algorithms， and Applications. Springer， 2013：105-127.
［69］ CHEN L L， WEI H， FERRYMAN J. A survey of human motion analysis using depth imagery［J］. Pattern Recognition Letters， 2013，34（15）：1995-2006.
［70］ SUAREZ J， MURPHY R R. Hand gesture recognition with depth images： A review［C］// Proceedings of the 2012 IEEE RO-MAN： The 21st IEEE International Symposium on Robot and Human Interactive Communication. IEEE， 2012：411-417.
［71］ SHOTTON J， FITZGIBBON A， COOK M， et al. Real-time human pose recognition in parts from single depth images［C］// Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition. IEEE， 2011：1297-1304.
［72］ LAI K， KONRAD J， ISHWAR P. A gesture-driven computer interface using Kinect［C］// Proceedings of the 2012 IEEE Southwest Symposium on Image Analysis and Interpretation. IEEE， 2012：185-188.
［73］ TAMAKI E， MIYAK T， REKIMOTO J. BrainyHand： A wearable computing device without HMD and it’s interaction techniques［C］// Proceedings of the 2010 International Conference on Advanced Visual Interfaces. ACM， 2010：387-388.
［74］ OIKONOMIDIS I， KYRIAZIS N， ARGYROS A A. Markerless and efficient 26-DOF hand pose recovery［C］// Proceedings of the 10th Asian Conference on Computer Vision. Springer， 2010：744-757.
［75］ REN Z， YUAN J S， ZHANG Z Y. Robust hand gesture recognition based on finger-earth mover’s distance with a commodity depth camera［C］// Proceedings of the 19th ACM International Conference on Multimedia. ACM， 2011：1093-1096.
［76］ OIKONOMIDIS I， KYRIAZIS N， ARGYROS A A. Efficient model-based 3D tracking of hand articulations using Kinect［C］// Proceedings of the 2011 British Machine Vision Conference. BMVA， 2011.
［77］ OIKONOMIDIS I， KYRIAZIS N， ARGYROS A A. Full DOF tracking of a hand interacting with an object by modeling occlusions and physical constraints［C］// Proceedings of the 2011 International Conference on Computer Vision. IEEE， 2011：2088-2095.
［78］ KURAKIN A， ZHANG Z， LIU Z. A real time system for dynamic hand gesture recognition with a depth sensor［C］// Proceedings of the 20th European Signal Processing Conference. IEEE， 2012：1975-1979.
［79］ OIKONOMIDIS I， KYRIAZIS N， ARGYROS A A. Tracking the articulated motion of two strongly interacting hands［C］// Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition. IEEE， 2012：1862-1869.
［80］ CHENG H， DAI Z J， LIU Z C. Image-to-class dynamic time warping for 3D hand gesture recognition［C］// Proceedings of the 2013 IEEE International Conference on Multimedia and Expo. IEEE， 2013. DOI： 10.1109/ICME.2013.6607524.
［81］ POTTER L E， ARAULLO J， CARTER L. The leap motion controller： A view on sign language［C］// Proceedings of the 25th Australian Computer-Human Interaction Conference： Augmentation， Application， Innovation， Collaboration. ACM， 2013：175-178.
［82］ MCKEAGUE S， LIU J D， YANG G Z. An asynchronous RGB-D sensor fusion framework using Monte-Carlo methods for hand tracking on a mobile robot in crowded environments［C］// Proceedings of the 5th International Conference on Social Robotics. Springer， 2013：491-500.
［83］ CHENG H， LUO J， CHEN X W. A windowed dynamic time warping approach for 3D continuous hand gesture recognition［C］// Proceedings of the 2014 IEEE International Conference on Multimedia and Expo. IEEE， 2014. DOI： 10.1109/ICME.2014.6890302.
［84］徐崇斌，周明全，沈俊辰，等. 一种基于Leap Motion的直观体交互技术［J］. 电子与信息学报， 2015，37（2）：353-359.
［85］李昊鑫. 三维手姿态建模及其交互系统研究［D］. 成都：电子科技大学， 2016.
［86］ FRATI V， PRATTICHIZZO D. Using Kinect for hand tracking and rendering in wearable haptics［C］// Proceedings of the 2011 IEEE World Haptics Conference. IEEE， 2011：317-321.
［87］ ABABSA F， HE J H， CHARDONNET J R. Combining hololens and leap-motion for free hand-based 3D interaction in MR environments［C］// Proceedings of the 7th International Conference on Augmented Reality， Virtual Reality， and Computer Graphics. Springer， 2020：315-327.
［88］ LIEBMANN F， RONER S， VON ATZIGEN M， et al. Pedicle screw navigation using surface digitization on the Microsoft hololens［J］. International Journal of Computer Assisted Radiology and Surgery， 2019，14（7）：1157-1165.
［89］ SHIMADA M， KURIHARA K， TSUJII T. Prototype of an augmented reality system to support animal surgery using hololens 2［C］// Proceedings of the 2022 IEEE 4th Global Conference on Life Sciences and Technologies. IEEE， 2022：335-337.
［90］韩彦鹏. 基于Leap Motion的手势识别算法的改进研究［D］. 银川：宁夏大学， 2022.
［91］崔海青，张旭鹏，詹湘琳. 基于HoloLens的飞机维修远程指导系统［J］. 计算机测量与控制， 2023，31（5）：214-220.
［92］ VATAVU R D. User-defined gestures for free-hand TV control［C］// Proceedings of the 10th European Conference on Interactive TV and Video. ACM， 2012：45-48.
［93］ GALLO L， PLACITELLI A P， CIAMPI M. Controller-free exploration of medical image data： Experiencing the Kinect［C］// Proceedings of the 2011 24th International Symposium on Computer-Based Medical Systems. IEEE， 2011. DOI： 10.1109/CBMS.2011.5999138.
［94］ CAPUTO M， DENKER K， DUMS B， et al. 3D hand gesture recognition based on sensor fusion of commodity hardware［M］// Mensch and Computer. Oldenbourg Verlag， 2012：293-302.
［95］ ZAFRULLA Z， BRASHEAR H， STARNER T， et al. American sign language recognition with the Kinect［C］// Proceedings of the 13th International Conference on Multimodal Interfaces. ACM， 2011：279-286.
［96］ CHAI X J， LI G， LIN Y S， et al. Sign language recognition and translation with Kinect［C］// Proceedings of the 10th IEEE International Conference on Automatic Face and Gesture Recognition. IEEE， 2013：22-26.
［97］ TANG M. Recognizing Hand Gestures with Microsoft’s Kinect［R］. Stanford University， 2011.
［98］ YU Z B， WANG J J， XU J W， et al. Skeleton2Mesh： Kinematics prior injected unsupervised human mesh recovery［C］// Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision. IEEE， 2021：8599-8609.
［99］ ZHAO W P， CHAI J X， XU Y Q. Combining marker-based mocap and RGB-D camera for acquiring high-fidelity hand motion data［C］// Proceedings of the 2012 ACM SIGGRAPH/Eurographics Symposium on Computer Animation. ACM， 2012：33-42.
［100］ESKIN C， KIRAC F， KARA Y E， et al. Real time hand pose estimation using depth sensors［C］// Proceedings of the 2011 IEEE International Conference on Computer Vision Workshops. IEEE， 2011：1228-1234.
［101］VAN DEN BERGH M， CARTON D， DE NIJS R， et al. Real-time 3D hand gesture interaction with a robot for understanding directions from humans［C］// Proceedings of the 2011 RO-MAN. IEEE， 2011：357-362.
［102］BISWAS K K， BASU S K. Gesture recognition using Microsoft Kinect［C］// Proceedings of the 5th International Conference on Automation， Robotics and Applications. IEEE， 2011：100-103.
［103］WEN Y， HU C Y， YU G H， et al. A robust method of detecting hand gestures using depth sensors［C］// Proceedings of the 2012 IEEE International Workshop on Haptic Audio Visual Environments and Games. IEEE， 2012：72-77.
［104］RAHEJA J L， CHAUDHARY A， SINGAL K. Tracking of fingertips and centers of palm using Kinect［C］// Proceedings of the 2011 3rd International Conference on Computational Intelligence， Modelling and Simulation. IEEE， 2011：248-252.
［105］DU G L， ZHANG P， MAI J H， et al. Markerless Kinect-based hand tracking for robot teleoperation［J］. International Journal of Advanced Robotic Systems， 2012，9（2）. DOI： 10.5772/50093.
［106］LEE U， TANAKA J. Hand controller： Image manipulation interface using fingertips and palm tracking with Kinect depth data［C］// Proceedings of the 2012 Asia Pacific Conference of Computer Human Interaction. ACM， 2012：705-706.
［107］REN Z， MENG J J， YUAN J S， et al. Robust hand gesture recognition with Kinect sensor［C］// Proceedings of the 19th ACM International Conference on Multimedia. ACM， 2011：759-760.
［108］LI Y. Hand gesture recognition using Kinect［C］// Proceedings of the 2012 IEEE International Conference on Computer Science and Automation Engineering. IEEE， 2012：196-199.
［109］REN Z， YUAN J S， MENG J J， et al. Robust part-based hand gesture recognition using Kinect sensor［J］. IEEE Transaction on Multimedia， 2013，15（5）：1110-1120.
［110］SHIRATUDDIN M F， WONG K W. Non-contact multi-hand gestures interaction techniques for architectural design in a virtual environment［C］// Proceedings of the 5th International Conference on Information Technology and Multimedia. IEEE， 2011. DOI： 10.1109/ICIMU.2011.6122761.
［111］PEDERSOLI F， ADAMI N， BENINI S， et al. XKin-： Extendable hand pose and gesture recognition library for Kinect［C］// Proceedings of the 20th ACM International Conference on Multimedia. ACM， 2012：1465-1468.
［112］REGENBRECHT H， COLLINS J， HOERMANN S. A leap-supported， hybrid AR interface approach［C］// Proceedings of the 25th Australian Computer-Human Interaction Conference： Augmentation， Application， Innovation， Collaboration. ACM， 2013：281-284.
［113］SABIR K， STOLTE C， TABOR B， et al. The molecular control toolkit： Controlling 3D molecular graphics via gesture and voice［C］// Proceedings of the 2013 IEEE Symposium on Biological Data Visualization. IEEE， 2013：49-56.
［114］PORFIRIO A J， WIGGERS K L， OLIVEIRA L E S， et al. LIBRAS sign language hand configuration recognition based on 3D meshes［C］// Proceedings of the 2013 IEEE International Conference on Systems， Man， and Cybernetics. IEEE， 2013：1588-1593.
［115］WEICHERT F， BACHMANN D， RUDAK B， et al. Analysis of the accuracy and robustness of the leap motion controller［J］. Sensors， 2013，13（5）：6380-6393.
［116］XU D， CHEN Y L， LIN C， et al. Real-time dynamic gesture recognition system based on depth perception for robot navigation［C］// Proceedings of the 2012 IEEE International Conference on Robotics and Biomimetics. IEEE， 2012：689-694.
［117］BOUKHAYMA A， DE BEM R， TORR P H S. 3D hand shape and pose from images in the wild［C］// Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition. IEEE， 2019：10835-10844.
［118］GE L H， REN Z， LI Y C， et al. 3D hand shape and pose estimation from a single RGB image［C］// Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition. IEEE， 2019：10825-10834.
［119］HAN S C， LIU B B， CABEZAS R， et al. MEgATrack： Monochrome egocentric articulated hand-tracking for virtual reality［J］. ACM Transaction of Graphics， 2020，39（4）. DOI： 10.1145/3386569.3392452.

[1]	黄庭培1, 马禄彪1, 李世宝2, 刘建航1. 基于WiFi和原型网络的手势识别方法[J]. 计算机与现代化, 2024, 0(12): 34-39.
[2]	周义凯，王宇，赵勇飞，袁燕. 基于CNN的人体姿态识别[J]. 计算机与现代化, 2019, 0(02): 49-.
[3]	姜雪婷,王宇,田丽迎. 人机交互中情感状态单多模的人类感知[J]. 计算机与现代化, 2016, 0(10): 104-111.
[4]	何坤金1，张莉军1，李强1，刘建新2. 基于OSG的航道船舶三维可视化信息管理系统[J]. 计算机与现代化, 2015, 0(11): 89-92.
[5]	顾绮芳. 上下肢康复训练器控制系统的设计与实现 [J]. 计算机与现代化, 2013, 1(11): 214-218.
[6]	高云丽;刘贤梅. 基于Flash的微生物发酵平台[J]. 计算机与现代化, 2013, 218(10): 51-54.
[7]	聂岩峰;田田;吴昊. 基于GIS指挥决策系统的多通道交互研究[J]. 计算机与现代化, 2013, 1(1): 203-206.
[8]	李钧;. 一种新型红外多点触摸识别算法[J]. 计算机与现代化, 2012, 1(9): 178-180,.
[9]	葛茜倩. 基于LPC2478的嵌入式人机互动终端[J]. 计算机与现代化, 2012, 1(200): 37-03.
[10]	顾杲;谈代林;李昌勇;武和雷. 基于双CPU结构的电能质量监测系统设计[J]. 计算机与现代化, 2012, 208(12): 222-225.
[11]	邱银国孙久运徐小芳魏萌. 基于Virtools的虚拟环境中视频应用技术研究 [J]. 计算机与现代化, 2011, 194(10): 54-56.