计算机与现代化

• 图像处理 • 上一篇    下一篇

基于视觉技术的手势跟踪与动作识别算法

  

  1. (1.华南农业大学信息学院,广东广州 510642; 2.广东工程职业技术学院,广东 广州 510520)
  • 收稿日期:2014-03-18 出版日期:2014-07-16 发布日期:2014-07-17
  • 作者简介:熊俊涛(1981-),男,湖北监利人,华南农业大学信息学院副教授,博士,研究方向:机器视觉与图像处理。
  • 基金资助:
    国家自然科学基金资助项目(31201135); 广东省教育部产学研结合项目(2011B090400160)

Gesture Tracking and Motion Recognition Algorithm Based on Vision Technology

  1. (1. College of Informatics, South China Agricultural University, Guangzhou 510642, China;
    2.Guangdong Engineering Polytechnic, Guangzhou 510520, China)
  • Received:2014-03-18 Online:2014-07-16 Published:2014-07-17

摘要: 对工业生产线上规程化操作动作进行手势跟踪与动作识别研究。首先选取YCbCr颜色模型进行手部区域识别,获得完整手部区域;然后利用Euclidean距离变换计算相邻2个手部运动轨迹点之间的距离和各帧图像的手部运动速度;再利用扩展有限状态机模型实现手部运动的分割,将分割的多个动作与建立的动作模板匹配,利用Hausdorff距离匹配法判断匹配结果的准确性,实现手部动作的识别。实验结果表明:该手部动作识别算法对背景干扰和摄像头轻微震动具有一定的抗噪能力,有较高的动作识别正确率,能够满足现实工作环境下的应用需求。

关键词: 视觉技术, 手势跟踪, 动作识别, 图像处理

Abstract: The gesture tracking and motion recognition of production line disciplined operational motion in industrial engineering was researched in this paper. Through the color analysis of hands skin, the YCbCr color model was used to recognize the hand area, the pretreatment so as threshold segmentation for video image was used in YCbCr color model to obtain the complete hand area; the Euclidean distance transform method was used to calculate the distance between the adjacent two hand trajectory points and speed of each frame image's hand movements, then the extended finite state machine model was used to realize the segmentation of hand movements, matching the segmented motions and established motion templates, and the Hausdorff distance matching method was used to determine the accuracy of the matching results, the recognition of hand gesture was realized. Experimental results show that the hand gesture recognition algorithm has certain anti-noise ability for background interference and camera vibrations, and has higher recognition accuracy, can satisfy the application requirements of real work environment.

Key words: vision technology, gesture tracking, motion recognition, image processing

中图分类号: