计算机与现代化 ›› 2021, Vol. 0 ›› Issue (08): 58-63.

• 图像处理 • 上一篇    下一篇

适用于便携式设备的深度神经网络眼动跟踪

  

  1. (成都理工大学工程技术学院,四川乐山614000)
  • 出版日期:2021-08-19 发布日期:2021-08-19
  • 作者简介:王建华(1975—),男,湖北黄冈人,讲师,硕士,研究方向:机器学习,模式识别,三维重建,E-mail: cc999687vip@sina.com; 冉煜琨(1998—),男,四川遂宁人,硕士研究生,研究方向:模式识别。
  • 基金资助:
    四川省重点实验室开放基金重点项目(scsxdz2019zd01) 

Eye-movement Tracking Based on Deep Neural Network for Portable Devices

  1. (School of Engineering and Technology, Chengdu University of Technology, Leshan 614000, China)
  • Online:2021-08-19 Published:2021-08-19

摘要: 针对目前眼动跟踪方法难以适用于智能手机、平板电脑等便携式设备的问题,提出一种基于大规模数据集的眼动跟踪方法。首先,通过众包法构建大规模数据集;然后,使用该数据集训练一个深度神经网络,用于端对端的预测。最 后,训练一个更小更快的网络进行优化,使所提方法在移动设备上的运行具有一定的实时性。实验结果表明,与其他类似方法相比,所提方法具有更好的跟踪鲁棒性以及数据泛化能力。在移动设备中的运行速度可达10~15 帧/s。在未校正的情况下,该方法在手机和平板电脑中的预测误差分别是1.71 cm和2.53 cm。校正后,误差分别降至1.34 cm和2.12 cm。 

关键词: 眼动跟踪, 众包法, 深度神经网络, 大规模数据集, 鲁棒性

Abstract: Aiming at the problem that the current eye-movement tracking methods can not be applied to intelligent mobile phones, tablet computers and other portable devices, an eye-movement tracking method based on large-scale data sets is proposed. Firstly, a large-scale data set is constructed by crowd-sourcing method. Then a deep neural network is trained with the data set for end-to-end prediction. Finally, a smaller and faster network is trained to optimize, which makes the proposed method run in real-time on mobile devices. Experimental results show that the proposed method has better tracking robustness and data generalization ability than other similar methods. The speed of running in mobile devices can reach 10~15 frames per second. The prediction errors of this method are 1.71 cm and 2.53 cm respectively in mobile phone and tablet computer without correction. After calibration, the errors are reduced to 1.34 cm and 2.12 cm respectively.

Key words: eye-movement tracking, crowd-sourcing method, deep neural network, large scale data sets, robustness