计算机与现代化 ›› 2021, Vol. 0 ›› Issue (10): 88-93.

• 图像处理 • 上一篇    下一篇

基于机械臂的化学物品定位与分类

  

  1. (青岛科技大学信息科学技术学院,山东青岛266061)
  • 出版日期:2021-10-14 发布日期:2021-10-14
  • 作者简介:马兴录(1970—),男,山东临沂人,副教授,硕士生导师,硕士,研究方向:嵌入式系统与自动化控制,E-mail: qdmxl@163.com; 通信作者:张兴强(1995—),男,山东淄博人,硕士研究生,研究方向:嵌入式系统与软件开发,E-mail: 953233624@qq.com; 王涛(1995—),男,山东临沂人,硕士研究生,研究方向:嵌入式系统与软件开发,E-mail: 861177678@qq.com。
  • 基金资助:
    国家重点研发计划项目(2017YFB1400903); 山东省重点研发计划项目(2017GSF218088)

Visual Grasping of Robot Arm in Chemical Experiment Scene

  1. (College of Information Science and Technology, Qingdao University of Science and Technology, Qingdao 266061, China)
  • Online:2021-10-14 Published:2021-10-14

摘要: 针对化学实验场景下深度相机难以探测试管等透明物体距离,继而引起机械臂难以获取化学试管在空间中的三维坐标的问题,提出通过改进的深度学习算法YOLOv3 Tiny检测试管上的贴纸标签以获取透明化学试管的三维空间坐标;针对不同化学试管无法分类的问题,提出通过深度学习算法CTPN+BLSTM+CTC Loss识别标签上的文字信息对试管进行分类。本文采用深度相机、单目相机与搭载ROS系统的六轴机械臂为实验平台,在TensorFlow上训练化学标签检测模型与文字检测识别模型。通过在机械臂搭载的树莓派上的ROS系统进行Python编程对贴有不同的化学标签的化学试管进行抓取实验,结果显示该方法对贴有标签的透明试管具有较高的识别率及定位准确率,可以实现机械臂抓取装有不同物质的化学试管。

关键词: 机械臂, 视觉捕获, 透明目标检测, 手写文字识别

Abstract: Aiming at the problem that it is difficult for the depth camera to detect the distance of transparent objects such as test tubes in chemical experiment scenes, and the robot arm is difficult to obtain the three-dimensional coordinates of the chemical test tubes in space, an improved deep learning algorithm YOLOv3 Tiny is proposed to detect the sticker labels on the test tube to obtain the three-dimensional coordinates of transparent chemical test tube. In view of the problem that different chemical test tubes cannot be classified, a deep learning algorithm CTPN+BLSTM+CTC Loss is proposed to identify the text information on the label to classify the test tubes. In this paper, a depth camera, a monocular camera and a six-axis robotic arm equipped with a ROS system are used as the experimental platform to train a chemical label detection model and a text detection recognition model on TensorFlow. The ROS system on the Raspberry Pi equipped with the robotic arm is used to perform Python programming and make grasping test about the chemical test tubes with different chemical labels. The results show that this method has a high recognition rate and positioning accuracy for the transparent test tubes with labels. It can realize the robotic arm grabbing chemical test tubes containing different substances.

Key words: robotic arm, visual capture, transparent object detection, handwriting recognition