Machine Vision Application Framework of Desktop Robot Arm

doi:10.3969/j.issn.1006-2475.2019.11.013

Abstract

Abstract: Compared with the traditional industry robot arm, the desktop robot arm has the characteristics of changeable environment and man-machine cooperation, which makes it more important to increase its visual function. At present, there are many application frameworks to realize machine vision. How to build an appropriate software and hardware platform for visual application according to the working environment and nature of the robot arm, so as to improve the accuracy and efficiency of machine vision recognition is the focus of this paper. Based on TensorFlow’s deep learning framework, the embedded system’s software and hardware design, and the application of OpenCV and other image processing software, this paper constructs a machine vision secondary development framework suitable for desktop robot arm, which provides a foundation for the further development of vision-based robot arm applications. Through simulation test and case application of man-machine cooperation, it is shown that the framework has better adaptability and better efficiency.

Key words: machine vision, desktop robot arm, TensorFlow, OpenCV

CLC Number:

TP216+.1

MA Xing-lu， HE Ai-xin， LI Ying-ying . Machine Vision Application Framework of Desktop Robot Arm[J]. Computer and Modernization, 2019, 0(11): 64-.

References

［1］ PAPAGEORGIOU C, OREN M, POGGIO T. A general framework for object detection ［C］// Proceedings of the 6th International Conference on Computer Vision. 1998:555-562.
［2］ LOWE D G. Object recognition from local scale-invariant features［C］// Proceedings of the 7th IEEE International Conference on Computer Vision. 1999,2:1150-1157.
［3］ DALAL N, TRIGGS B. Histograms of oriented gradients for human detection［C］// IEEE Conference on Computer Vision and Pattern Recognition. 2005:886-893.
［4］黄心汉,苏豪,彭刚,等．基于卷积神经网络的目标识别及姿态检测［J］. 华中科技大学学报(自然科学版), 2017,45(10):7-11.
［5］孙军,张家亮,马玲． Dobot机械臂建模仿真与轨迹规划算法研究［J］. 机械与电子, 2016,34(6):72-75.
［6］周小模,刘威. 基于Kinect与Dobot机械臂的人机交互系统［J］. 信息技术, 2017(12):102-104．
［7］徐凯. 基于双目视觉的机械手定位抓取技术的研究［D］. 杭州:浙江大学, 2018.
［8］ BUCICOIU M, GHIDEU M S, RUGHINIS R. Cloud video streaming using Raspberry Pi［C］// 2013 3rd International 〖JP2〗Conference on Social Sciences and Society. 2013:218-223.
［9］〖JP2〗XU G S, CHEN Z, QIAO W. Research of control system for mask projection stereolithography with Raspberry Pi［C］// 2016 International Conference on Applied Mechanics, Mechanical and Materials Engineering. 2016:393-397.
［10］蓝杰,张浩然. 基于STM32的微型步进电机驱动控制器设计［J］. 硬件与结构, 2015,34(1):43-46.
［11］赵丹,谌建飞,周旋,等. 基于MJPG-streamer的嵌入式远程视频监控系统［J］. 单片机与嵌入式系统应用, 2017(4):51-54.
［12］宋蕴,璞陈元. 基于嵌入式Linux及MJPG-streamer的双目立体视觉系统设计［J］. 物联网技术, 2016(3):102-104.
［13］ROSS G, JEFF D, TREVOR D, et al. Rich feature hierarchies for accurate object detection and semantic segmentation［C］// Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition. 2014:580-587．
［14］ROSS G. Fast R-CNN ［C］// Proceedings of IEEE International Conference on Computer Vision. 2015:1440-1448．
［15］ZHAO X, LI W, ZHANG Y, et al. A faster RCNN-based pedestrian dection system ［C］// Proceedings of Vehicular Technology conference. 2017:1-5.
［16］REN S Q, HE K M, ROSS G, et al. Faster R-CNN: Towards real-time object detection with region proposal networks ［J］. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017,39(6):1137-1149．
［17］郭毓,苏鹏飞,吴益飞,等. 基于FasterR-CNN的机器人目标检测及空间定位［J］. 华中科技大学学报(自然科学版), 2018,46(12):55-59.
［18］黄莉芝. 基于深度卷积神经网络的目标检测算法研究［D］. 成都:西南交通大学, 2018.
［19］郭之先. 基于深度卷积神经网络的小目标检测［D］. 南昌:南昌航空大学, 2018.
［20］KRIZHEVSKY A, SUTSKEVER I, HINTON G E． ImageNet classification with deep convolutional neural networks［C］// Proceedings of the 25th International Conference on Neural Information Processing Systems. 2012:1097-1105．
［21］庞博. 智能机械臂视觉系统的目标检测与定位方法研究［D］. 长沙:国防科学技术大学, 2016.
［22］孟凡胜. 摄像机定标中的标定物特征提取和位姿计算方法［D］. 青岛:中国海洋大学, 2013.
［23］唐自翔. 机器视觉中的摄像机定标研究与实现［D］. 成都:电子科技大学, 2013.
［24］杨亮,郭志军,李文生,等. 基于视觉伺服的桌面型机械臂创新实验平台研制［J］. 实验技术与管理, 2018,35(5):92-101.

[1]	LIU Yaoxin1, CHEN Renxi2, YANG Weihong1. A Moving Object Detection Algorithm Aiming at Jittery Drone Videos [J]. Computer and Modernization, 2024, 0(05): 99-103.
[2]	GUO Zhi-dong, LIU Jun, YANG Fan, ZHOU Xin, CHEN Liang-liang. Intelligent Traffic Light Control System Based on Machine Vision [J]. Computer and Modernization, 2023, 0(04): 101-105.
[3]	GE Hong-fei, LI Yi-ran. Visual SLAM Algorithm Based on Adaptive Fusion of Point and Edge Features [J]. Computer and Modernization, 2023, 0(03): 107-112.
[4]	CHEN Zhuo, QIAO Gui-fang, CHAI Xin-bo, DU Yi-jun, SHEN Chong-lin, WANG Yuan-hao. Multi-weather Vehicle Detection Algorithm Based on Modified Knowledge Distillation [J]. Computer and Modernization, 2023, 0(02): 50-57.
[5]	YIN Chu, ZHAO Qi-lin, RUI Ting, YUAN Hui, WANG Jian. Crack Target Detection Algorithm Based on Adaptive Anchor Frame [J]. Computer and Modernization, 2022, 0(11): 95-101.
[6]	REN Chao-dong, ZHANG De-li. Charging Socket Detection Algorithm Based on Region Proposal Net and LBP Feature [J]. Computer and Modernization, 2021, 0(08): 64-69.
[7]	WU Shui-ming, ZHU Yan, WANG Fang, JING Dong-sheng. An Electronic Device Container Quality Detection Method Based on Cascade R-CNN [J]. Computer and Modernization, 2020, 0(11): 33-38.
[8]	LUO Wei, LIANG Shi-hao, JIANG Xin, AN Ni, DU Rui. Crack Recognition of Outcrop Area Based on Deep Learning [J]. Computer and Modernization, 2020, 0(05): 56-.
[9]	CUI Juan-juan1, ZHANG Lei1, HOU Xie-lian2, CHEN Cai-kou2, ZHANG Hai-yan1. A Two-phase Face Recognition Algorithm Based on Discriminative Low-rank Representation [J]. Computer and Modernization, 2019, 0(12): 55-.
[10]	ZHANG Rui-xun1, ZHOU Hong-yu2, LUO Sheng-li2. Congestion Detection Algorithms for Medicine Box Transportation Based on Machine Vision [J]. Computer and Modernization, 2019, 0(10): 94-.
[11]	LI Yu-meng, DUAN Xin-bo， MA Peng-bo. A Rotor Surface Defect Detection Method Based on Point Cloud [J]. Computer and Modernization, 2019, 0(10): 101-.
[12]	Maierziyan Abudula， FENG Xiang-ping. Non-contact Horse Body Measurement Method Based on Machine Vision [J]. Computer and Modernization, 2019, 0(10): 108-.
[13]	JI Chao, HUANG Xin-bo, CAO Wen, ZHU Yong-can, ZHANG Ye. Research on Infrared Insulator Detection Based on Improved Fast-CNN Mode [J]. Computer and Modernization, 2019, 0(04): 59-.
[14]	LIU Qingsong， XIE Xiaofang， CAO Jian， ZHANG Longjie. Performance Evaluation Software of Seekers Image#br# Processing Algorithm Based on OpenCV [J]. Computer and Modernization, 2017, 0(3): 80-.
[15]	WANG Fan1, XING Yanwen2. Machine Vision AGV Indoor Navigation Method Based on Ground Feature Block Matching [J]. Computer and Modernization, 2016, 0(10): 44-48.