Application of Improved YOLOv7 Algorithm in Detection of Capping Defects of Vials

doi:10.3969/j.issn.1006-2475.2023.12.014

Abstract

Abstract: Abstract: Aiming at the problem of missing inspection caused by small target defects and unclear features in the defect detection of the capping of penicillin bottles， this paper proposes a defect detection method based on the improved YOLOv7 algorithm. First， the defect images of the capping of penicillin bottles are collected in the real industrial environment， including four common defects: scratches， missing cap， concave-crack， and composite defect， and the data are enhanced to construct a data set with 3220 images of penicillin bottle capping defects. Then CBAM （convolution block attention module） and ASFF （adaptive spatial feature fusion） adaptive feature fusion modules are introduced on the basis of the original YOLOv7 in order to improve the ability of network to extract features， improve the detection accuracy of small target defects， and reduce the missed detection rate of penicillin bottle capping defects. The experimental results show that the average detection accuracy （mAP） of the improved algorithm reaches 99.3%， which is 1.9 percentage points higher than that before the improvement. The improved algorithm provides a new idea for the detection of capping defects of penicillin bottles in industry， and has good application prospect.

Key words: Key words: vials, defect detection, YOLOv7, attention module, adaptive feature fusion

CLC Number:

TP391

NING Juan, ZHOU Qing-hua, ZENG Xiao-wei. Application of Improved YOLOv7 Algorithm in Detection of Capping Defects of Vials[J]. Computer and Modernization, 2023, 0(12): 82-86.

References

［1］王朝轩，费树岷. 基于瓶体定位的西林瓶缺陷检测方法研究［J］. 电子测试， 2021（9）:95-97.
［2］罗婧舒，杨伟，梁海孝，等. 提高西林瓶分装联动线生产中轧盖产品合格率的方法［J］. 化工设计通讯， 2021，47（8）:145-146.
［3］ SABET M. 药品生产质量管理规范（GMP）的演变［J］. 流程工业， 2013（22）:16-20.
［4］李莉娜. 西林瓶真空包装的密封完整性检查［J］. 化工设计通讯， 2018，44（8）:193.
［5］韩素华，张闯闯. 基于机器视觉的表面缺陷检测实验系统设计［J］. 实验室研究与探索， 2022，41（7）:247-252.
［6］王耀南，刘学兵，张辉，等. 机器视觉技术在包装行业研究进展与应用综述［J］. 包装学报， 2022，14（2）:1-14.
［7］ JIAN C X， GAO J， AO Y H. Automatic surface defect detection for mobile phone screen glass based on machine vision［J］. Applied Soft Computing， 2017，52:348-358.
［8］李玉，汤勃，孙伟，等. 基于改进Faster R-CNN的钢板表面缺陷检测［J］. 组合机床与自动化加工术， 2022（5）:113-115.
［9］刘群坡，方源，张建军，等. 基于特征融合SSD的微电连接器缺陷检测［J］. 华中科技大学学报（自然科学版）， 2022，50（3）:49-54.
［10］沈希忠，吴迪. 基于YOLO的铝型材料表面小缺陷检测［J］. 浙江工业大学学报， 2022，50（4）:372-380.
［11］ WANG C Y， BOCHKOVSKIY A， LIAO H Y M. YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors［J］. arXiv preprint arXiv:2207.02696， 2022.
［12］刘璎瑛，曹晅，郭彬彬，等. 基于改进YOLO v5复杂场景下肉鹅姿态的检测算法研究［J/OL］. 南京农业大学学报， 2022:1-12［2022-09-22］. DOI: 10.7685/jnau.202205016.
［13］戚玲珑，高建瓴. 基于改进YOLOv7的小目标检测［J］. 计算机工程， 2023，49（1）:41-48.
［14］王琦. 基于整体结构相似的红外和可见光图像匹配方法研究［D］. 大连:大连理工大学， 2020.
［15］冯超. 基于全角度扫描光源的低适光性表面缺陷视觉检测研究［D］. 无锡:江南大学， 2021.
［16］ GILBLAS R， SENTENAC T， ORTEU J J， et al. Detection of micro-cracks on highly specular reflectors: Dimensioning a vision machine based on optical properties［J］. IEEE Sensors Journal， 2017，17（23）:7901-7907.
［17］张铮，徐超，任淑霞，等. 数字图像处理与机器视觉［M］. 北京:人民邮电出版社， 2014.
［18］吴克伟，杨学志，谢昭. 面向区域的非均匀光照估计方法［J］. 光学学报， 2016，36（2）:320-328.
［19］张修懿，陈长兴，杜娟，等. 辅助驾驶的车辆与行人检测模型YOLO-DNF［J/OL］. 计算机工程与应用， 2022:1-15［2022-09-22］. DOI: 10.3778/j.issn.1002-8331.2204-0505.
［20］朱晓慧，钱丽萍，傅伟. 图像数据增强技术研究综述［J］. 软件导刊， 2021，20（5）:230-236.
［21］曾广淼，俞万能，王荣杰，等. 船舶目标重叠下马赛克图像数据增强方法研究［J］. 控制理论与应用， 2022，39（6）:1139-1148.
［22］ BOCHKOVSKIY A， WANG C Y， LIAO H Y M. YOLOv4: Optimal speed and accuracy of object detection［J］. arXiv preprint arXiv:2004.10934， 2020.
［23］茅智慧，朱佳利，吴鑫，等. 基于YOLO的自动驾驶目标检测研究综述［J］. 计算机工程与应用， 2022，58（15）:68-77.
［24］邵延华，张铎，楚红雨，等. 基于深度学习的YOLO目标检测综述［J］. 电子与信息学报， 2022，44（10）:3697-3708.
［25］ WOO S， PARK J， LEE J Y， et al. CBAM: Convolutional block attention module［C］// Proceedings of the 2018 European Conference on Computer Vision （ECCV）. 2018:3-19.
［26］ HU J， SHEN L， SUN G. Squeeze-and-excitation networks［C］// Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition （CVPR）. 2018:7132-7141.
［27］ WANG Q L， WU B G， ZHU P F， et al. ECA-Net: Efficient channel attention for deep convolutional neural networks［C］// Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition （CVPR）. 2020:11531-11539.
［28］巢斌. 基于人体关键点检测的起跑动作矫正系统的研究与实现［D］. 昆明:云南师范大学， 2022.
［29］肖粲俊，潘睿志，李超，等. 基于改进YOLOv5s绝缘子缺陷检测技术研究［J/OL］. 电子测量技术， 2022:1-7［2022-09-22］. DOI: 10.19651/j.cnki.emt.2210050.
［30］ LIU S T， HUANG D， WANG Y H. Learning spatial fusion for single-shot object detection［J］. arXiv preprint arXiv:1911.09516， 2019.

[1]	ZHANG Simin, LIU Xinmei, YIN Junling, LI Baoling. PCB Defect Detection Method Based on Improved YOLOv7 [J]. Computer and Modernization, 2024, 0(12): 45-52.
[2]	DONG Yuwen. Multi-scale Moving Object Detection Algorithm Based on Improved YOLOv7-tiny [J]. Computer and Modernization, 2024, 0(11): 99-105.
[3]	ZHANG Ze1, ZHANG Jianquan2, 3, ZHOU Guopeng2, 3. Camera Module Defect Detection Based on Improved YOLOv8s [J]. Computer and Modernization, 2024, 0(09): 107-113.
[4]	YU Chenxi, GU Lin. Recognition and Warning of Elevator Abnormal Behavior Based on Human Skeleton [J]. Computer and Modernization, 2024, 0(09): 114-120.
[5]	YUE Youjun1, 2, ZHANG Yuankun1, ZHAO Hui1, 2, WANG Hongjun1, 2. Indoor Scene Recognition Method Based on Multi-scale Feature and Attention Module [J]. Computer and Modernization, 2024, 0(08): 37-42.
[6]	ZHOU Yong-qin, WANG Yong, WANG Ying. Lightweight PCB Defect Detection Method Based on Multi-scale Features and Attention Mechanism [J]. Computer and Modernization, 2024, 0(02): 88-92.
[7]	ZHOU Cheng-cheng, ZENG Qing-jun, YANG Kang, HU Jia-ming, HAN Chun-wei. EEG Recognition of Motor Imagination Based on Efficiency Channel Attention Module [J]. Computer and Modernization, 2023, 0(12): 19-23.
[8]	YAN Zi-xian, DONG Bao-liang, TANG Si-mi. Improved YOLOv7 Algorithm for Low-resolution Ship Object Detection in Complex Backgrounds#br# [J]. Computer and Modernization, 2023, 0(11): 120-126.
[9]	ZHANG Jia-Qi, XU Qi-lei. Apple Defect Detection Algorithm Based on NAM-YOLO Network [J]. Computer and Modernization, 2023, 0(10): 53-58.
[10]	LIU Chan-yi, HUANG Dan, XUE Lin-yan, WANG Tao, ZHU Tao, . COVID-19 X-ray Classification Based on Improved Efficientnet Network [J]. Computer and Modernization, 2023, 0(09): 94-99.
[11]	LUO Wei, LIU Si-yuan, XU Jian-xiang, DONG Tian-pei. Improved Solar Cell Defect Detection Algorithm Based on YOLOv5s [J]. Computer and Modernization, 2023, 0(07): 119-126.
[12]	YE Li-ming, CHEN Wei-wen. A Cascaded Insulator Defect Detection Model Combining Semantic Segmentation and Object Detection [J]. Computer and Modernization, 2023, 0(06): 82-88.
[13]	ZHU Jian-bo, GE Ming-feng, DONG Wen-fei. Alzheimer’s Disease Image Classification Based on Improved EfficientNet [J]. Computer and Modernization, 2023, 0(06): 56-61.
[14]	REN Qiu-lin, REN De-jun, LI Xin, YAN Zong-yi, CAO Lin-jie, TANG Hong. Medical Glass Bottle Mouth Defect Detection Method Based on Convolutional Autoencoder [J]. Computer and Modernization, 2022, 0(08): 114-120.
[15]	YIN Yuan-qi, XU Yuan, XING Yuan-xin. Vehicle Target Detection Algorithm Based on YOLO v4 [J]. Computer and Modernization, 2022, 0(07): 8-14.