计算机与现代化 ›› 2023, Vol. 0 ›› Issue (02): 50-57.

• 人工智能 • 上一篇    下一篇

基于改进知识蒸馏的多天候车辆检测方法

  

  1. (1. 南京工程学院自动化学院,江苏 南京211167; 2. 南京工程学院机械工程学院,江苏 南京211167)
  • 出版日期:2023-04-10 发布日期:2023-04-10
  • 作者简介:陈卓(2000—),男,河南驻马店人,本科生,研究方向:机器视觉,E-mail: chenz092@163.com; 乔贵方(1987—),男,江苏新沂人,副教授,博士,研究方向:机器人测试与标定,机器人仿生控制技术,E-mail: qiaoguifang@126.com; 柴鑫波(2000—),男,浙江慈溪人,本科生,研究方向:机器视觉,E-mail: cxb201191106@163.com; 杜一君(1984—),女,河北石家庄人,讲师,博士,研究方向:为模式识别,图像处理,人工智能,E-mail: duyijun@njit.edu.cn; 沈重霖(2000—),男,江苏南通人,本科生,研究方向:机器人智能控制与模式识别; 王远浩(2001—),男,江苏苏州人,本科生,研究方向:为路径规划与模式识别,E-mail: 2391585055@qq.com。
  • 基金资助:
    江苏省自然科学基金青年项目(BK20201043); 江苏省大学生创新创业训练计划项目(202111276077Y)

Multi-weather Vehicle Detection Algorithm Based on Modified Knowledge Distillation

  1. (1. College of Automation, Nanjing Institute of Technology, Nanjing 211167, China;  2.  College of Mechanical Engineering, Nanjing Institute of Technology, Nanjing 211167, China)
  • Online:2023-04-10 Published:2023-04-10

摘要: 为提高多天候下的车辆检测效果,本文提出一种基于改进知识蒸馏方法的卷积网络训练框架。该网络框架利用复杂CNN(Convolutional Neural Network)作为教师网络、轻量CNN作为学生网络,在不增加新训练数据集和略微增加轻量CNN参数量的同时提高轻量CNN多天候下车辆检测的效果。该知识蒸馏方法采用特殊的数据增强方法产生含有多天候特征的数据集,将不含天气特征的原始图片投入教师网络,将对应含有天气特征的增强图片投入学生网络训练。由于不含天气特征的图片能够提供更多的信息,相较于一般知识蒸馏方法,该种训练方式能使学生网络对教师网络的输出信息进行更有效的学习。最终,经过在天气数据增强后的BDD100k数据集上进行训练和多天候车辆检测的性能测试,在本文知识蒸馏卷积网络框架下训练的学生网络模型目标检测的能力和在多天候环境下检测精度的稳定性得到了提高;在DAWN多天候数据集上进行多个网络的泛化能力对比测试表明,本文改进的知识蒸馏卷积网络框架在平均查准率(Average precision,AP)和检测速度上均取得了一定的优势。

关键词: 机器视觉, 深度学习, 知识蒸馏, 卷积神经网络, 目标检测, 数据增强

Abstract: In order to improve the vehicle detection result under multi-weather conditions, a convolutional network based on modified knowledge distillation method was proposed. The network uses cumbersome CNN(Convolutional neural network) as teacher network and lightweight CNN as student network. Without adding new training dataset and slightly increasing the number of light network parameters, the performance of the lightweight CNN under multi-weather vehicle detecting conditions can be improved. The network utilizes a specialized data enhancing method to generate a multi-weather feature dataset. The teacher network is trained on the data without weather feature, and the student network data is trained simultaneously on the data with weather features. Considering that images without weather features can provide more information relatively, through this training method, the student network can better learn the information generated by the teacher network. Finally, through the multi-weather vehicle detecting performance of the network trained and tested on BDD100k dataset with enhanced weather dataset, the detectability and stability of the student model in multi-weather environment boosts. The comparison test of the generalization ability of multiple networks is carried out on DAWN multi-weather dataset, and the modified distillation convolutional network achieves certain advantages in average precision and detection speed.

Key words: machine vision, deep learning, knowledge distillation, convolutional neural network, object detection, data enhancement