倪建功, 李娟, 邓立苗, 韩仲志. 基于知识蒸馏的胡萝卜外观品质等级智能检测[J]. 农业工程学报, 2020, 36(18): 181-187. DOI: 10.11975/j.issn.1002-6819.2020.18.022
    引用本文: 倪建功, 李娟, 邓立苗, 韩仲志. 基于知识蒸馏的胡萝卜外观品质等级智能检测[J]. 农业工程学报, 2020, 36(18): 181-187. DOI: 10.11975/j.issn.1002-6819.2020.18.022
    Ni Jiangong, Li Juan, Deng Limiao, Han Zhongzhi. Intelligent detection of appearance quality of carrot grade using knowledge distillation[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2020, 36(18): 181-187. DOI: 10.11975/j.issn.1002-6819.2020.18.022
    Citation: Ni Jiangong, Li Juan, Deng Limiao, Han Zhongzhi. Intelligent detection of appearance quality of carrot grade using knowledge distillation[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2020, 36(18): 181-187. DOI: 10.11975/j.issn.1002-6819.2020.18.022

    基于知识蒸馏的胡萝卜外观品质等级智能检测

    Intelligent detection of appearance quality of carrot grade using knowledge distillation

    • 摘要: 胡萝卜等级分类是提高胡萝卜市场竞争力的关键环节。传统的胡萝卜外部缺陷检测采用特征提取+分类器模式,需要手工定义特征,客观性差。为了解决上述问题,该研究提出一种基于知识蒸馏的网络模型,通过引入教师模型来指导学生模型的训练,在保证准确率的情况下减少网络模型的参数量和运行时间消耗。该试验采集了外观无缺陷以及黑斑、弯曲、带须根的四类胡萝卜样本图片,将其导入网络模型中进行训练。通过使用Resnet34、Resnet50、Resnet101这3个不同教师模型来指导学生模型Resnet18的训练,蒸馏模型平均准确率从94.3%分别提高到94.8%、95.2%、95.8%,其中Resnet101模型指导的Resnet18模型中正常胡萝卜识别率提高到100%,正常、黑斑、须根识别率提高约2%,模型训练时间为11.3 h。此外,传统Resnet50模型和Resnet101模型对数据集的识别准确率分别是96.3%和96.9%,模型训练时间分别是19.3和31.3 h。试验发现:蒸馏模型识别率大幅优于基于特征提取+分类器的传统模型,且随着教师模型网络深度的增加,模型识别率也进一步提高。从模型训练时间和模型部署上考虑,知识蒸馏是很有必要的,通过牺牲小部分准确率可以大大缩短模型训练时间和降低模型部署成本。该研究所提出的知识蒸馏模型作为一种轻量级前端部署方法,对于改进胡萝卜外观品质自动检测装置的性能具有积极意义。

       

      Abstract: Abstract: Carrot has widely been served in the human diet, due to its rich in nutrients, particularly on carotene and dietary fiber. However, the brown and black spot disease can ruin the appearance and nutritional quality of carrot during the planting. Therefore, the classification of carrot grades has become an essential part, to improve the competitiveness of carrots in the market. Specifically, the detailed grading can greatly contribute to the commercial value of carrots. Traditionally, a feature extraction with classifier mode was generally adopted to detect the carrot appearance, where the manual definition of features was required, leading to time consuming, less accuracy, and erroneous judgement. In this study, a novel network was proposed to solve the problem, based on a lightweight front-end deployment method, the knowledge distillation technique. Teacher and student models were selected, where a teacher model was introduced to guide the training of student model. The model in this network can be used to reduce the number of parameters and running time, while achieve high accuracy. 3 266 high-resolution images of carrot were collected from the sorting machine as the experimental data sets. Four grades were divided, including the normal, curved, black spot and fibrous root, according to the carrot grading standards of Ministry of Agriculture of the People's Republic of China NY/T 1983-2011. 70% of the dataset was randomly divided into the training sets, whereas, the remaining 30% into test sets. The dataset of carrot was first imported into the network model for training. A teacher model was then introduced, when training to induce a student model, where the teacher model was a large-scale and complex network with many participants, whereas, the student model was a small-scale and streamlined network with a small number of parameters. By inducing training, small models can finally achieve high accuracy. Three teacher models were used, including Resnet34, Resnet50, and Resnet101, in order to guide the training of student model of Resnet18. Correspondingly, the average accuracy of distillation model increased from 94.3% to 94.8%, 95.2%, and 95.8%, respectively. The recognition rate of normal carrot was improved to 100%, where the Resnet18 student model was guided by the Resnet101 teacher model. The recognition rate of normal, black spot and fibrous root increased by about 2%, while, the training time of the model was 11.3 h. In addition, the recognition accuracies of Resnet50 and Resnet101 teacher model were 96.3% and 96.9% respectively, whereas, the training time of models can be 19.3 h and 31.3 h, respectively. The experimental results showed that the recognition rate of distillation model was much higher than that of the traditional model based on feature extraction with classifier. The recognition rate of model can further improved as the increase in the depth of teacher model. Knowledge distillation can perform well from the perspective of training time and arrangement in the model. The training time and deployment of model can be greatly shortened with a tradeoff of accuracy. Consequently, the knowledge distillation model can be used to provide a promising significant support to improve the performance of automatic detection device for the appearance quality of carrots.

       

    /

    返回文章
    返回