Design and experiment of automatic sorting and grading system based on machine vision for white agaricus bisporus

Wang Fengyun; Feng Wenjie; ZhengJiye; Sun Jiabo; Niu Luyan; Chen Zhenxue; ZhangXuetao; Wang Lei

doi:10.11975/j.issn.1002-6819.2018.07.033

Volume 34 Issue 7

Mar. 2018

Turn off MathJax

Article Contents

Abstract

References

Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE) > 2018 > 34(7): 256-263. > DOI: 10.11975/j.issn.1002-6819.2018.07.033

Wang Fengyun, Feng Wenjie, ZhengJiye, Sun Jiabo, Niu Luyan, Chen Zhenxue, ZhangXuetao, Wang Lei. Design and experiment of automatic sorting and grading system based on machine vision for white agaricus bisporus[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2018, 34(7): 256-263. DOI: 10.11975/j.issn.1002-6819.2018.07.033

Citation:

PDF (734 KB)

Design and experiment of automatic sorting and grading system based on machine vision for white agaricus bisporus

1.
S&T Information Institution, Shandong Academy of Agricultural Sciences, Jinan 250100, China
2.
Control Science and Engineering School, Shandong University, Jinan 250061, China

More Information

Received Date: November 01, 2017
Revised Date: January 21, 2018
Published Date: March 31, 2018

Graphical Abstract

Abstract

Abstract

Abstract: White Agaricus bisporus is an excellent source of the B vitamins, riboflavin, niacin, and pantothenic acid and also a good source of the dietary mineral phosphorus. It is one of the most commonly and widely consumed mushrooms in the world. The production of white Agaricus bisporus has been industrialized in China. However, during the last production chain, it needs a lot of labors to sort and grade the white Agaricus bisporus. The manual sorting and grading mode has many disadvantages such as larger error, low productivity, non-uniform standard, and so on. With the development of machine vision technology, it has been successfully used for automatic inspection and sorting, especially in agricultural industry due to its nondestructive characteristic. An automatic sorting and grading system based on machine vision was designed in this paper. Firstly, an automatic sorting and grading hardware system was designed. It included conveying mechanism, image acquiring system, control module and actuator. The conveying mechanism consists of the fixed support, conveyor, roller, driving unit, tension unit, cleaner and guide plate. The image acquiring system consists of a line scan camera, lens, light source and its controller. The control module consists of photoelectric sensor controlling the camera, electromagnetic valve and relay starter controlling the actuator. The actuator consists of the air compressor, duplex pieces, muffler, air cylinder, joints, gas channel, guide rod, slider, connector, flap, baffle, and so on. Secondly, it put forward an image algorithm based on the watershed method, Canny operator, OR operation and closed operation to determine the diameter of white Agaricus bisporus. The first watershed algorithm combining the global threshold segmentation method and maximum entropy threshold segmentation method is used to remove the shadow of image. The second watershed algorithm based on Canny operator, OR operator and closed operation is used to remove the disturbance of petiole. The minimum enclosing rectangle method is used to get the diameter of white button mushroom. Thirdly, a precise control strategy based on the conveyor speed, distance between trigger and flap piece, trigger time and algorithm processing time was designed. Finally, the software based on OpenCV 2.4.10 and Visual Studio 2010 was developed in this paper to acquire, analyze and process the image and output the control instruction to control the valve by USB-4761 module. It also has the visual parameter configuration function for camera, control module and grading standard. When the whole system starts at the first time, the light source of image acquiring system is adjusted by the light controller to make the image clear and stable. The air compressor is powered on and pressurized to the rated pressure of 0.3 MPa. The motor of conveyor is started and the speed of the conveyor belt is adjusted according to the actual production requirement. The white Agaricus bisporus goes into the guide bar with the conveyor belt. When the white Agaricus bisporus goes into the region of image acquiring, it triggers the industrial camera to scan. The image data are transmitted to the industrial computer by image capture card. The software analyzes the image on line. The analyzed result is sent to the related solenoid valve through the digital control module. When the white Agaricus bisporus arrives near the container of related grade, it is sorted into the container by the related flap piece driven by the solenoid valve. In order to validate the applicability and reliability, the test of grading performance and effect was carried out with the prototype of sorting and grading system at 12.7 m/min conveying speed and 1900 Hz line frequency. The results showed that the average maximum grading speed was 102.41 pieces/min, the accuracy of grading was 97.42%, the damage rate was 0.05% and the undetected rate was 0.96%. The grading speed improved by 38.86%, the accuracy improved by 6.84% and the damage rate reduced by 0.13% compared to the manual grading. The system can stably and continuously operate. For long time grading, the advantage of intelligent system is more obvious due to the fatigue of labor. The whole system realizes the on-line automatically sorting and grading for fresh white Agaricus bisporus with the minimum destruction.
- image processing,
- bacteria,
- algorithms,
- agaricus bisporus,
- automatic grading

FullText(HTML)

References (30)

References

[1]	何泽强. 基于机器视觉的工业机器人分拣系统设计[D]. 哈尔滨：哈尔滨工业大学，2016.He Zeqiang. Design of Industrial Robot Sorting System Based on Machine Vision [D]. Harbin: Harbin Institute of Technology, 2016. (in Chinese with English abstract)
[2]	Jyoti Jhawar. Orange Sorting by Applying Pattern Recognition on Colour Image[J]. Procedia Computer Science, 2016, 78: 691－697.
[3]	林欢，许林云. 中国农业机器人发展及应用现状[J]. 浙江农业学报，2015，27(5)：865－871.Lin Huan, Xu Linyun. The development and prospect of agricultural robots in China[J]. Acta Agriculturae Zhejiangensis, 2015, 27(5): 865－871. (in Chinese with English abstract)
[4]	Kondo N. Automation on fruit and vegetable grading system and food traceability [J]. Trends in Food Science & Technology, 2010, 21(3): 145－152．
[5]	高新浩，刘斌. 基于机器视觉的鲜食玉米品质检测分类器设计与试验[J]. 农业工程学报，2016，32(1)：298－303.Gao Xinjie, Liu Bin. Design and experiment of fresh corn quality detection classifier based on machine vision [J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2016, 32(1): 298－303. (in Chinese with English abstract)
[6]	张志强，牛智有，赵思明，等. 基于机器视觉技术的淡水鱼质量分级[J]. 农业工程学报，2011，27(2)：350－354.Zhang Zhiqiang, Niu Zhiyou, Zhao Siming, et al. Weight grading of freshwater fish based on computer vision[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2011, 27(2): 350－354. (in Chinese with English abstract)
[7]	陈青君，魏金康. 双孢蘑菇设施栽培实用技术[M]. 北京：中国农业大学出版社，2015.
[8]	刘战丽，王相友. 双孢蘑菇贮藏品质评价方法及适收期研究[J]. 食品科技，2015，40(6)：42－46.Liu Zhanli, Wang Xiangyou. Quality evaluation and suitable harvest date of mushroom (Agaricus bisporus)[J]. Food Science and Technology, 2015, 40(6): 42－46. (in Chinese with English abstract)
[9]	周竹，黄懿，李小昱，等. 基于机器视觉的马铃薯自动分级方法[J]. 农业工程学报，2012，28(7)：178－183.Zhou Zhu, Huang Yi, Li Xiaoyu, et al. Automatic detecting and grading method of potatoes based on machine vision [J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2012, 28(7): 178－183. (in Chinese with English abstract)
[10]	董春旺，朱宏凯，周小芬，等. 基于机器视觉和工艺参数的针芽形绿茶外形品质评价[J]. 农业机械学报，2017，48(9)：38－45.Dong Chunwang, Zhu Hongkai, Zhou Xiaofen, et al. Quality evaluation for appearance of needle green tea based on machine vision and process parameter[J]. Transactions of the Chinese Society for Agricultural Machinery, 2017, 48(9): 38－45. (in Chinese with English abstract)
[11]	王慧慧，孙永海，张贵林，等. 基于压力和图像的鲜玉米果穗成熟度分级方法[J]. 农业工程学报，2010，26(7)：369－373.Wang Huihui, Sun Yonghai, Zhang Guilin, et al. Grading method of fresh corn ear maturity based on pressure and image[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2010, 26(7): 369－373. (in Chinese with English abstract)
[12]	王红军，熊俊涛，黎邹邹，等. 基于机器视觉图像特征参数的马铃薯质量和形状分级方法[J]. 农业工程学报，2016，32(8)：272－277.Wang Hongjun, Xiong Juntao, Li Zouzou, et al. Potato grading method of weight and shape based on imaging characteristics parameters in machine vision system [J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2016, 32(8): 272－277. (in Chinese with English abstract)
[13]	李明智，张光发，于功志，等. 扇贝苗分级计数装置的设计与试验[J]. 农业工程学报，2015，31(21)：93－101.Li Mingzhi, Zhang Guangfa, Yu Gongzhi, et al. Design and experiment of grading and counting device for scallop seedling[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2015, 31(20): 93－101. (in Chinese with English abstract)
[14]	展慧，李小昱，王为，等. 基于机器视觉的板栗分级检测方法[J]. 农业工程学报，2010，26(4)：327－331.Zhan Hui, Li Xiaoyu, Wang Wei, et al. Determination of chestnuts grading based on machine vision[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 26(4): 327－331. (in Chinese with English abstract)
[15]	王树才，文友先，刘俭英. 基于机器人的禽蛋自动检测与分级系统集成开发[J]. 农业工程学报，2008，(4)：186－189.Wang Shucai, Wen Youxian, Liu Jianying. Integrated development of the system of robot for detecting and grading eggs[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2008, 24(4): 186－189. (in Chinese with English abstract)
[16]	Tillett RD, Batchelor BJ. An algorithm for locating mushrooms in a growing bed [J]. Computers and Electronics in Agriculture, 1991,6(3): 191－200.
[17]	Vooren JG, Polder G, Heijden GWAM. Application of image analysis for variety testing of mushroom[J]. Euphytica, 1991, 57(3): 245－250.
[18]	V??zhányó T, Felf?ldi J. Enhancing colour differences in images of diseased mushrooms[J]. Computers and Electronics in Agriculture, 2000 (26): 187－198.
[19]	Van Loon PCC. Het bepalen van het ontwikkelingsstadium bij de champignon met computer beeldanalyse.[J]. Champignoncultuur, 1996, 40(9): 347－353.
[20]	Chen Ho-Hsien, Ting Ching-Hua. The development of a machine vision system for shiitake grading [J]. Journal of Food Quality, 2004, 27(5): 352－365.
[21]	葛亮. 香菇实时分级生产线的研究[D]. 武汉：华中农业大学，2012.Ge Liang. The Research of The Real Time Grading Line of Mushrooms[D]. Wuhan: Huazhong Agricultural University, 2012. (in Chinese with English abstract)
[22]	NY/T 1790-2009，双孢蘑菇等级规格 [S].NY/T 1790-2009, Grades and specification of Agaricus bisporus.
[23]	陈艳军，张俊雄，李伟，等. 基于机器视觉的苹果最大横切面直径分级方法[J]. 农业工程学报，2012，28(2)：284－288.ChenYanjun, Zhang Junxiong, Li Wei, et al. Grading method of apple by maximum cross-sectional diameter based on computer vision[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2012, 28(2): 284－288. (in Chinese with English abstract)
[24]	杜建军，郭新宇，王传宇，等. 基于分级阈值和多级筛分的玉米果穗穗粒分割方法[J]. 农业工程学报，2015，31(15)：140－146.Du Jianjun, GuoXinyu, Wang Chuanyu, et al. Segmentation method for kernels of corn ear based on hierarchical threshold and multi-level screening[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2015, 31(15): 140－146. (in Chinese with English abstract)
[25]	C Durastanti. Adaptive global thresholding on the sphere [J]. Journal of Multivariate Analysis, 2016, 151: 110－132.
[26]	师韵，王震，王旭启，等. 基于改进遗传算法的最大熵作物病害叶片图像分割算法[J]. 江苏农业科学，2015，43(9)：453－455.Shi Yun, Wang Zhen, Wang Xuqi, et al. Texture image segmentation method with crop disease based on genetic algorithm and maximum entropy[J] Jiangsu Agricultural Sciences, 2015, 43(9): 453－455. (in Chinese with English abstract)
[27]	夏华. 基于自然路标的室内机器人双目视觉定位系统的研究[D]. 长春：吉林大学，2017.Xia Hua. Research on Binocular Vision Localization System for Indoor Robot Based on Natural Landmarks[D]. Changchun: Jilin University, 2017. (in Chinese with English abstract)
[28]	拓小明，李云红，刘旭，等. 基于Canny算子与阈值分割的边缘检测算法[J]. 西安工程大学学报，2014，28(6)：745－749.Tuo Xiaoming, Li Yunhong, Liu Xu, et al. The edge detection algorithm based on Canny operator and threshold segmentation[J]. Journal of Xi'an Polytechnic University, 2014, 28(6):745－749. (in Chinese with English abstract)
[29]	李恺，杨艳丽，刘凯，等. 基于机器视觉的红掌检测分级方法[J]. 农业工程学报，2013，29(24)：196－203.Li Kai, Yang Yanli, Liu Kai, et al. Determination and grading of Anthuriumbased on machine vision[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2013, 29(24): 196－203. (in Chinese with English abstract)
[30]	杨意，初麒，杨艳丽，等. 基于机器视觉的白掌组培苗在线分级方法[J]. 农业工程学报，2016，32(8)：33－40.Yang Yi, Chu Qi, Yang Yanli, et al. Online grading method for tissue culture seedlings of Spathiphyllum floribundum based on machine vision[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2016, 32(8): 33－40. (in Chinese with English abstract)

[1]	Cao Dongjie, Wang Xiangyou, Wang Juan. Respiration rate model of Agaricus bisporus based on enzyme kinetics equation under controlled atmosphere storage[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2016, 32(4): 284-289. DOI: 10.11975/j.issn.1002-6819.2016.04.040
[2]	Li Jing, Li Shunfeng, Wang Anjian, Chen Jin, Tian Guangrui. Appropriate water blanching treatment to keep quality and color of Agaricus bisporus slices[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2014, 30(7): 268-273. DOI: 10.3969/j.issn.1002-6819.2014.07.032
[3]	Li Xiaolong, Ma Zhanhong, Sun Zhenyu, Wang Haiguang. Automatic counting for trapped urediospores of Puccinia striiformis f. sp. tritici based on image processing[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2013, 29(2): 199-206.
[4]	Zhou Zhu, Huang Yi, Li Xiaoyu, Wen Dongdong, Wang Chenglong, Tao Hailong. Automatic detecting and grading method of potatoes based on machine vision[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2012, 28(7): 178-183.
[5]	Gao Yun, Li Xiaoyu, Chen Hong, Wang Wei, Liang Xiuying, Huang Hanying. Automatic control system for grading pipeline of dyeing bamboo sticks[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2009, 25(9): 188-191.
[6]	Lin Qixun, Xie Wenjun, Wang Zejin, Tong Jinhua. Optimization of the technology for controlled atmosphere drying of Agaricus bisporus segments[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2006, 22(4): 186-189.
[7]	Wang Xiangyou, Shi Qilong, Wang Juan, Zhu Jiying, Zhao Ya. Color protection and freshness-keeping technology of Agaricus bisporus during modified atmosphere storage[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2004, 20(6): 205-208.
[8]	Zhou Zengchan, Zhang Xiaowen, Wu Jianhong, Zhou Weiguang. Development of automated grading system for cucumbers[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2003, 19(5): 118-121.
[9]	Han Liqun, He Wei, Duan Zhengang, Su Weijun, Shi Qinxia. Intelligent Technologies in Automatic Grading of Flue-Cured Tobacco[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2002, 18(6): 173-175.
[10]	Xu Juan, Wang Maohua. Application of Morphological Image Processing inStem Location and Edge Detection of Apple Automatic Grading[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 1999, 15(2): 177-180.

Cited By

Cited by

Periodical cited type(12)

1.	王小炜，王会强，张勇，李文翔，孙玉林，孙广军. 单垄洋葱联合收获机设计与试验. 中国农机化学报. 2025(01): 44-51+60 .
2.	杨然兵，张建，尚书旗，田光博，翟宇鸣，潘志国. 甘薯联合收获机二级输送分离装置的设计与试验. 吉林大学学报(工学版). 2024(09): 2708-2722 .
3.	鲍国丞，王公仆，胡良龙，杨薇，申海洋，徐效伟，吴稳，陈文明，殷梓城. 甘薯联合收获机高度自适应集薯装置设计与优化. 农业工程学报. 2023(02): 24-33 . 本站查看
4.	王法安，曹钦洲，李彦彬，庞有伦，解开婷，张兆国. 丘陵山区自走式马铃薯联合收获机设计与通过性试验. 农业机械学报. 2023(S2): 10-19 .
5.	汪昕，杨德秋，刘萌萌，李洋，陈新予，程子文. 自走式马铃薯捡拾机捡拾装置参数优化与试验. 农业机械学报. 2023(S2): 20-29 .
6.	李涛，魏训成，姜伟，李娜，张华，周进. 甘薯秧蔓收获特性试验装置研究. 农业机械学报. 2022(S1): 166-175 .
7.	史宇亮，陈新予，陈明东，王东伟，尚书旗. 甘薯起垄整形机犁铧式开沟起垄装置设计与试验. 农业机械学报. 2022(10): 16-25 .
8.	万里鹏程，李永磊，黄金秋，宋建农，董向前，王继承. 根茎类作物单摆铲栅收获装置驱动转矩特性研究. 农业机械学报. 2022(S1): 191-200+339 .
9.	王相友，吕丹阳，任加意，张蒙，孟鹏祥，李学强. 装袋型马铃薯联合收获机清选装置研制. 农业工程学报. 2022(S1): 8-17 . 本站查看
10.	武涛，吴合槟，刘庆庭，梁小玲，樊秋菊. 基于EDEM的甘蔗田间运输车输送装置性能研究. 中国农机化学报. 2021(07): 107-114 .
11.	张兆国，李彦彬，王海翼，张振东，刘贤存. 马铃薯机械化收获关键技术与装备研究进展. 云南农业大学学报(自然科学). 2021(06): 1092-1103 .
12.	李彦彬，张兆国，王圆明，王海翼，庞有伦，张振东. 马铃薯收获机多级输送分离装置设计与试验. 沈阳农业大学学报. 2021(06): 758-768 .