• EI
    • CSA
    • CABI
    • 卓越期刊
    • CA
    • Scopus
    • CSCD
    • 核心期刊

高湿高雾环境下红茶发酵图像实时采集系统研制

雷攀登, 周汉琛, 田娟, 刘亚芹, 王辉, 杨霁虹, 黄建琴

雷攀登, 周汉琛, 田娟, 刘亚芹, 王辉, 杨霁虹, 黄建琴. 高湿高雾环境下红茶发酵图像实时采集系统研制[J]. 农业工程学报, 2022, 38(12): 207-215. DOI: 10.11975/j.issn.1002-6819.2022.12.024
引用本文: 雷攀登, 周汉琛, 田娟, 刘亚芹, 王辉, 杨霁虹, 黄建琴. 高湿高雾环境下红茶发酵图像实时采集系统研制[J]. 农业工程学报, 2022, 38(12): 207-215. DOI: 10.11975/j.issn.1002-6819.2022.12.024
Lei Pandeng, Zhou Hanchen, Tian Juan, Liu Yaqin, Wang Hui, Yang Jihong, Huang Jianqin. Real-time image acquisition system for black tea fermentation under high humidity conditions[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2022, 38(12): 207-215. DOI: 10.11975/j.issn.1002-6819.2022.12.024
Citation: Lei Pandeng, Zhou Hanchen, Tian Juan, Liu Yaqin, Wang Hui, Yang Jihong, Huang Jianqin. Real-time image acquisition system for black tea fermentation under high humidity conditions[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2022, 38(12): 207-215. DOI: 10.11975/j.issn.1002-6819.2022.12.024

高湿高雾环境下红茶发酵图像实时采集系统研制

基金项目: 安徽省重点研究和开发计划项目(201904a06020034);安徽省科技重大专项(202003a06020019);国家现代农业产业技术体系建设专项(CARS-19)。

Real-time image acquisition system for black tea fermentation under high humidity conditions

  • 摘要: 为解决高湿高雾的红茶发酵场景下,无法实时采集图像的问题,该研究基于加热除雾防潮装置与工业相机系统,设计了高湿高雾环境下红茶发酵叶图像实时采集系统。系统主要由工业相机、镜头、加热除雾防潮装置、面光源、固定支架、控制软件与电脑组成。利用该系统采集单芽、叶片、茎、一芽二叶的发酵进程图像,通过图像处理技术,可以有效提取发酵叶的颜色特征信息;利用茶叶感官审评、发酵叶色泽与气味变化的方法,将采集的1 564张图像分为发酵轻、偏轻、适度、过度4个带有红茶品质标签的数据集,数据集按照7∶3的比例划分为训练集和测试集,训练集通过MobileNetV3 + Vision Transformer技术搭建深度学习模型,模型预测准确率达到95.68%;开发的可视化红茶发酵程度判别软件,可以实现红茶发酵程度有效预测与结果输出。研究结果表明,设计的图像实时采集系统可为红茶发酵程度智能化判别装备研发提供数据基础和技术支持。
    Abstract: Abstract: Fermentation is one of the key steps for the flavor in black tea processing. However, the traditional evaluation of fermentation grade can often be time-consuming, labor-intensive, and inaccurate at present, depending on the subjective sensory for the color observing and the flavor smelling. Since the change of color dominates the fermentation degree, machine vision can be expected to accurately and timely detect the optimum condition of fermentation in black tea processing. Nevertheless, the real-time image acquisition is still lacking so far, due mainly to the high humidity of processing workshop during tea fermentation. Herein, a real-time image acquisition system was designed for the black tea fermentation under the high humidity conditions. The high-efficient system consisted of an industrial camera, lens, defogging and moisture-proof device, surface light source, fixed bracket, vision software platform, and industrial computer. Specifically, a heating and mist elimination device was used as an upper and lower detachable aluminum alloy shell (length × width × height, 120 × 65 × 68 mm) and two end caps. Among them, three components were soldered, including an opening (50 × 45 mm) in the center of one end cover of the shell, the electrode strip resistance (9-10 Ω), and the wires. The high-temperature resistant insulating transparent glue was used to fix the electrodes on the short side of the ITO coated glass (length × width × height, 55 × 50 ×1.1 mm), where the glass surface resistance with the electrode strip was about 10 Ω. As such, a heating and defogging device was formed to fix the glass on the end cover of the central window. The 12.4 MP color CMOS vision system was equipped with the industrial cameras and the gigabit ethernet interface for 1Gbps bandwidth. The cameras were synchronized with the hardware and software triggers. C mount type was selected to connect the low-distortion 8 mm and 6 MP lens for the machine vision cameras. The specific procedure was as follows. The industrial camera was firstly fixed on one L-shaped bracket, and another was on the sidewall of the aluminum alloy shell by two screws, where the two brackets were interlocked, and the lens was 23 mm away from the ITO coated glass. Three outlet holes with the diameters of 20, 15, and 15 mm were opened on the other end cover, which was used for the outlet of the camera net cable, power cable, and heating power cable, respectively. The outlet and screw fastening positions were then sealed with the high-temperature resistant insulating transparent adhesive. The image acquisition device was fixed for the surface light source on the machine vision bracket. The curtains of the tea fermentation room were drawn to prevent the change of sunlight intensity, then the power of all devices was turned on to adjust the voltage of 6-6.5V in the heating and defogging device. The vision software platform was run for the white balance of the camera once, and then turned off the automatic exposure mode to select the image saving format and continuous trigger for the acquisition mode and the image acquisition interval. The camera was mounted over the surface of the tea, and then manually focused at a distance of about 145 mm. The results demonstrated that the machine vision system was efficient to capture the change of color of tea shoots, leaves, buds, and stem during tea fermentation. 1564 fermentation leaves images were selected to combine with the sensory evaluation and the variations in the color and smell of fermentation leaves. Four datasets were classified with the quality labels: light-, semi-, well-, and over- fermented. The datasets was then divided into the training set and test set, according to the ratio of 7:3. The training set was used to establish the deep learning model by the MobileNetV3 and Vision Transformer. The test set was used to evaluate the classification performance of the model, where the average prediction accuracy reached up to 95.68%. More importantly, a visualization software was also conducted to predict the fermentation grade of black tea using the deep learning. Consequently, the image acquisition system can be expected to acquire the real-time images of fermented leaves under the high humidity and fog environment. The finding can also provide a strong reference for the fermentation evaluation during black tea processing.
  • [1] 安徽农业大学. 制茶学(第3版)[M]. 北京:中国农业出版社,2016.
    [2] 钟兴刚,黄怀生,黎娜,等. 不同萎凋和发酵处理对"汝城白毛茶"加工红茶品质的影响[J]. 食品与发酵工业,2022,48(4):137-144.Zhong Xinggang, Huang Huaisheng, Li Na, et al. Effect of withering and fermentation technology on the quality of "Rucheng Baimaocha" processed black tea[J]. Food and Fermentation Industries, 2022, 48(4): 137-144. (in Chinese with English abstract)
    [3] 潘科,沈强,申东,等. 红茶通氧发酵过程中发酵叶相变化分析[J]. 食品科学,2014,35(15):198-201.Pan Ke, Shen Qiang, Shen Dong, et al. Changes in sensory and physico-chemical characteristics of tea leaves during Aerobic Fermentation for Black Tea[J]. Food Science, 2014, 35(15): 198-201. (in Chinese with English abstract)
    [4] 滑金杰,袁海波,姚月凤. 等. 温度对茶发酵叶色泽及茶色素含量的影响[J]. 农业工程学报,2018,34(12):300-308.Hua Jinjie, Yuan Haibo, Yao Yuefeng, et al. Effect of temperature on color and tea pigment content of fermented tea leaves[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2018, 34(12): 300-308. (in Chinese with English abstract)
    [5] 钱园凤. 工夫红茶发酵适度判定方法研究[D]. 北京:中国农业科学院,2013.Qian Yuanfeng. Research on the Determination Method of the Appropriate Fermentation of Kungfu Black Tea[D]. Beijing: Chinese Academy of Agriculture Science, 2013. (in Chinese with English abstract)
    [6] 刘晓东,刘玉芳,甘春萍,等. 工夫红茶发酵过程中发酵叶茶汤吸光值变化的研究[J]. 茶叶科学,2011,31(4):300-304.Liu Xiaodong, Liu Yufang, Gan Chunping, et al. Research on tea liquor variation in terms of light absorption value during black tea fermentation process[J]. Journal of Tea Science, 2011, 31(4): 300-304. (in Chinese with English abstract)
    [7] 刘玉芳. 工夫红茶发酵适度检测方法的研究[J]. 中国农学通报,2011,27(4):345-349.Liu Yufang. Study on the detecting method of optimum fermentation of Kungfu black[J]. Chinese Agricultural Science Bulletin, 2011, 27(4): 345-349. (in Chinese with English abstract)
    [8] Jin G, Wang Y J, Li L Q, et al. Intelligent evaluation of black tea fermentation degree by FT-NIR and computer vision based on data fusion strategy[J]. LWT-Food Science and Technology, 2020, 125: 109216.
    [9] Wang Y J, Li L Q, Liu Y, et al. Enhanced quality monitoring during black tea processing by the fusion of NIRS and computer vision[J]. Journal of Food Engineering, 2021, 304: 110599.
    [10] Bhattacharyya N, Seth S, Tudu B, et al. Detection of optimum fermentation time for black tea manufacturing using electronic nose[J]. Sensors and Actuators B: Chemical, 2007, 122(2): 627-634.
    [11] Bhattacharyya N, Seth S, Tudu B, et al. Monitoring of black tea fermentation process using electronic nose[J]. Journal of Food Engineering, 2007, 80(4): 1146-1156.
    [12] 陈琳,叶阳,董春旺,等. 基于嗅觉可视化技术的工夫红茶发酵程度判定方法[J]. 茶叶科学,2017,37(3):258-265.Chen Lin, Ye Yang, Dong Chunwang, et al. Monitoring black tea fermentation using a colorimetric sensor array-based artificial olfaction system[J]. Journal of Tea Science, 2017, 37(3): 258-265. (in Chinese with English abstract)
    [13] Borah S, Bhuyan M. Non-destructive testing of tea fermentation using image processing[J]. Insight-Non-Destructive Testing and Condition Monitoring, 2003, 45(1): 55-58.
    [14] Borah S, Bhuyan M. A computer based system for matching colours during the monitoring of tea fermentation[J]. International Journal of Food Science & Technology, 2005, 40(6): 675-682.
    [15] 杨龙. 利用计算机视觉技术控制红茶发酵的方法研究[D]. 武汉:华中农业大学,2013.Yang Long. Study on the Method of Computer Vision Technology Using for Controlling Fermentation of Black Tea[D]. Wuhan: Huazhong Agricultural University, 2013. (in Chinese with English abstract)
    [16] 李莎莎,洪文娟,陈华才,等. R/G/B直方图对比算法判别红茶发酵适度[J]. 中国计量学院学报,2016,27(2):172-176.Li Shasha, Hong Wenjuan, Chen Huacai, et al. Black tea fermentation degree monitoring with histogram comparison algorithm[J]. Journal of China University of Metrology, 2016, 27(2): 172-176. (in Chinese with English abstract)
    [17] 张彬. 基于光学传感器技术的红茶通氧发酵过程在线监测研究[D]. 镇江:江苏大学,2017.Zhang Bin. On Line Monitoring the Aerobic Fermentation Process of Black Tea Based on Optical Sensor Technology[D]. Zhenjiang: Jiangsu University, 2017. (in Chinese with English abstract).
    [18] 王凡,赵春江,徐波,等. 便携式茶鲜叶品质光谱检测装置研制[J]. 农业工程学报,2020,36(24):273-279.Wang Fan, Zhao Chunjiang, Xu Bo, et al. Development of a portable detection device for the quality of fresh tea leaves using spectral technology[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2020, 36(24): 273-279. (in Chinese with English abstract)
    [19] 杨崇山,董春旺,江用文,等. 基于高光谱的工夫红茶发酵品质程度判别方法(英文)[J]. 光谱学与光谱分析,2021,41(4):1320-1328.Yang Chongshan, Dong Chunwang, Jiang, Yongwen, et al. A method for judging the fermentation quality of Congou based on hyperspectral[J]. Spectroscopy and Spectral Analysis, 2021, 41(4): 1320-1328. (in Chinese with English abstract)
    [20] 全国茶叶标准化技术委员会.茶叶感官审评方法:GB/T23776-2018[S]. 北京:中国标准出版社,2018.Zhejiang University, Hangzhou tea research institute of China Coop, Tea research institute of Chinese academy of agricultural sciences, et al. GB/T23776-2018, Methodology for sensory evaluation of tea[S]. Beijing: Standards Press of China, 2018.
    [21] 韩巧玲,柏浩,赵玥,等. 采用染色示踪技术的土壤优先流自动分割与量化系统[J]. 农业工程学报,2021,37(6):127-134.Han Qiaoling, Bai Hao, Zhao Yue, et al. Automatic segmentation and quantitative analysis of soil preferential flowusing dye tracer technology[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2021, 37(6): 127-134. (in Chinese with English abstract)
    [22] Howard A, Sandler M, Chen B, et al. Searching for MobileNetV3[C]//2019 IEEE/CVF International Conference on Computer Vision, IEEE, 2020.
    [23] Dosovitskiy A, Beyer L, Kolesnikov A, et al. An image is worth 16x16 words: Transformers for Image Recognition at Scale[C]//9th International Conference on Learning Representations, 2021.
    [24] Chen Y, Dai X, Chen D, et al. Mobile-Former: Bridging MobileNet and Transformer[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021.
  • 期刊类型引用(9)

    1. 崔玉祥,康力峰,郭玮,杨志林. 玉米精密播种机漏播监测器研制与试验. 农业工程. 2024(03): 85-90 . 百度学术
    2. 张甜,蒋乐,李兆东,谢瑞,王韦韦,陈永新. 光纤计数式油菜精量排种器种子流检测系统研究. 农业机械学报. 2023(01): 64-74+145 . 百度学术
    3. 张甜,夏海威,牛冠宸,石文兵,孙善朋,王龙宝. 光电感应式油菜种子流监测装置设计与试验. 安徽农业大学学报. 2022(02): 322-328 . 百度学术
    4. 姜萌,刘彩玲,都鑫,李方林,周智智. 基于光量阻挡原理的颗粒化肥流量检测方法. 农业机械学报. 2022(S2): 91-99 . 百度学术
    5. 徐春保 ,刘靖怡 ,苏清茂 ,靳伟 ,王登辉 ,王万超 ,丁幼春 . 薄面光折射式小麦种子流多通道并行检测装置设计与试验. 农业工程学报. 2022(18): 81-91 . 本站查看
    6. 徐洛川,胡斌,罗昕,任玲,郭孟宇,毛自斌,蔡一全,王健. 叉指电容式棉花穴播取种状态监测系统研制. 农业工程学报. 2022(23): 50-60 . 本站查看
    7. 丁幼春,王凯阳,刘晓东,刘伟鹏,陈礼源,刘温伯,杜超群. 中小粒径种子播种检测技术研究进展. 农业工程学报. 2021(08): 30-41 . 本站查看
    8. 丁幼春,刘伟鹏,董万静,陈礼源,刘晓东,靳伟. 基于排种频率实时反馈的油菜排种器设计与试验. 农业机械学报. 2021(06): 73-82+116 . 百度学术
    9. 丁幼春,陈礼源,王登辉,刘晓东,徐春保,王凯阳. 油菜播种质量监测系统设计与试验. 华南农业大学学报. 2021(06): 43-51 . 百度学术

    其他类型引用(14)

计量
  • 文章访问数:  221
  • HTML全文浏览量:  7
  • PDF下载量:  238
  • 被引次数: 23
出版历程
  • 收稿日期:  2022-03-17
  • 修回日期:  2022-06-06
  • 发布日期:  2022-06-29

目录

    /

    返回文章
    返回