王瑞萍, 刘东风, 王先琳, 杨会君. 基于多视图几何的白菜薹分割与关键表型测量[J]. 农业工程学报, 2022, 38(16): 243-251. DOI: 10.11975/j.issn.1002-6819.2022.16.027
    引用本文: 王瑞萍, 刘东风, 王先琳, 杨会君. 基于多视图几何的白菜薹分割与关键表型测量[J]. 农业工程学报, 2022, 38(16): 243-251. DOI: 10.11975/j.issn.1002-6819.2022.16.027
    Wang Ruiping, Liu Dongfeng, Wang Xianlin, Yang Huijun. Segmentation and measurement of key phenotype for Chinese cabbage sprout using multi-view geometry[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2022, 38(16): 243-251. DOI: 10.11975/j.issn.1002-6819.2022.16.027
    Citation: Wang Ruiping, Liu Dongfeng, Wang Xianlin, Yang Huijun. Segmentation and measurement of key phenotype for Chinese cabbage sprout using multi-view geometry[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2022, 38(16): 243-251. DOI: 10.11975/j.issn.1002-6819.2022.16.027

    基于多视图几何的白菜薹分割与关键表型测量

    Segmentation and measurement of key phenotype for Chinese cabbage sprout using multi-view geometry

    • 摘要: 植物表型调查是选育优良品种和基因功能研究的重要依据,为理解植物生长发育规律及环境的作用提供有力支持。针对传统叶菜类植物表型分析方法存在速度慢、误差大、维度限制等问题,该研究提出了一种基于高通量重建和茎叶自动分割的白菜薹关键表型参数提取方法。首先,基于多视图立体几何技术对白菜薹进行多视角RGB图像三维重建、尺度恢复、均匀简化、背景去除及点云去噪等预处理。之后,提出基于超体素的改进植物器官自动分割算法,将植株分为茎、叶片等不同语义类别。在此基础上,给出有效的表型参数计算方法,完成了株高、叶长、颜色等7个关键性状的无损、精确测量。试验结果表明,该研究实现了白菜薹关键表型自动分析,茎叶器官分割的精确率、召回率及F1分数的均值分别为0.961、0.940、0.943;株高、株幅、叶长、叶宽的均方根误差分别为0.261、0.313、0.174、0.100 cm,叶面积及叶片数的均方根误差分别为1.608 cm2和0.283,平均绝对百分比误差分别为1.659%、1.643%、1.417%、2.486%、8.258%、6.000%。与其他方法相比,该研究具有较低的综合误差,可适应叶片形状不规则的植物表型参数提取研究。同时,克服了当前植物冠层幼叶难以分割、表型性状提取效率低等困难,为精准农业领域叶菜表型高效分析提供有效的技术手段,可在进一步的基因型到表型研究中发挥重要作用。

       

      Abstract: Abstract: Plant phenotype has been one of the most important indicators to select and breed superior varieties in modern agriculture. The traditional phenotypic analysis of leafy vegetables cannot fully meet the requirement of large-scale production in recent years, such as the slow speed, large error, and limited dimension. Moreover, most morphological measurements have been currently confined to only several plants (such as maize, cotton and sorghum), particularly with the complex procedure and low automation. Taking the Chinese cabbage sprout as the research object, this study aims to extract the key phenotypic parameters of the plant using the high-throughput reconstruction and automatic segmentation of stem and leaf. Firstly, a multi-view geometry was utilized to reconstruct the three-dimensional model of Chinese cabbage sprout from sequence images. A series of pre-processing operations were used to establish the three-dimensional model of pure plants with the actual scale, including scale recovery, background removal, point cloud denoising, and uniform simplification. Secondly, the stem and leaf organs were automatically segmented using the convexity criterion and random sampling consistency. Thirdly, the principal component analysis and directed bounding box were combined to measure the plant height and width for the phenotypic parameters. The number of leaves was counted by the cluster segmentation of leaf clusters. The shortest path searching was selected to accurately calculate the leaf length and width. A greedy projection triangulation was used to calculate the leaf area. An HSV model and mean color histogram were utilized to measure the color characteristics for distinguishing health status of plants. The classification accuracy, recall, and F1-score were 0.922, 0.938, and 0.930, respectively. Finally, the segmentation experiments were carried out on the six varieties of Chinese cabbage sprouts at different growth stages. A comparison was then made with the ground truth. It was found that the parts belonging to stem and leaf were segmented correctly. The average precision, recall, and F1-score of stem and leaf organ segmentation were 0.961, 0.940 and 0.943 respectively, indicating better performance than the smoothing threshold-based and the color-based region growth. In addition, 50 samples were tested to verify the measurement. A regression analysis was performed between the algorithmic and manual measurements of Chinese cabbage sprout plant traits. The experimental results showed that the determination coefficients of plant height, plant width, leaf length, leaf width, leaf area, and leaf number were 0.987, 0.982, 0.984, 0.985, 0.922, and 0.924, respectively. The mean absolute percentage errors were 1.659%, 1.643%, 1.417%, 2.486%, 8.258%, and 6.000%, respectively. Among them, the Root Mean Square Error (RMSE) of plant height, plant width, leaf length, and leaf width were 0.261, 0.313, 0.174, and 0.100 cm, respectively. The RMSE of leaf area and number were 1.608 cm2, and 0.283, respectively. Consequently, the automatic measurement was realized for the seven key phenotypes of Chinese cabbage sprouts, including the plant height, leaf length, and color in lower error. Therefore, the segmentation and measurement can be expected to extract the plant phenotypic parameters with irregular leaf shape, especially in the young leaves of plant canopy, with high efficiency of phenotype extraction. The finding can provide an effective technical means for the efficient and accurate phenotypic analysis of leafy vegetables.

       

    /

    返回文章
    返回