农业机器人导航中两类纹理边缘的快速跟踪与透视变换

    Fast boundary tracking and projective transformation of cut-uncut surfaces for agricultural robot navigation

    • 摘要: 野外田间的主动摄像机视觉,尤其是对作物割过与未割过的高相似颜色表面进行实时识别与跟踪是一项极具挑战性的工作。提出了两种全新的快速分割方法,以用于农业机器人导航。其关键是基于多尺度特征提取,通过求取k-层行像素极值的加权均值来形成窄带兴趣区,以及基于相邻行像素两类特征证据增强与多证据模糊判别进行分割增强。提出了新的方法,分割出导向线能够自适应环境的一些变化。同时,本研究还提出了一种快速透视变换算方法和摄像机主姿态的一次性校正方法,能够在1 ms内完成对分割导向线参数的透视投影变换,在0.5 s内通过自校正获取相机的主姿态角。开发了一套对园艺草割过与未割过的边缘进行在线跟踪的分析软件。试验和相应的误差分析结果令人满意(160×120显示分辨率下,能在55 ms内自主做出经透视投影变换的作业机理想移动方向决策,普通难度的相似颜色序列图像的分割误差被控制在了平均5%以内)。对最佳适应步法(BFS)做了改进,提出了多行最佳适应步法(MR-BFS),在不降低正确性的前提下使其分割速度提高了100%以上。通过折衷组合多行最佳适应步法(MR-BFS)与多证据模糊增强法(MEFE)进行在线试验,获得了160×120分辨率下8~9帧/秒的边缘自动跟踪性能。边缘跟踪试验显示:自然图像中的不同色块和阴影对其分割影响不大,能够快速输出导向跟踪参数。如果待分割纹理表面的颜色距离相对较远,还可采用本文新提出的颜色分量运算+颜色位屏蔽方法。该方法能在320×240分辨率下,在20~30 ms内实现全帧的鲁棒分割,获得田间实时的多边缘跟踪性能。该方法避免了耗时的计算和人的操作介入,可被进一步应用于农业机器人的实际导航控制中。

       

      Abstract: Active vision on application of agricultural field, especially with the boundary tracking of cut-uncut crop surfaces with similar colors, is quite a challenge. Two novel methods were proposed for its fast segmentation in order to navigate agricultural robot. The key to efficiency is based on a narrow band extraction of multi-scale features from regions of interest (ROI) and the multi-cues enhancement of pixel-rows. The former is related to the weighted mean of k-level extreme values of pixels. The latter is related to the feature enhancement of neighborhood rows and multi-evidence fuzzy recognition. The two approaches are nearly unsupervised and their guidance line is able to be adaptive to a changing environment. A real-time method of projective transformation (with less than 1 ms of parameter processing) and an auto-calibration method for camera's main pose (with the time cost less than 0.5 s) were presented. Software for analyzing the cut-uncut lawn was developed. Experimental results were promising, in which correct segmentation was achieved within 55ms at 160×120 resolutions with an average error below 5% for normal sequence, and the online boundary tracking of cut-uncut lawns was done autonomously at the speed of 8~9 frame per second (FPS) under 160×120 resolutions, based on a trade-off combination of the multi-rows Best Fit Step (MR-BFS) and the multi-evidence fuzzy enhancement from pixel-rows. If the color distances between sides of tracking boundary are relatively larger, the present method of color components operation plus bit-mask may be a good choice for multi-boundary tracking in the field, with full segmentation done within 20~30 ms for color sequence of 320×240 resolutions. All the technique can be further used in real-time control over agricultural robot navigation without the involvement of human.

       

    /

    返回文章
    返回