菠萝采收机械低成本双目视觉平台搭建与田间试验

    Construction and in-field experiment of low-cost binocular vision platform for pineapple harvesting robot

    • 摘要: 摘要:视觉系统是菠萝采摘机械的关键部件之一,可为采摘终端提供待采果实的位置导航信息。考虑到菠萝果形较大,易于识别,以及系统应用于农业领域,需尽可能降低成本。该研究选取双目视觉技术,采用低成本的CMOS视觉传感器,辅以三脚架、双目云台,以及计算机、软件系统,搭建低成本双目视觉标定平台;研究了标定模型及流程,并基于C++和OpenCV v1.1环境以及Matlab标定工具箱的软件环境平台,采用张正友标定算法,分别对视觉传感器进行标定试验,选取了适合本平台的标定方法。基于此平台和开发的菠萝果实识别算法,在湛江菠萝田间进行果实深度测量试验发现,果实测试距离小于1 m时,深度误差在6~8 cm范围内,经软件算法校正后,误差控制在2~3 cm范围内,该平台试验结果良好,表明低成本试验平台具有可行性。该研究可为菠萝采摘机器人视觉系统的开发提供参考。

       

      Abstract: Vision system is one of key parts of agricultural harvesting robots, which provides the fruit's position information for navigating the manipulator. Considering its applications in agriculture and the pineapple is big enough for recognition, this study presents a low-cost binocular vision platform for pineapple harvesting robots, which consists of low-cost CMOS (Complementary Metal Oxide Semiconductor) image sensors, a tripod, a binocular pan, a PC and software system; The calibration model and the calibration software were developed based on C++ and OpenCV version 1.1, and Matlab calibration toolbox separately; The Zhang's algorithm was employed during the calibration. By experiment, the suitable calibration method for the constructed platform was selected. Based on the low-cost vision platform and developed pineapple recognition algorithms, 3D position calculation experiments for pineapples were conducted in a pineapple field of Zhanjiang. The results showed that the depth errors were less than 6-8 cm when the depth distance was around 1 m, and the errors were less than 2-3 cm after correcting the whole system. The low-cost platform performed well and its feasibility was proved. This study can provide a reference for the development of pineapple harvesting robots.

       

    /

    返回文章
    返回