苹果采摘机器人关键技术研究现状与发展趋势

    Current status and future development of the key technologies for apple picking robots

    • 摘要: 目前国内苹果基本采用人工采摘方式,随着劳动力资源短缺以及机械自动化技术的迅速发展,利用机器人采摘替代人工作业成为必然趋势,开发苹果采摘机器人用于果园收获作业具有重要意义。由于苹果采摘作业环境复杂,严重制约了采摘自动化的发展。目标识别、定位与果实分离是苹果采摘机器人的关键技术,其性能决定了苹果采摘的效率及质量。该文概述了具有市场化前景的苹果采摘机器人发展和应用现状,综述了在复杂自然环境光照变化、枝叶遮挡、果实重叠、夜间环境下以及同色系苹果的识别方法,介绍了多种场景并存的复杂环境下基于深度学习的苹果识别算法、遮挡、重叠及振荡果实的定位方法,并对采用末端执行器实现果实与果树的分离方法进行了分析。针对现阶段苹果采摘机器人采摘速度低、成功率低、果实损伤、成本高等问题,指出今后苹果采摘机器人商业化发展亟需在农机农艺结合、优化识别算法、多传感器融合、多臂合作、人机协作、扩展设备通用性、融合5G与物联网技术等方面开拓创新。

       

      Abstract: Abstract: Fruit picking has been one of the most important operations in modern agriculture. Manual picking cannot fully meet large-scale apple production in recent years, due to the labor-intensive and time-consuming task. Alternatively, robot picking can be expected to replace manual work. However, the conventional semi-automatic picking machine can seriously vibrate the branches and damage the fresh apples during batch harvesting in the existing orchard. It is a high demand to detect apples under complex environments, and then pick them without damaging the fruit or trees. The picking robots are also required a compatible auxiliary platform during operations in an orchard. The performance of picking robots can be assessed using the picking speed, picking success, and fruit damage rates. These parameters depend on three key technologies: target recognition, localization, and fruit separation. In this paper, an overview was provided of the history and current status of commercial apple-picking robots. Specifically, the performance and robustness were highlighted, in terms of the picking efficiency, structural composition, the type of orchard, and adaptability to the external environment. The main technical features were then summarized from the application of apple-picking robots. Since the apple picking was operated in an unstructured orchard environment, the most serious challenge remained in the application of target recognition, localization, and fruit separation techniques. Therefore, the recognition techniques were reviewed for the apples in the complex natural environments with changing light, branch and leaf shading, overlapping fruit, night-time environments, and same-colored apples. Deep learning-based apple recognition algorithms were the far-reaching prospects in complex environments, particularly in multiple scenarios. The accuracy and speed of apple recognition were improved using deep learning recognition algorithms in the field of apple picking. The second most challenge was the application of the apple localization for the fruit occlusion and overlap, while the fruit displacement by wind during the imaging process. Therefore, four aspects were introduced in the apple localization, including 2D information acquisition, depth information acquisition, apple pose acquisition and oscillating fruit localization. Point cloud processing algorithms were highlighted to achieve the precise localization of occluded apples. In addition, the applications of end-effectors were reviewed in the apple-picking robots with high efficiency and non-destructive picking. Three types of the end-effector structure (such as hand-jaw, vacuum, and shear) were summarized under fruit separation. It was found that the hand-jaw was the most commonly-used type of end-effector. Current research on the end-effectors was focused on the flexible materials for the finger surfaces, under-driven, flexible structures or control systems, such as the soft hands and perception-based servo control. Therefore, it is necessary to improve the picking speed and success rate with the low fruit damage and cost saving in the apple picking robot, in order to accelerate the process of apple picking automation. Future development was also proposed for the apple-picking robot in the urgent commercial need of the pioneering innovation in the combination of agricultural machinery and agronomy. Some optimization can be expected to be performed on the recognition algorithm, multi-sensor fusion, multi-arm cooperation, human-machine collaboration, extending device versatility, and integrating 5G and IoT technology. This finding can provide a strong reference for the current status, future development trends, and equipment innovation of apple-picking robots, together with the key technologies.

       

    /

    返回文章
    返回