Abstract:
Abstract: To achieve full automation of a grafting robot for fruits and vegetables, this paper presented a machine vision system for restoring the cotyledons of seedlings and extracting their parameters by ellipse fitting. Overlooking images of seedlings were captured by a gray camera. After doing a fast median filter, bright areas composed of cotyledons were segmented by an auto-threshold binarization algorithm with Otsu. Moreover, their contours could be easily found by an edge trace algorithm. Each corner representing the intersection of two different cotyledons was detected by finding the local maximum of the curvature in the contours. Under the constraints of distance and arc length, two corners which belong to the same two cotyledons were made a pair. Thus, all contour segments belonging to the same cotyledon could be retrieved. To restore the shape of the cotyledon, its contour was parameterized by a fitting ellipse. Through combining two parameterized cotyledons, the parameters of seedlings including growth direction, growth point, and size were extracted. Furthermore, the cells in which the seedlings were planted were determined by arraying all growth points. In a grafting operation, the growth direction and growth point can be used to assist the manipulator to fetch the seedling accurately, and the size of a cotyledon can provide some information for making the best correspondences between rootstocks and scions. One example showed that the proposed method can achieve good performance even if the cotyledons overlap each other. The errors from an ellipse fitting defined as the least absolute distance from initial points to the ellipse were calculated. Moreover, their means and standard derivation were mostly near 0.5 pixels, which indicated that the ellipse can represent the shape of the cotyledon well. Exceptionally, several ellipses with large errors were not accurate due to the fuzzy contour. The reason is that the segmented bright area was mixed in with some non-cotyledon region. The final test showed that 461 seedlings were identified and positioned in all 473 seedlings, and its rate reached 97.5%, which meets the requirement of robot grafting. There are two main reasons why some seedlings were missed. First, the bright stem and the cotyledon may be overlapped in the overlooking image because of the bending stem, and may bring in an additional corner of the contour. Secondly, when the place the seedling is living is kept away from the center of tray or the two neighbor cotyledons are too close, the cell where the seedling was planted cannot be found.