基于双目视觉的海参体积测量方法

    Measurement of sea cucumber volume using binocular vision

    • 摘要: 海洋珍品的体积测量可以为水产养殖过程中海洋珍品的生长状态观测以及价值评估提供科学的数据支撑。针对目前海参养殖过程中体积测量耗时耗力、效率低下、精度参差不齐等问题,该研究提出了一种基于双目视觉的海参体积测量方法,以真实养殖场景下的原位海参作为研究对象,包含海参目标检测、海参实体分割、海参体积估计3个模块。其中,目标检测模块针对水下光线多变、环境复杂的问题,设计了融合多头自注意力机制的YOLOv8目标检测器,提高水下环境下的检测精度;实例分割模块构建了加入adapter机制的SAM(segment anything model)海参分割模型,以此获取有效精准的掩码信息;体积估计模块将掩码信息映射到三维空间获取海参的点云数据,通过泊松表面重建和体素化处理的方法克服点云数据稀疏、噪声干扰的障碍,重构海参的三维表征。结果表明,改进后的检测模型展现了综合性能的最佳表现,在精度和帧率方面分别达到了92.5%和31帧/s,相较于Faster RCNN、Cascade RCNN、YOLOv7、YOLOv8等算法,均保持一定的领先优势;泊松表面重建的重建效果明显优于Alpha shapes、Ball pivoting算法,更贴近于真实海参的表征信息,可以达到较好的体积测量效果,较于其他海参体积测量算法,该研究提出的算法在不同深度下均有更好的表现,在距离为100 cm处表现最佳,测量精度达到了94%,比最小包围框测量法和Ball pivoting测量法分别高出22和14个百分点。可见,所提方法能较为准确地测量出海参的体积,基本能够满足养殖户的评估需求,可为海参的科学养殖提供更为便捷精准的数据支持。

       

      Abstract: Accurate volume measurement is essential to the marine treasures in aquaculture. However, existing approaches cannot fully meet the growth and evaluation in the volume measurement of sea cucumbers. In this study, the binocular vision was introduced to efficiently and precisely in-situ measure the volume of sea cucumbers. Three modules also included target detection, segmentation, and volume estimation. In the first module, the target detection was used in the variable lighting and environmental conditions under the typical underwater. The reason was that object detection previously failed to monitor underwater environments, due to the fluctuation of light conditions, reflections, and debris in the water. YOLOv8 target detection model was introduced to integrate the multi-head self-attention mechanism, in order to enhance the detection accuracy in these unpredictable conditions. This attention mechanism was significantly improved to detect the sea cucumbers under the complex underwater landscape. A high-precision system was obtained to more effectively process information from different parts of images under these challenging circumstances. In the second module, instance segmentation was used to focus on the precise identification and segmentation of sea cucumber entities. A segmentation model of sea cucumber was constructed using the segment anything model (SAM) with an adapter mechanism. The SAM model was used to more accurately isolate the sea cucumber from its background, even in the presence of noise and other marine organisms in the water. The segmentation was successfully essential for the accuracy of subsequent steps, as the generated mask served as the input for the volume estimation. High-quality mask information was provided to ensure that the shape of the sea cucumber was captured with the necessary details for accurate volume reconstruction. In the third module of volume estimation, the 2D mask maps were input into 3D space to obtain a point cloud representation of sea cucumbers. Poisson surface reconstruction and voxelization were employed to reduce the distortion of the 3D model because point cloud data often suffered from sparsity and noise. Specifically, the sparse data and noise interference were avoided for the accurate 3D model. As such, the actual volume of sea cucumber was faithfully represented for precise measurement. The experimental results demonstrate that the superior performance of the improved detection model was achieved, compared with the existing algorithms. The 92.5% accuracy and a frame rate of 31 frames per second (fps) outperformed the rest, such as Faster RCNN, Cascade RCNN, YOLOv7, and YOLOv8. Additionally, the Poisson surface reconstruction also produced a closer shape approximation of the true sea cucumber, compared with the Alpha Shapes and Ball Pivoting. More accurate volume measurements were better performed at various depths. Specifically, the accuracy of volume measurement reached 94% at a distance of 100 cm, which was 22 percentage points higher than the minimum bounding box and 14 points higher than the Ball Pivoting. Reliable data was then provided to accurately measure the sea cucumber in aquaculture. In conclusion, high efficiency and precision were obtained to measure the sea cucumber volume after 3D reconstruction in underwater conditions. The finding can also offer reliable data to monitor the growth and assess value for more accurate and efficient aquaculture practices.

       

    /

    返回文章
    返回