基于文本分类和知识挖掘的远洋渔船安全问题分析

    Evaluating the safety of distant-water fishing vessels using text classification and knowledge mining

    • 摘要: 针对远洋渔船问题信息的知识挖掘与分析任务中存在渔船安全知识提取深度不足、安全问题文本分类精度不够的问题,该研究在归纳中国沿海8省市远洋渔业管理机构和企业的约5000条远洋渔船安全问题文本数据特征的基础上,提出一种整合文本分类、知识挖掘和共现网络分析技术的远洋渔船安全问题分析方法。首先,构建基于双向预训练语言模型与文本卷积神经网络的混合深度学习模型BERT-TextCNN(bidirectional encoder representations from transformers-text convolutional neural networks),对渔船安全问题文本进行基于《开普敦协定》规定的精准主题分类。进一步利用基于主题的词频-逆文档频率算法TF-IDF(term frequency-inverse document frequency),提取各主题下的关键渔船安全知识。最后,绘制渔船安全知识共现网络图,可视化分析各知识的分布规律及内在联系。结果表明,BERT-TextCNN模型对渔船安全问题文本的分类精度相较于BERT、Word2vec、Character embedding文本表示方法和DPCNN、BiLSTM-Attention、RCNN等6种神经网络的其他17种对比模型提升较为明显,准确率、宏平均召回率、宏平均F1值分别达98.20%、98.02%、98.05%;基于主题的渔船安全知识挖掘方法可以展示远洋渔船安全工作的重点排序和关系网络图,涵盖渔船的机电设备、消防装置、救生设备、无线电通信等10类安全知识。该方法可为相关渔业管理人员提供高质量的渔船安全知识服务,对国内远洋渔业的安全管理效率、履约水平、智慧渔业工程的应用和发展有促进作用。

       

      Abstract: Potential knowledge can be extracted from the safety text of distant water fishing (DWF) vessels. However, the previous approaches have not yet been fully developed for the safety text of fishing vessels. Some challenges remained, such as the low accuracy of text classification, and insufficient depth of knowledge extraction. In this study, an analytical approach was proposed to combine text classification, knowledge mining, and co-occurrence network technology under the Cape Town Agreement(CTA) of 2012 . The text data on DWF vessel safety was also collected from the fishery management organizations, associations, and over 20 fishery enterprises from eight Chinese coastal provinces and cities, including Zhejiang, Shanghai, and Fujian. The DWF vessel safety corpus consisted of more than 5,000 valid questions and 100,000 characters. The analytical approach comprised three stages. Firstly, a hybrid deep learning model was developed using bidirectional encoder representations from transformers-text convolutional neural networks (BERT-TextCNN), according to the characteristics of DWF vessel safety text, such as diverse data types, sparse data features, and fuzzy boundaries. The character vectors were generated to extract the contextual semantic and deep syntactic information of the text using BERT during text representation. Multiple convolutional kernels of TextCNN were utilized to spatially model the generated character vectors and then to extract the local features for the accurate classification of safety theme. Secondly, term rrequency-inverse document frequency (TF-IDF) was employed to extract the key safety knowledge of fishing vessels, considering the importance and prevalence of knowledge within each safety theme. Finally, a co-occurrence network was constructed to visualize the safety knowledge of fishing vessels, including distributional patterns and interconnections. The results show that the BERT-TextCNN model achieved an accuracy, macro average recall rate, and macro average F1 value of 98.20%, 98.02%, and 98.05%, respectively. The performance outperformed the other 17 comparative models, which utilized three text representations (BERT, Word2vec, and Character embedding) and six neural networks (TextCNN, Softmax, DPCNN, BiLSTM-Attention, RCNN, and Transformer). Meanwhile, the theme-based knowledge mining and analytical approach achieved clear rankings of DWF vessel compliance and safety management knowledge, as well as relationship networks crossing ten safety knowledge themes of fishing vessels, including provisions, structure, stability, electrical installations, fire protection, crew protections, life-saving equipment, emergency procedures, wireless communication, and shipborne navigation equipment. Intelligent safety knowledge services and decision-making tools were obtained to improve the compliance level and safety management efficiency in DWF. The finding can provide a strong reference to promote the application and development of knowledge service systems and the smart fishing industry.

       

    /

    返回文章
    返回