Crown segmentation from UAV visible light DOM based on level set method

Li Yadong; Cao Minglan; Li Changqing; Feng Zhongke; Jia Shuhua

doi:10.11975/j.issn.1002-6819.2021.06.008

Volume 37 Issue 6

Mar. 2021

Turn off MathJax

Article Contents

Abstract

References

Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE) > 2021 > 37(6): 60-65. > DOI: 10.11975/j.issn.1002-6819.2021.06.008

Li Yadong, Cao Minglan, Li Changqing, Feng Zhongke, Jia Shuhua. Crown segmentation from UAV visible light DOM based on level set method[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2021, 37(6): 60-65. DOI: 10.11975/j.issn.1002-6819.2021.06.008

Citation:

PDF (1001 KB)

Crown segmentation from UAV visible light DOM based on level set method

1.
Beijing Polytechnic College, Beijing 100042, China
2.
Beijing Key Laboratory of Precision Forestry of Beijing Forestry University, Beijing 100083, China
3.
Inner Mongolia Dayangshu Forest Bureau, Dayangshu 022456, Inner Mongolia, China

More Information

Received Date: January 12, 2021
Revised Date: February 21, 2021
Published Date: March 14, 2021

Graphical Abstract

Abstract

Abstract

Abstract: Under complicated forest stands like natural forest, mixed forest, and multi-storied forest, the visible light forest images are greatly influenced by the canopy density, canopy structure, and photographing season, etc. During the crown extraction, the existing methods fail to guarantee the precision and lack effective manual intervention mechanism. A universal, flexible, and practical crown segmentation method, which could realize the automatic segmentation under low canopy density and appropriately implement the manual intervention under high canopy density, was explored in this study. The unmanned aerial vehicle (UAV) visible light forest images were firstly processed into DSM, DEM, and DOM, the CHM was obtained by deducting DEM from DSM, the plane position of tree top was extracted from CHM via the local maximum method to generate a Thiessen polygon, a rectangle of crown range was generated based on its bounding rectangle, the image of crown range of an individual standing tree was traversed and segmented, and after the anisotropic diffusion filtering, the boundary curve of crown was evolved out through the level set method. A level set CV model-based crown segmentation plug-in that could operate with embedded ArcMap was implemented on ArcGIS Engine via C# language, this plug-in was used to do the crown extraction test of DOM images in nine 50 m×50 m standard mixed forest sample plots with different canopy densities and different species compositions Naimuhe forest farm of Inner Mongolia Great Khingan Dayangshu Forestry Bureau, and meanwhile, this method was compared with the manual extraction method and SVM image segmentation method. The results showed that the extraction rate of the proposed method was averagely elevated by 45.97% in comparison with that of the manual extraction method, and the extraction accuracy was averagely improved by 15.29 percentage pionts compared with that of the SVM image segmentation method. Directing at the problems existing in the crown extraction from UAV forest visible light images of natural mixed forests, namely, the extraction difficulty was great and the existing methods were of low precision, a method integrating level set and selective manual intervention was proposed in this study, thus effectively avoiding the large workload in the full manual segmentation, and solving the problem that the precision could not be guaranteed by the machine learning method, which was inconvenient for the manual intervention. The level set method, which was not influenced by the initial value, was used, so it was unnecessary to seek for the initial value by training a large quantity of samples, and the crown segmentation efficiency was improved. The crown segmentation result is the vector line factor of the crown boundary of an individual standing tree, which can flexibly edit individual crowns. This method highlights the efficiency under low canopy density and large crown breadth, and guarantees the accuracy under high canopy density and small crown breadth, so it is of strong flexibility and universality.
- unmanned aerial vehicle,
- level set,
- crown segmentation,
- visible light,
- ortho-image

FullText(HTML)

References (26)

References

[1]	曾晶. 基于LiDAR与DOM数据的单木参数提取与程序开发[D]. 北京：北京林业大学，2016.Zeng Jing. Tree Parameters Extraction and Software Development Based on LiDAR and DOM[D]. Beijing: Beijing Forestry University, 2016. (in Chinese with English abstract)
[2]	于东海，冯仲科. 基于无人机倾斜航空影像的树冠体积测算方法[J]. 农业工程学报，2019，35(1)：90-97.Yu Donghai, Feng Zhongke. Tree crown volume measurement method based on oblique aerial images of UAV[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2019, 35(1): 90-97. (in Chinese with English abstract)
[3]	王伟. 无人机影像森林信息提取与模型研建[D]. 北京：北京林业大学，2015.Wang Wei. Forest Information Extraction and Model Building Based on UAV Image[D]. Beijing: Beijing Forestry University, 2015. (in Chinese with English abstract)
[4]	陈崇成，李旭，黄洪宇，等. 基于无人机影像匹配点云的苗圃单木冠层三维分割[J]. 农业机械学报，2018，49(2)：149-155，206.Chen Chongcheng, Li Xu, Huang Hongyu, et al. 3D segmentation of individual tree canopy in forest nursery based on drone image-matching point cloud[J]. Transactions of the Chinese Society for Agricultural Machinery, 2018, 49(2): 149-155. (in Chinese with English abstract)
[5]	何艺，周小成，黄洪宇，等. 基于无人机遥感的亚热带森林林分株数提取[J]. 遥感技术与应用，2018，33(1)：168-176.He Yi, Zhou Xiaocheng, Huang Hongyu, et al. Counting tree number in subtropical forest districts based on UAV remote sensing images[J]. Remote Sensing Technology and Application, 2018, 33(1): 168-176. (in Chinese with English abstract)
[6]	李亚东，冯仲科，明海军，等. 无人机航测技术在森林蓄积量估测中的应用[J]. 测绘通报，2017(4)：66-69.Li Yadong, Feng Zhongke, Ming Haijun, et al. Application of UAV aerophotographic system in forest volume estimation[J]. Bulletin of Surveying and Mapping, 2017(4): 66-69. (in Chinese with English abstract)
[7]	李亚东，曹明兰，李长青，等. 无人机森林航摄影像三维点云估测林分蓄积量研究[J]. 中南林业科技大学学报，2019(3)：56-60.Li Yadong, Cao Minglan, Li Changqing, et al. A research on three-dimensional point cloud estimation of forest stand volume by UAV forest aerial survey images[J]. Journal of Central South University of Forestry & Technology, 2019(3): 56-60. (in Chinese with English abstract)
[8]	费运巧. 森林病虫害图像分析算法研究[D]. 北京：北京林业大学，2016.Fei Yunqiao. Analysis of Image Segmentation Algorithms for Forest Diseases and Insect Pests[D]. Beijing: Beijing Forestry University, 2016. (in Chinese with English abstract)
[9]	樊仲谋，周成军，周新年，等. 无人机航测技术在森林资源调查中的应用[J]. 森林与环境学报，2018，38(3)：297-301.Fan Zhongmou, Zhou Chengjun, Zhou Xinnian, et al. Application of unmanned aerial vehicle aerial survey technology in forest inventory[J]. Journal of Forest and Environment, 2018, 38(3). 297-301. (in Chinese with English abstract)
[10]	付尧，王新杰，孙玉军，等. 树冠提取技术研究进展[J]. 世界林业研究，2013，26(4)：38-42.Fu Yao, Wang Xinjie, Sun Yujun, et al. A study of tree crown information extraction method[J]. World Forestry Research, 2013, 26(4): 38-42. (in Chinese with English abstract)
[11]	李德仁，李明. 无人机遥感系统的研究进展与应用前景[J]. 武汉大学学报：信息科学版，2014，39(5)：505-513，540.Li Deren, Li Ming. Research advance and application prospect of unmannedaerial vehicle remote sensing system[J].Geomatics and Information Science of Wuhan University, 2014, 39(5): 505-513, 540. (in Chinese with English abstract)
[12]	于旭宅，王瑞瑞，陈伟杰. 改进分水岭算法在无人机遥感影像树冠分割中的应用[J]. 福建农林大学学报：自然科学版，2018，47(4)：428-434.Yu Xuzhai, Wang Ruirui, Chen Weijie. Forest canopy segmentation of UAV remote sensing images using improved watershed algorithm[J]. Journal of Fujian Agriculture and Forestry University:Natural Science Edition, 2018, 47(4): 428-434. (in Chinese with English abstract)
[13]	李文静，王瑞瑞，石伟，等. 基于无人机多光谱影像的单木树冠提取方法[J]. 福建农林大学学报：自然科学版，2020，49(5)：639-645.Li Wenjing, Wang Ruirui, Shi Wei, et al. Crown extraction method of individual tree based on multi-spectral image of UAV[J]. Journal of Fujian Agriculture and Forestry University: Natural Science Edition, 2020, 49(5): 639-645. (in Chinese with English abstract)
[14]	卜帆，石玉立. 机载LiDAR高差和高分影像的城市树冠提取比较[J]. 遥感技术与应用，2017，32(5)：875-882.Pu Fan, Shi Yuli. The comparison of urban tree crown extraction based on airborne LiDARelevation difference and high resolution Imagery[J]. Remote Sensing Technology and Application, 2017, 32(5): 875-882. (in Chinese with English abstract)
[15]	刘清旺，李世明，李增元，等. 无人机激光雷达与摄影测量林业应用研究进展[J]. 林业科学，2017，53(7)：134-148.Liu Qingwang, Li Shiming, Li Zengyuan, et al. Review on the applications of UAV-based LiDAR and photogrammetry in forestry[J]. Scientia Silvae Sinicae, 2017, 53(7): 134-148. (in Chinese with English abstract)
[16]	全迎，李明泽，甄贞，等. 运用无人机激光雷达数据提取落叶松树冠特征因子及树冠轮廓模拟[J]. 东北林业大学学报，2019，47(11)：52-58.Quan Ying, Li Mingze, Zhen Zhen, et al. Modeling crown characteristic attributes and profile of larix olgensis using UAV-borne LiDAR[J]. Journal of Northeast Forestry University, 2019, 47(11): 52-58. (in Chinese with English abstract)
[17]	耿林，李明泽，范文义等. 基于机载LiDAR的单木结构参数及林分有效冠的提取[J]. 林业科学，2018，54(7)：65-75.Geng Lin, Li Mingze, Fan Wenyi, et al. Individual tree structure parameters and effective crown of the stand extraction base on airborn LiDAR data[J]. Scientia Silvae Sinicae, 2018, 54(7): 65-75. (in Chinese with English abstract)
[18]	金忠明，曹姗姗，王蕾，等. 天山云杉林无人机可见光影像树冠信息提取方法研究[J]. 林业资源管理，2020(1)：125-135.Jin Zhongming, Cao Shanshan, Wang Lei, et al. Study on extraction of tree crown information from UAV visible light Image of piceaschrenkiana var. tianschanica forest[J]. Forest Resources Management, 2020(1): 125-135. (in Chinese with English abstract)
[19]	杨勇强，王振锡，师玉霞，等. 基于无人机影像的天山云杉林单木树冠信息提取[J]. 新疆农业科学，2020，57(8)：1484-1492.Yang Yongqiang, Wang Zhenxi, Shi Yuxia, et al. The extraction of single wood canopy of picea schrenkiana vartianshanica forest based on UAV image[J]. Xinjiang Agricultural Sciences, 2020, 57(8): 1484-1492. (in Chinese with English abstract)
[20]	李丹，张俊杰，赵梦溪. 基于FCM和分水岭算法的无人机影像中林分因子提取[J]. 林业科学，2019，55(5)：180-187.Li Dan, Zhang Junjie, Zhao Mengxi. Extraction of stand factors in UAV image based on FCM and watershed algorithm[J]. Scientia Silvae Sinicae, 2019, 55(5): 180-187. (in Chinese with English abstract)
[21]	Osher S, Sethian J A. Fronts propagating with curvature dependent speed: Algorithms based on hamilton-jacobi formulation[J]. Journal of Computational Physics, 1988, 79: 12-49.
[22]	宋昱，吴一全，毕硕本. 边缘修正CV模型的卫星遥感云图分割方法[J]. 光学学报，2014，34(9)：30-37.Song Yu, Wu Yiquan, Bi Shuoben. Satellite remote sensing cloud image segmentation using edge corrected CV model[J]. Acta Optica Sinica, 2014, 34(9): 30-37. (in Chinese with English abstract)
[23]	刘江俊，高海力，方陆明，等. 基于无人机影像的树顶点和树高提取及其影响因素分析[J]. 林业资源管理，2019(4)：107-116.Liu Jiangjun, Gao Haili, Fang Luming, et al. Tree vertex and height extraction based on UAV imagery and analysis on its influencing factors[J]. Forest Resources Management, 2019(4): 107-116. (in Chinese with English abstract)
[24]	Yu Y, Acton S T. Speckle reducing anisotropic diffusion[J]. IEEE Transactions on Image Processing, 2002, 11(11): 1260-1270.
[25]	丁鑫，陶庭叶，陶征广，等. RTKLIB软件结构及调用方法[J]. 导航定位学报，2020，8(4)：93-99.Ding Xin, Tao Tingye, Tao Zhengguang, et al. Discussion of software structure and calling method for RTKLIB[J]. Journal of Navigation and Positioning, 2020, 8(4): 93-99. (in Chinese with English abstract)
[26]	Chan T F, Vese L A. Active contours without edges[J]. IEEE Transactions on Image Processing, 2001, 10(2): 266-277.

[1]	CHEN Longwei, ZHOU Xiaocheng, LI Chuanxin, LIN Huazhang, WANG Yongrong, CUI Yonghong. Classification of tree species based on UNet-ResNet14* semi-supervised learning using UAV images[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2024, 40(1): 217-226. DOI: 10.11975/j.issn.1002-6819.202310172
[2]	Ye zhangxi, Guo Qian, Zhang Jian, Zhang Houxi, Deng Hui. Extraction of urban impervious surface based on the visible images of UAV and OBIA-RF algorithm[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2022, 38(4): 225-234. DOI: 10.11975/j.issn.1002-6819.2022.04.026
[3]	Dai Jianguo, Xue Jinli, Zhao Qingzhan, Wang Qiong, Chen Bing, Zhang Guoshun, Jiang Nan. Extraction of cotton seedling growth information using UAV visible light remote sensing images[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2020, 36(4): 63-71. DOI: 10.11975/j.issn.1002-6819.2020.04.008
[4]	Gao Yonggang, Lin Yuehuan, Wen Xiaole, Jian Wenbin, Gong Yingshuang. Vegetation information recognition in visible band based on UAV images[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2020, 36(3): 178-189. DOI: 10.11975/j.issn.1002-6819.2020.03.022
[5]	Dai Jianguo, Zhang Guoshun, Guo Peng, Zeng Tiaojun, Cui Meina, Xue Jinli. Classification method of main crops in northern Xinjiang based on UAV visible waveband images[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2018, 34(18): 122-129. DOI: 10.11975/j.issn.1002-6819.2018.18.015
[6]	Li Ming, Huang Yuqi, Li Xumeng, Peng Dongxing, Xie Jingxin. Extraction of rice planting information based on remote sensing image from UAV[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2018, 34(4): 108-114. DOI: 10.11975/j.issn.1002-6819.2018.04.013
[7]	Guo Peng, Wu Fadong, Dai Jianguo, Wang Haijiang, Xu Liping, Zhang Guoshun. Comparison of farmland crop classification methods based on visible light images of unmanned aerial vehicles[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2017, 33(13): 112-119. DOI: 10.11975/j.issn.1002-6819.2017.13.015
[8]	Wang Xiaoqin, Wang Miaomiao, Wang Shaoqiang, Wu Yundong. Extraction of vegetation information from visible unmanned aerial vehicle images[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2015, 31(5): 152-159. DOI: 10.3969/j.issn.1002-6819.2015.05.022
[9]	Xia Lang, Mao Kebiao, Ma Ying, Sun Zhiwen, Zhao Fen. Retrieval land surface temperature from visible infrared imager radiometer suite data[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2014, 30(8): 109-116. DOI: 10.3969/j.issn.1002-6819.2014.08.013
[10]	Tian Xiaodong, Lü Liangqing, Wang Bin. Method for county-level land use change survey based on orthophoto and GIS[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2005, 21(13): 171-173.