Classification of Tree Species and Standing Dead Trees with Lidar Point Clouds Using Two Deep Neural Networks: PointCNN and 3DmFV-Net

Knowledge about tree species distribution is important for forest management and for modeling and protecting biodiversity in forests. Methods based on images are inherently limited to the forest canopy. Airborne lidar data provide information about the trees’ geometric structure, as well as trees beneath the upper canopy layer. In this paper, the potential of two deep learning architectures (PointCNN, 3DmFV-Net) for classification of four different tree classes is evaluated using a lidar dataset acquired at the Bavarian Forest National Park (BFNP) in a leaf-on situation with a maximum point density of about 80 pts/m2\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$^{2}$$\end{document}. Especially in the case of BFNP, dead wood plays a key role in forest biodiversity. Thus, the presented approaches are applied to the combined classification of living and dead trees. A total of 2721 single trees were delineated in advance using a normalized cut segmentation. The trees were manually labeled into four tree classes (coniferous, deciduous, standing dead tree with crown, and snag). Moreover, a multispectral orthophoto provided additional features, namely the Normalized Difference Vegetation Index. PointCNN with 3D points, laser intensity, and multispectral features resulted in a test accuracy of up to 87.0%. This highlights the potential of deep learning on point clouds in forestry. In contrast, 3DmFV-Net achieved a test accuracy of 73.2% for the same dataset using only the 3D coordinates of the laser points. The results show that the data fusion of lidar and multispectral data is invaluable for differentiation of the tree classes. Classification accuracy increases by up to 16.3% points when adding features generated from the multispectral orthophoto.