基于露天矿三维点云的非结构化道路语义分割方法

Unstructured road semantic segmentation method based on 3D point cloud of open pit mine

  • 摘要: 近年来在矿山智能化相关举措的逐步实施下,矿山行业朝着智能化、无人化方向发展。无人驾驶技术是当前露天矿智能化运输作业系统的重要组成部分,通过场景重建和识别获得准确的场景几何信息,是无人运输车辆应用于露天矿作业生产的先决条件。三维点云数据可以准确实现三维场景重建,而点云语义分割能够有效提取驾驶场景中道路环境的三维特征信息,实现无人驾驶对行驶环境区域的准确识别。相比城市结构化道路,露天矿场景下非结构化道路具有道路与地形边界特征模糊、无明显道路边沿、空间三维坐标跨度大等特点。为解决目前公开的非结构化道路数据集规模较少、样本分布不均匀以及主流点云语义分割算法对非结构化道路分割精度较低的问题,通过三维点云重建构造露天矿点云数据集,以及优化改进PointNet++算法,提出了一种适用于露天矿场景下非结构化道路的语义分割方法。基于SFM和MVS算法对采集到的多视点图像进行稠密点云重建,同时优化改进PointNet++,引入MLP、通道注意力机制以及基于点注意力的自注意力机制,设计了露天矿非结构化道路点云语义分割模型。为验证该方法的有效性,依据S3DIS数据集格式进行转换、划分并数据增强构建了2641组samples露天矿点云数据。通过模型训练的实验结果表明:改进后的算法进行分割测试比PointNet++的mIoU提升了4.9%,且分割性能良好。对比其他点云分割网络,该网络模型更适用于露天矿场景下的非结构化道路,能够满足矿区运输无人车对于可行域的行驶要求,为无人驾驶后续的决策与规划提供准确的三维环境信息。

     

    Abstract: In recent years, under the gradual implementation of mine intelligence-related initiatives, the mining industry has developed towards intelligence and unmanned development. Driverless technology, as an important part of the current intelligent transportation operation system of surface mines, obtains accurate scene geometry information through scene reconstruction and recognition, which is a prerequisite for the application of unmanned transportation vehicles to the operation and production of surface mines. Three-dimensional point cloud data can accurately realize three-dimensional scene reconstruction, and point cloud semantic segmentation can effectively extract the three-dimensional feature information of the road environment in the driving scene, realizing the unmanned driver's accurate recognition of the driving environment area. Compared with urban structured roads, unstructured roads in open pit mining scenarios are characterized by fuzzy road and terrain boundary features, no obvious road edges, and large spatial 3D coordinate spans. In order to solve the problems of small size of publicly available unstructured road datasets, uneven sample distribution, and low segmentation accuracy of mainstream point cloud semantic segmentation algorithms for unstructured roads, a semantic segmentation method for unstructured roads in open-pit mine scenarios is proposed by constructing an open-pit mine point cloud dataset through 3D point cloud reconstruction, as well as by optimizing and improving the PointNet++ algorithm. Based on SFM and MVS algorithms for dense point cloud reconstruction of captured multi-viewpoint images, and optimization and improvement of PointNet++, MLP, channel attention mechanism, and self-attention mechanism based on point attention are introduced, and a point cloud semantic segmentation model for unstructured roads in open-pit mines is designed. In order to verify the effectiveness of the method, 2641 sets of samples of open pit mine point cloud data were constructed based on the S3DIS dataset format for conversion, segmentation and data enhancement. The experimental results of model training show that the improved algorithm for segmentation test has a 4.9% increase in mIoU compared to PointNet++, and the segmentation performance is good. Compared with other point cloud segmentation networks, this network model is more suitable for unstructured roads in open pit mine scenarios, and can meet the requirements of mine transportation unmanned vehicles for driving in feasible domains, providing accurate 3D environment information for subsequent decision-making and planning of unmanned vehicles.

     

/

返回文章
返回