高毅楠,姚顽强,蔺小虎,等. 煤矿井下多重约束的视觉SLAM关键帧选取方法[J]. 煤炭学报,2024,49(S1):472−482. DOI: 10.13225/j.cnki.jccs.2023.0519
引用本文: 高毅楠,姚顽强,蔺小虎,等. 煤矿井下多重约束的视觉SLAM关键帧选取方法[J]. 煤炭学报,2024,49(S1):472−482. DOI: 10.13225/j.cnki.jccs.2023.0519
GAO Yinan,YAO Wanqiang,LIN Xiaohu,et al. Visual SLAM keyframe selection method with multiple constraints in underground coal mines[J]. Journal of China Coal Society,2024,49(S1):472−482. DOI: 10.13225/j.cnki.jccs.2023.0519
Citation: GAO Yinan,YAO Wanqiang,LIN Xiaohu,et al. Visual SLAM keyframe selection method with multiple constraints in underground coal mines[J]. Journal of China Coal Society,2024,49(S1):472−482. DOI: 10.13225/j.cnki.jccs.2023.0519

煤矿井下多重约束的视觉SLAM关键帧选取方法

Visual SLAM keyframe selection method with multiple constraints in underground coal mines

  • 摘要: 煤矿智能化的重大需求对煤矿井下移动机器人智能感知提出了更高的要求,视觉同时定位与建图(Visual Simultaneous Localization and Mapping,VSLAM)是煤矿机器人智能感知的关键技术。然而,煤矿井下存在非结构化环境特征、纹理弱、光照不均匀、空间狭小等问题,现有依赖启发式阈值进行关键帧选取的方法无法满足煤矿下视觉SLAM的定位与建图需求。为此,提出一种煤矿井下多重约束的视觉SLAM关键帧选取方法,实现了煤矿井下移动机器人实时稳健的位姿估计,并为煤矿井下数字孪生提供数据基础。首先,提出的方法根据几何结构约束,采用自适应阈值取代静态启发式阈值进行关键帧选取,以实现视觉SLAM关键帧选取的有效性和鲁棒性。其次,通过重心平衡原则对有效特征点分布进行均匀化处理,以进一步确保视觉SLAM关键帧选取的稳定性以及创建地图点的稠密性和准确性。最后,利用航向角阈值对转向处做进一步约束,降低视角突变对视觉SLAM精度的影响。为验证本文方法的有效性,利用自主搭建的移动机器人数据采集平台在室内场景及煤矿井下分别进行了实验,并从绝对轨迹误差(Absolute Trajectory Error,ATE)和均方根误差(Root Mean Square Error,RMSE)等方面进行了定量和定性评价。结果表明:相比于启发式视觉SLAM关键帧选取方法,提出的方法在室内场景中轨迹RMSE提高了29%,在煤矿井下环境中轨迹RMSE提高了44%,具有较高的鲁棒性、定位精度和全局一致的建图效果。

     

    Abstract: The significant demand of coal mine intelligence has put forward some higher requirements for the intelligent perception of underground mobile robots in coal mines, and the Visual Simultaneous Localization and Mapping (VSLAM) is a key technology for the intelligent perception of coal mine robots. However, due to unstructured environmental features, weak textures, uneven illumination, and small space in underground coal mines, the existing methods that rely on heuristic thresholds for keyframe selection cannot meet the localization and mapping requirements of visual SLAM in underground coal mines. Therefore, a visual SLAM keyframe selection method with multiple constraints in underground coal mines was proposed, which achieves a real-time and robust pose estimation of mobile robot in coal mines and provides data for digital twin in coal mines. Firstly, the proposed method was constrained according to geometric structure, adaptive thresholding was used instead of static heuristic thresholding for keyframe selection to achieve the effectiveness and robustness of keyframe selection. Secondly, the distribution of effective feature points was homogenized by the balance of gravity principle to further ensure the stability of keyframe selection and the denseness and accuracy of created map points. Finally, the steering place was further constrained by using the heading angle threshold to reduce the impact of viewpoint abrupt change on the visual SLAM accuracy. In order to verify the effectiveness of the proposed method, an experimental analysis was conducted in indoor scenes and underground coal mines respectively using an independently designed mobile robot data acquisition platform. Then, the qualitative and quantitative evaluations were made from Absolute Trajectory Error (ATE) and Root Mean Square Error (RMSE). The results show that compared with the heuristic keyframe selection method, the proposed method improves the trajectories RMSE by 29% and 44% in the indoor scenes and the fully enclosed promenade environment, respectively. The proposed method also has a higher robustness, localization accuracy and globally consistent map building effect in underground coal mines.

     

/

返回文章
返回