基于双目视觉的露天矿无人车前障碍检测研究

Research on the detection of obstacles in front of unmanned vehicles in opencast mines based on binocular vision

  • 摘要: 无人驾驶汽车在露天矿区复杂环境下遭遇落石、水坑、行人等障碍物有着极大的安全隐患,易导致车辆侧翻、陷车,造成财物损失的风险或者对人员生命安全构成威胁,因此,露天矿道路上复杂多变的地形环境作为矿山智能化中露天矿无人驾驶车辆的重要解决问题,需要在测出车前障碍物的深度的同时保障对障碍物检测的精度和速度。提出的Feffol网络模型在特征提取阶段选取Efficient-v2作为骨干网络结构进行特征提取,选取基于带有SppCSP结构的Ebifpn特征金字塔模块在提高特征感受野的同时也增强了不同尺寸的特征信息,使用Focal Loss和CIoU Loss损失函数来平衡正负样本并解决预测框与真实检测框没有交集时方法失效的问题。针对现阶段对于露天矿障碍物检测多数处于二维阶段、仅能对目标障碍物进行识别、缺少对障碍物的深度信息的测量、对前方障碍物无法做出正确决策的问题,基于双目相机,以双目视觉深度检测的方法对无人车提供车前障碍物的深度数据支持。实验结果表明:Feffol的检测精度为90.09%,检测速度为9.75 it/s,对比其他主流型网络,Feffol能在进一步提高监测精度的同时,监测速度也可以满足露天无人驾驶矿区道路障碍物检测的避障数据决策需求,同时对车前障碍物的深度获取使图像识别在露天矿山的应用更加具有可行性,为露天矿无人驾驶车辆的安全行驶提供了重要依据。

     

    Abstract: Driverless cars in the complex environment of the open pit mining area encountered falling rocks, puddles, pedestrians and other obstacles have great safety hazards, easy to cause vehicle rollover, stuck in the car, resulting in the risk of loss of property or pose a threat to the safety of personnel, therefore, the complex and changing terrain environment on the road of the open pit mine as an important problem solving of the open pit mine unmanned vehicles in the mining intelligence, the need to measure the depth of obstacles in front of the car of the while guaranteeing the accuracy and speed of obstacle detection. The Feffol network model proposed in this paper selects Efficient-v2 as the backbone network structure for feature extraction in the feature extraction stage, selects the Ebifpn feature pyramid module based on the SppCSP structure with SppCSP structure to improve the feature sensing field while enhancing the feature information of different sizes, uses the Focal Loss and CIoU Loss loss functions to balance positive and negative samples, and solve the problem of method failure when there is no intersection between the prediction frame and the real detection frame. Aiming at the current stage of obstacle detection in open pit mines, most of which are in the two-dimensional stage, and can only recognize the target obstacles, but lack of measurement of the depth information of the obstacles, and can not make a correct decision on the obstacles in front of them; this paper is based on the binocular camera, and provides the support of the depth data of the obstacles in front of the unmanned vehicle by the method of binocular vision depth detection. The test results show that: Feffol's detection accuracy is 90.09%, detection speed is 9.75 it/s, compared with other mainstream type network, Feffol can further improve the monitoring accuracy at the same time, the monitoring speed can also meet the unmanned mining area unmanned mining road obstacle detection obstacle avoidance data decision-making needs, at the same time the depth of the obstacle in front of the vehicle to obtain, so that the image recognition Application in open pit mines is more feasible, providing an important basis for the safe traveling of unmanned vehicles in open pit mines.

     

/

返回文章
返回