低照度尘雾下煤、异物及输送带早期损伤多尺度目标智能检测方法

Multi-scale target intelligent detection method for coal, foreign object and early damage of conveyor belt surface under low illumination and dust fog

  • 摘要: 煤炭开采过程中矸石等异物不可避免将混入煤块中,且铁器等容易对输送带造成损伤,煤矿运输系统的智能化需要对矸石等异物和输送带损伤等进行一体化视觉检测。针对井下低照度、光照不均及尘雾等因素导致监测图像不清晰以及带面早期损伤小目标检测难题,提出一种低照度尘雾环境下煤炭、异物及带面早期损伤的多尺度目标智能检测方法。首先通过限制对比度自适应直方图均衡化对低照度尘雾图像进行预处理以增强图像对比度;接着通过增加浅层检测层凸显带面早期损伤小目标位置和形状等细节信息,提升带面早期损伤检测性能,且在不影响检测精度前提下去掉部分检测层及相应特征提取模块以缩小模型;然后针对主干网络特征提取能力不足问题,使用Partial Conv与Res2Net构建新的P_Res2Block多尺度特征表征模块,并将其替换主干网络中C3模块的Bottleneck,得到一种新的P_RC3轻量级多尺度特征提取模块,以增加模型的感受野,提升对小目标的关注度;最后在主干网络和特征融合网络中引入轻量级高效通道注意力机制来提升通道利用率和带面早期损伤检测精度。实验结果表明,在自主构造的低照度尘雾图像数据集上,相比原始YOLOv5s,所提方法的带面早期损伤检测精度AP0.5提高了10.00%,最终精度达到91.30%,模型参数量、计算量和模型大小分别降低了34.85%、6.33%、29.86%,证明改进方法可在降低模型复杂度情况下很好地解决低照度尘雾环境下小目标检测难题。

     

    Abstract: In the process of coal mining, foreign object such as gangue will inevitably be mixed into the coal, and ironware is easy to cause damage to the belt. The intelligent transportation system of coal mine needs to carry out integrated visual detection of foreign object such as gangue and belt damage. Aiming at the problems of unclear monitoring images and small target detection of early damage of belt surface caused by low illumination, uneven illumination and dust fog, a multi-scale target intelligent detection method for coal, foreign object and early damage of belt surface in low illumination and dust fog environment is proposed. Firstly, the low illumination and dust fog images are preprocessed by the contrast limited adaptive histogram equalization to enhance the image contrast. Then, by adding a shallow detection layer to highlight the detailed information such as the position and shape of the small target of the early belt surface damage, the performance of the early belt surface damage detection is improved, in the meantime some detection layers and corresponding feature extraction modules are removed to reduce the model without affecting the detection accuracy. Then, aiming at the problem of insufficient feature extraction ability of backbone network, a new P_Res2Block multi-scale feature representation module is constructed by using Partial Conv and Res2Net, and it is used to replace the Bottleneck of C3 module in backbone network to obtain a new P_RC3 lightweight multi-scale feature extraction module, so as to increase the receptive field of the model and enhance the attention to small targets. Finally, a lightweight and efficient channel attention mechanism is introduced into the backbone network and feature fusion network to improve channel utilization and early damage detection accuracy. The experimental results show that on the self-constructed low-illumination dust-fog image dataset, compared with the original YOLOv5s, the early damage detection accuracy AP0.5 of the proposed method is improved by 10.00%, and the final accuracy is 91.30%. The number of model parameters, FLOPs and model size are reduced by 34.76%, 6.33% and 29.86% respectively, which proves that the improved method can solve the problem of small target detection in low illumination and dust fog environment while reducing the complexity of the model.

     

/

返回文章
返回