一种基于改进DeblurGAN-v2的煤矿带式输送机图像去运动模糊方法

A motion blurring removal method based on improved DeblurGAN-v2 for coal mine belt conveyor images

  • 摘要: 针对煤矿井下相机与带式输送机带面物体相对运动而造成监测图像上物体产生拖影与轮廓不清晰的问题,提出一种基于改进DeblurGAN-v2的图像去运动模糊方法。首先采用WGAN-GP替换DeblurGAN-v2鉴别器的损失函数,抑制了原模型生成图像轮廓不清晰和纹理细节丢失问题;然后为了获取更深层次的图像信息并使鉴别器的损失计算更加精确,以便更好地捕捉生成图像与清晰图像之间的局部细节和2者之间差异,设计了三尺度鉴别器结构并将3个鉴别器计算所得损失赋予不同权值计算加权和,所得生成图像中物体的轮廓清晰且表面细节丰富,但是部分区域出现了与图像无关的彩色斑块,造成了有效信息的丢失;为解决彩色斑块问题,将结构相似性损失和梯度损失引入生成器的损失函数中并在VGG19的Conv 4-1层进行生成器感知损失的计算,生成图像消除了局部彩色斑块且图像中物体的轮廓更清晰,表面细节更丰富,去运动模糊效果最优,梯度标准差较运动模糊图像提升了68.38%,为所对比2种方法的6倍和17倍;最后将去运动模糊前后图像中异物进行标注并使用YOLOv5模型进行样本训练,结果表明在不同交并比下异物的检测精度均上升,分别提升了3.9%和7.9%,模糊图像和对比方法的漏检、误检和检测置信度低等问题大幅改善,验证了所提图像去运动模糊方法的有效性。

     

    Abstract: In order to solve the problem that the object on the monitored image is dragged and the object contour is unclear due to the relative motion between the camera and the object on the belt of belt conveyor in coal mine. In this paper, an image motion blurring removal method based on improved DeblurGAN-v2 is proposed. Firstly, WGAN-GP is used to replace the loss function of the DeblurGAN-v2 discriminator, which suppressed the problems of unclear image contours and loss of texture details generated by the original model; Then, in order to capture deeper image details and calculate discriminator loss more accurately, a three-scale discriminator structure is designed. This allows for the better capture of the local details of generated and clear images and differences between them. The losses computed by three discriminators with different weight values are used to obtain a weighted sum. The contour of the object in the generated image is clear and the surface details are rich. But color patches unrelated to the image appear in some areas, resulting in the loss of effective information. In order to solve the color patch problem, the structural similarity loss and gradient loss are introduced into the loss function of the generator and the generator perception loss is calculated at the Conv 4-1 layer of VGG19. The generated image eliminates the local color plaque and the contour of the object in the image is clearer, the surface details are richer, and the motion blur effect is optimal. The gradient standard deviation of the generated image is 68.38% higher than that of the blurred image, which is 6 times and 17 times of the compared two methods. Finally, the foreign objects in the image before and after motion blurring removal are annotated, and these samples are trained by YOLOv5 model. The results show that the detection accuracy of foreign objects increases under different intersection ratios, with an improvement rate of 3.9% and 7.9%, respectively, and the issues of missed detection, false detection and low detection confidence of blurred images and compared methods are greatly improved. The effectiveness of the proposed image motion blurring removal method is verified.

     

/

返回文章
返回