煤矿井下掘进机位姿视觉测量系统相机在线标定方法

Online camera calibration method for pose vision measurement system of roadheader in underground coal mines

  • 摘要: 视觉测量因其系统简单、非接触测量而被广泛应用于煤矿井下掘进机位姿测量,但视觉测量精度受到相机参数标定精度的影响,而井下复杂工况、光照不均及危险区域等因素导致掘进机位姿视觉测量系统相机标定精度低且标定困难。为提高井下掘进机位姿视觉测量系统相机标定自动化水平、标定精度和标定速度,提出一种掘进机位姿视觉测量系统相机在线自动标定方法。以掘进机位姿视觉测量系统的红外标靶作为标定目标,基于二次曲线极点极线约束以及直线射影变换交比不变性质构造标靶平面及其对应像平面上的虚拟点线特征,完成标靶平面及其对应像平面间的点线特征映射,并建立基于点线双特征约束的相机参数单应性求解模型,求解出相机参数的线性解。考虑镜头畸变影响,引入点特征的最小化重投影误差及线特征的直线间距离误差,建立包含动态权重系数和约束的组合目标函数,以单应性求解模型得出的相机参数的线性解为优化初始值,采用非线性迭代优化算法做进一步优化,得到优化后的相机标定结果。开展了标定视图数及噪声对不同标定方法标定精度影响的仿真分析,与其他方法相比,此方法只需要较少视图数时,标定误差趋向收敛,且具有较好的抗噪性能。搭建掘进机位姿视觉测量试验平台,对不同方法进行了相机标定试验并应用此方法完成位姿测量试验,结果表明:此方法获得的相机参数与真实值误差较小,fxfyu0v0k1k2的相对误差分别为1.155%、1.144%、0.463%、0.450%、1.887%、4.082%,平均重投影误差为0.197 像素,位姿测量试验验证了标定方法的有效性,实现了井下掘进机位姿视觉测量系统相机在线标定,为高精度的位姿视觉测量提供了重要支撑。

     

    Abstract: Visual measurement is widely used for the position and orientation measurement of roadheaders in coal mines due to its simple system and non-contact nature. However, the accuracy of visual measurement is affected by the calibration precision of camera parameters. The complex working conditions underground, uneven lighting, and hazardous areas lead to low calibration accuracy and difficulties in calibrating the cameras of the visual measurement system for roadheader position and orientation. To improve the automation level, calibration accuracy, and calibration speed of the camera calibration in underground roadheader pose visual measurement systems, an online automatic camera calibration method for roadheader pose vision measurement systems is proposed. Using the infrared target of the roadheader pose visual measurement system as the calibration target, a virtual point-line feature is constructed on the target plane and its corresponding image plane based on the constraints of the conic pole-polar line and the invariance of the cross ratio in projective transformation of straight lines. This allows the mapping of point-line features between the target plane and its corresponding image plane. A camera parameter homography solving model based on point-line dual feature constraints is then established to solve the linear solution for the camera parameters. Considering the influence of lens distortion, the minimisation of the re-projection error for point features and the line-to-line distance error for line features are introduced. A combined objective function is established, incorporating dynamic weight coefficients and constraints. Using the linear solution for the camera parameters derived from the homography solving model as the initial optimisation value, a nonlinear iterative optimisation algorithm is applied for further refinement, ultimately obtaining the optimised camera calibration results. A simulation analysis was conducted to examine the impact of the number of calibration views and noise on the calibration accuracy of different methods. Compared to other approaches, this method achieves convergence of calibration error with fewer views and demonstrates better noise robustness. An experimental platform for roadheader pose visual measurement was established, and camera calibration experiments were conducted using different methods. This method was applied to complete the pose measurement experiment. The results show that the camera parameters obtained using this method have a small error compared to the true values. The relative errors for fx, fy, u0, v0, k1 and k2 are 1.155%, 1.144%, 0.463%, 0.450%, 1.887%, and 4.082%, respectively. The average re-projection error is 0.197 pixel. The pose measurement experiment verified the effectiveness of the calibration method and successfully achieved online camera calibration for the underground roadheader pose visual measurement system, and provides an important support for high-precision pose visual measurement.

     

/

返回文章
返回