改进SURF−FLANN的综采工作面视频拼接特征提取与匹配算法

Improved SURF−FLANN feature extraction and matching algorithm for video stitching of fully-mechanized working face

  • 摘要: 针对目前视频拼接技术中的主要问题,即SURF(Speed Up Robust Features)特征提取算法与FLANN(Fast Library or Approximate Nearest Neighbors)特征匹配算法在综采工作面恶劣环境中存在特征点误提取和特征点匹配正确率低的问题,提出一种改进SURF−FLANN的综采工作面视频拼接特征提取与匹配算法。为了提高特征点提取正确率,该方法通过将传统的高斯滤波换为更为先进的双边滤波提取图像中的SURF关键特征点,同时在特征向量中引入特征点4−领域内的特征点描述符信息,从而改进了描述符算子,进一步提高了特征点的描述能力。为了提升特征点匹配速度,提出了R−FLANN(Random Sample Consensus−Fast Library or Approximate Nearest Neighbors)特征匹配算法,该算法利用 RANSAC算法获取特征点的匹配先验信息剔除无匹配、误匹配的特征点,从而提高特征点匹配速度。为了验证改进效果,通过消融试验验证了改进SURF−FLANN的特征提取与匹配算法有效提升综采工作面视频图像特征提取和匹配正确率。通过本文方法与SIFT+FLANN,Hairrs与SURF+FLANN的特征提取与匹配算法进行特征点提取与匹配的对比试验,结果表明本文方法特征提取与匹配平均正确率和平均匹配速度最高,分别达到了81.47%和51.47帧/s。通过运用本文方法与SIFT+FLANN,Hairrs与SURF+FLANN的特征提取与匹配算法进行视频图像拼接对比试验,结果表明本文提出的方法在拼接效果清晰度、对比度、熵、拼接速率指标都最好,得到了最佳效果。

     

    Abstract: The SURF (Speed Up Robust Features) feature extraction algorithm and FLANN (Fast Library or Approximate Nearest Neighbors) feature matching algorithm in current video stitching technology have the problems of feature point extraction errors and low feature point matching accuracy in harsh environments of fully-mechanized working face. An improved SURF−FLANN feature extraction and matching algorithm for video stitching of fully-mechanized working face is proposed. To improve the accuracy of feature point extraction, the improved algorithm extracts SURF key feature points of video images by changing conventional Gaussian filter to advanced bilateral filter, and improves the descriptor operator by adding feature point 4−domain feature point descriptor information to the feature vector. This improvement further improves the description of feature points. To improve the speed of feature point matching, The R−FLANN (Random sample consensus-Fast library or approximate nearest neighbors) feature matching algorithm is proposed. The R−FLANN algorithm uses RANSAC algorithm to get the matching prior information of feature points and eliminate the unmatched and mismatched feature points to improve matching speed of feature points. In order to verify the improvement effect, ablation experiments are conducted to verify that the improved SURF−FLANN feature extraction and matching algorithm effectively enhances the feature extraction and matching accuracy of video images of fully-mechanized working faces. Comparison experiments of feature point extraction and matching are carried out by the proposed method with SIFT+FLANN, Hairrs and SURF+FLANN feature extraction and matching algorithms, and the results indicate that the proposed method has the highest feature extraction and matching accuracy and matching speed, with the accuracy and matching speed reaching 81.47% and 51.47fps.Video image stitching comparison experiments are carried out by the proposed method with SIFT+FLANN, Hairrs and SURF+FLANN feature extraction and matching algorithms, the results indicate the proposed method has the best stitching performance in terms of clarity, contrast, entropy, and stitching speed.The best results are obtained.

     

/

返回文章
返回