面向煤矿复杂空间任务的人机XR共融精准作业方法

A human-machine XR collaborative precise operation method aimed at complex spatial tasks in coal mines

  • 摘要: 人机协作是煤矿机器人精准完成煤矿复杂作业任务的关键技术之一。为解决煤矿复杂作业任务人机协作存在的机器人对任务和环境信息感知能力不足、人机间通讯交流困难以及机器人自主规划控制能力不足等问题,提出了人机拓展现实技术(XR)共融精准作业方法,包括基于“人–机−任务”多智能体理论的虚实空间描述方法、基于“人–AR”虚实协同的空间任务编程测量方法和基于 VR 的“机–人”虚实协同精准解算与规划作业方法。基于“人–机−任务”多智能体理论的虚实空间描述方法是利用所构建智能体映射实际物体,获得底盘路径规划和机械臂轨迹规划所需要的目标和环境信息,提高机器人对任务和环境信息的感知理解能力。基于“人–AR”虚实协同的空间任务编程测量方法是利用人的主观感知决策能力对物体进行编程标记并从基准坐标系转换到机器人坐标系,再通过智能体传递给机器人,提高了人机间的通讯交流能力。基于 VR 的“机–人”虚实协同精准解算与规划作业方法是根据目标和环境信息以及编程标记,自主规划机器人底盘路径和机械臂轨迹并显示在AR中,提高机器人的运动规划能力,并且人可以通过AR对规划结果进行修改,提高了机器人的自主规划控制能力。搭建模拟煤矿作业环境的试验场地,开展虚实空间编程测量试验、机器人在线精准解算与规划试验和采煤机滚筒焊接场景人机协作试验。结果表明,基于“人–AR”虚实协同的空间任务编程测量方法感知精度服从正态分布误差均值–0.21 mm,标准差1.59 mm,最大误差4.1 mm;基于 VR 的“机–人”虚实协同精准解算与规划作业方法可以实现机器人自主规划控制,且作业精度服从正态分布,误差均值为0.245 58 mm,标准差1.678 06 mm,最大误差5.446 45 mm。应用人机XR共融精准作业方法执行煤矿复杂环境下的人机协作任务,可以不受其恶劣环境条件影响辅助机器人完成对任务和环境信息感知的感知,机器人根据感知结果自主规划底盘路径和机械臂轨迹并执行作业任务,且机器人的作业精度能够达到正常非煤矿场景中的作业精度,相较于传统煤矿场景中人机协作的作业精度更高。

     

    Abstract: Human-machine collaboration is one of the key technologies for robots to accurately complete complex operational tasks in coal mines. To address the challenges in human-machine collaboration for complex tasks, such as robots’ insufficient ability to perceive task and environmental information, difficulty in communication between humans and machines, and inadequate autonomous planning and control capabilities of robots, a method of human-machine extended reality (XR) collaborative precision operation is proposed. This includes a virtual-real space description method based on multi-agent theory of ‘human-machine-task’, a spatial task programming and measurement method based on ‘human-AR’ virtual-real collaboration, and a VR-based ‘machine-human’ virtual-real collaborative precise calculation and planning method. The virtual-real space description method based on ‘human-machine-task’ multi-agent theory utilizes constructed agents to map actual objects, acquiring the necessary target and environmental information for chassis path planning and robotic arm trajectory planning, thereby enhancing the robot’s perceptual understanding of task and environment information. The spatial task programming and measurement method based on ‘human-AR’ virtual-real collaboration leverages human subjective perception and decision-making abilities to program and tag objects, converting coordinates from a reference coordinate system to the robot coordinate system, which improves communication capabilities between humans and robots. The VR-based ‘machine-human’ virtual-real collaborative precise calculation and planning method autonomously plans the chassis path and robotic arm trajectory based on target and environmental information as well as programming tags, displaying the results in AR, which enhances the robot’s motion planning capabilities, while allowing humans to modify the planning results through AR, thereby improving the robot’s autonomous planning and control capabilities. A simulated coal mine operational environment experimental site was set up to conduct virtual-real spatial programming and measurement experiments, online precise calculation and planning experiments of robots, and human-machine collaboration experiments for the welding scenario of coal mining machine drums. The results indicate that the perception accuracy of the spatial task programming and measurement method based on ‘human-AR’ follows a normal distribution with a mean error of –0.21 mm, a standard deviation of 1.59 mm, and a maximum error of 4.1 mm; the VR-based ‘machine-human’ virtual-real collaborative precise calculation and planning method achieves autonomous robot planning and control, with operational accuracy also following a normal distribution, a mean error of 0.245 58 mm, a standard deviation of 1.678 06 mm, and a maximum error of 5.446 45 mm. The application of human-machine XR integration precision operation methods to execute human-machine collaboration tasks in complex coal mine environments allows robots to assist in completing perception of tasks and environmental information without being affected by harsh environmental conditions. The robots autonomously plan the chassis path and robotic arm trajectory based on the perception results and perform operational tasks, achieving operational accuracy that can reach the level of normal non-coal mine scenarios, thus exceeding the operational accuracy of human-machine collaboration in traditional coal mine settings.

     

/

返回文章
返回