Key technology of video structured analysis in mine production operation scenario

With the increasing applications of technologies such as 5G communication, edge computing, big data, and artificial intelligence in the coal mine production scenarios, the types of video equipment and functional systems have dramatically increased.To enhance the capacity of collaborative management and control and the level of intelligent decision-making for mining safe production, as well as to simultaneously solve the problems of low intelligence level, poor perception for deep information, and weak decision-making ability in all business systems throughout the mining production process, it is necessary to study the intelligent application of the video structured technology in different production scenarios in-depth, and establish a video structured analysis system for the intelligent mine with the abilities of cross-scenario situational awareness and collaboration, as well as the status monitoring of whole production process.This paper suggests to analyze the video data from five dimensions, i.e., person, machine, material, regulation, and circumstance, and then proposes to utilize the scenario recognition and rule modeling technologies to meet the business requirements of complex mine scenarios.Furthermore, the structural features of mine production business and rules are modeled to comprehensively analyze and hierarchically index the target features in terms of time, space and semantics.Based on the cloud-edge collaboration architecture, a cloud-edge collaboration video structured analysis platform for full-type structured data transmission, full-scenario semantic information fusion, and full-process production risk management is studied.This platform, empowered with the perception data upload and rule models download, is able to construct an unstructured data governance mode that conforms to the mine characteristics.Based on the in-depth analysis of mine safe production requirements and the technical characteristics of video structured analysis, this paper proposes to study the key technologies including video structured analysis mechanism, cognitive and rule modeling technology, personnel safety behavior analysis and supervision technology, equipment status joint analysis technology, and emergency coordination and linkage technology in the mine operation scenarios.These technologies are of great significance to build the mining video structural analysis system with the functions of both human supervision and production monitoring and boost the development of mining production systems from the local informatization to the collaborative intelligence of multi-system.