高级检索
王宏伟,李 进,闫志蕊,等. 基于图像与点云融合的巷道锚护孔位识别定位方法[J]. 煤炭科学技术,2024,52(5):249−261. doi: 10.12438/cst.2023-1050
引用本文: 王宏伟,李 进,闫志蕊,等. 基于图像与点云融合的巷道锚护孔位识别定位方法[J]. 煤炭科学技术,2024,52(5):249−261. doi: 10.12438/cst.2023-1050
WANG Hongwei,LI Jin,YAN Zhirui,et al. Roadway anchor hole recognition and positioning method based on image and point cloud fusion[J]. Coal Science and Technology,2024,52(5):249−261. doi: 10.12438/cst.2023-1050
Citation: WANG Hongwei,LI Jin,YAN Zhirui,et al. Roadway anchor hole recognition and positioning method based on image and point cloud fusion[J]. Coal Science and Technology,2024,52(5):249−261. doi: 10.12438/cst.2023-1050

基于图像与点云融合的巷道锚护孔位识别定位方法

Roadway anchor hole recognition and positioning method based on image and point cloud fusion

  • 摘要: 煤矿掘进巷道锚护位置的精准识别与定位是钻锚机器人实现智能永久支护亟需突破的关键技术。笔者提出一种基于视觉图像与激光点云融合的巷道锚护孔位智能识别定位方法,包括图像目标识别、点云图像特征融合和定位坐标提取3个步骤:①针对煤矿井下低照度、水雾和粉尘等环境因素导致的锚孔轮廓成像模糊的问题,采用IA(Image-Adaptive)-SimAM-YOLOv7-tiny 网络对巷道待锚护孔位进行视觉识别,该网络能够自适应地增强图像亮度和对比度,恢复锚孔边缘的高频信息,并使模型重点关注锚孔特征,提高锚孔检测的成功率;②求解激光雷达和工业相机联合标定的外参矩阵,将图像检测的锚孔边界框通过透视投影关系生成锥形感兴趣区域(Region Of Interest,ROI),获得对应的目标点云团簇;③采用点云处理算法提取锚护孔位边界点云,获得孔位中心坐标及其法向量,并通过坐标深度差比较判断锚孔识别的正确性。文中搭建了锚杆台车机械臂钻孔定位系统,对算法自主定位的精度以及准确度进行验证,试验结果表明:IA-SimAM-YOLOv7-tiny模型的平均精度均值(Mean Average Precision,mAP)为87.3%,较YOLOv7-tiny模型提高了4.6%;提出的融合算法定位误差为3 mm,单锚孔情况下系统平均识别时间为0.77 s,与单一视觉方法相比,采用激光与视觉多源融合不仅可以降低环境和小样本训练对定位性能的影响,而且可以获得锚护孔位的法向量,为机械臂调整钻孔位姿实现精准锚固提供依据。

     

    Abstract: The accurate identification and positioning of the anchor position of the coal mine tunneling roadway is the key technology that the drilling anchor robot urgently needs to break through to achieve intelligent permanent support. An intelligent identification and positioning method for roadway anchor hole position based on visual image and laser point cloud fusion is proposed, which includes three steps: image target recognition, point cloud image feature fusion, and positioning coordinate extraction: ① In order to solve the problem of blurred image of anchor hole contour caused by environmental factors such as low illumination, water mist and dust in coal mines, the IA (Image-Adaptive)-SimAM-YOLOv7-tiny network was used to visually identify the position of the anchor hole to be anchored in the roadway, which can adaptively enhance the image brightness and contrast, recover the high-frequency information at the edge of the anchor hole, and make the model focus on the characteristics of the anchor hole, so as to improve the success rate of anchor hole detection; ② The Region of Interest (ROI) of image detection is generated by perspective projection relationship to generate a cone-shaped area of interest to obtain the corresponding target point cloud cluster; ③ The point cloud processing algorithm is used to extract the anchor hole boundary point cloud, obtain the central coordinates of the hole position and its normal vector, and judge the correctness of the anchor hole recognition by comparing the coordinate depth difference. In this paper, a drilling and positioning system for bolting trolley manipulator is built to verify the accuracy and accuracy of the algorithm's autonomous positioning, and the experimental results show that the mean average precision (mAP) of the IA-SimAM-YOLOv7-tiny model is 87.3%, which is 4.6% higher than that of the YOLOv7-tiny model. Compared with the single vision method, the fusion algorithm proposed in this paper has a positioning error of 3 mm, and the average recognition time of the system in the case of a single anchor hole is 0.77 s, compared with the single vision method, the fusion of laser and visual multi-source can not only reduce the influence of environment and small sample training on positioning performance, but also obtain the normal vector of the anchor hole position, which provides a basis for the manipulator to adjust the drilling posture to achieve accurate anchoring.

     

/

返回文章
返回