高级检索

低照度煤流异物可见光与红外图像配准融合方法

Visible image and infrared image registration and fusion method in low-illumination coal flow with foreign object detection scene

  • 摘要: 煤矿井下开采环境复杂,普遍存在低照度、高雾尘的工况,此类工况下人工巡检困难且效率低下,因此普遍采用机器视觉检测方法。低照度环境下带式输送机异物入侵机器视觉检测一直面临严峻挑战,具体表现为可见光信息不足,红外图像的灰度信息又缺乏细节纹理,导致识别准确率低、存在漏检现象。为了解决井下低照度环境下视觉感知困难的问题,基于多模态信息的融合理论,研究了一种通过红外图像与可见光图像融合进行图像处理的方法。前端网络配置了煤堆自适应感知配准算法(SuperGlue-CPA),通过椭圆物理约束权重掩膜和分层单应矩阵策略将配准误差降低33.51%,有效特征比提升至95.33%,极大提高了配准的准确率。后端网络配置了多尺度场景适应稀疏语义图像融合算法(MSPFusion),通过引入全局分组坐标注意力模块提高特征表达能力,改进语义注入方式实现全局特征保留与参数解耦,语义感知网络引入多尺度卷积解决识别异物尺度差异问题,将平均交并比提升1.4%,融合信息量提升9.4%,显著增强图像融合算法综合能力。试验结果表明:新的方法显著提升了融合图像的视觉质量,大幅增强异物目标的凸显程度与识别置信度,为井下巡检机器人的视觉应用提供了新的思路,进而减少低照度环境下异物入侵导致的输送带事故,对保障煤矿安全生产与智能化转型具有重要应用价值。

     

    Abstract: The underground coal mining environment is complex and typically characterized by low illumination and high concentrations of fog and dust. Under such working conditions, manual inspection is difficult and inefficient, so machine vision–based detection methods are widely adopted. However, the machine vision detection of foreign object intrusion on belt conveyors under low-illumination conditions has long faced severe challenges. Visible light images lack sufficient information, while infrared images, rich in grayscale data, lack detailed texture, leading to low recognition accuracy and missed detections. To address the difficulties of visual perception in such low-light conditions, an image processing method based on multi-modal information fusion theory, which integrates infrared and visible light images, is proposed. The proposed framework consists of two core components. First, at the front-end, a Coal Pile Adaptive perception registration algorithm (SuperGlue-CPA) is employed. Utilizing an elliptical physical constraint weight mask and a layered homography matrix strategy, this algorithm reduces registration error by 33.51% and increases the effective feature ratio to 95.33, significantly improving registration accuracy. Second, at the back-end, a Multi-scale Scene-adaptive sparse semantic image Fusion algorithm (MSPFusion) is proposed. This algorithm enhances feature representation capability by introducing a Global Grouped Coordinate Attention module. It also improves the semantic injection method to achieve global feature retention and parameter decoupling. Furthermore, its semantic perception network incorporates multi-scale convolutions to address the scale variation of foreign objects. These improvements result in a 1.4% increase in mean Intersection over Union (mIoU) and a 9.4% increase in fused information quantity, markedly enhancing the overall capability of the fusion algorithm. Experiments demonstrate that the proposed method significantly improves the visual quality of fused images and substantially enhances the salience and recognition confidence of foreign objects. This work provides a new approach for the visual applications of underground inspection robots, thereby reducing belt conveyor accidents caused by foreign object intrusion in low-light environments. It holds important application value for ensuring coal mine safety and enabling intelligent transformation.

     

/

返回文章
返回