高级检索

融合运动先验与LSTM的掘进机视觉−惯性组合定位方法

Roadheader visual−inertial integrated positioning method fusing motion priors and LSTM

  • 摘要: 煤矿井下空间狭窄、煤尘弥漫、光照不均的极端环境导致全球导航卫星系统信号失效,超宽带等无线定位技术易受多径效应与金属遮挡干扰,实现掘进机等移动装备的精准稳定定位已成为煤矿智能化开采的核心难题。针对井下复杂环境下视觉特征匹配易受干扰、惯性测量单元(Inertial Measurement Unit, IMU)误差累积导致定位精度退化的问题,提出一种融合运动先验与长短期记忆(Long Short-Term Memory, LSTM)网络的视觉−惯性组合定位方法。在视觉前端,设计基于IMU运动先验的感兴趣区域(Region of Interest, ROI)生成机制,利用IMU预积分信息预测相机运动并形成局部ROI以约束特征搜索范围;结合双层概率模型从外观相似性与运动一致性维度对候选特征进行联合评估,剔除误匹配点对。在后端融合中,构建扩展卡尔曼滤波(Extended Kalman Filter, EKF)与LSTM级联的误差补偿框架:前端EKF实现IMU状态初步估计,并与视觉观测进行紧耦合融合;后端LSTM网络对EKF残差中的非线性误差进行深度时序建模,预测位置误差补偿量并反馈至EKF前端。同时设计三级闭环优化机制,通过自适应协方差重置、滑动窗口平滑与偏置在线标定,实现后端补偿与前端修正的深度协同。在EuRoC公开数据集上的实验结果表明:所提方法在MH_01与V1_01序列上的绝对轨迹误差分别为0.130和0.251 m,与先进算法Air-SLAM精度相当。在模拟煤矿井下环境的自主采集数据集中,正常巷道工况下定位误差为0.705 m,较Air-SLAM提升5.4%;在喷雾模拟粉尘与强光干扰工况下定位误差为0.820 m,较Air-SLAM提升12.8%。在视觉退化严重时段,LSTM模块将平均定位误差从0.508 m降低至0.319 m,优化幅度达37.2%。研究表明:该方法能够有效抑制井下复杂环境下的特征误匹配与IMU累积漂移,显著提升定位系统在极端工况下的精度与鲁棒性,为掘进设备长距离自主导航提供技术支撑。

     

    Abstract: The extreme environment of underground coal mines, characterized by narrow spaces, coal dust, and uneven illumination, renders Global Navigation Satellite System (GNSS) signals ineffective. Furthermore, wireless positioning technologies such as Ultra-Wideband (UWB) are susceptible to multipath effects and obstructions from metallic structures. Consequently, achieving accurate and stable positioning for mobile equipment like roadheaders has become a critical challenge for intelligent mining. To address the degradation of positioning accuracy caused by susceptibility to interference in visual feature matching and the error accumulation of Inertial Measurement Units (IMU) in such complex underground environments, a visual-inertial integrated positioning method fusing motion priors and a Long Short-Term Memory (LSTM) network is proposed. In the visual front-end, a Region of Interest (ROI) generation mechanism based on IMU motion priors is designed. IMU pre-integration information is utilized to predict camera motion and establish a local ROI to constrain the feature search range. A two-layer probabilistic model is then introduced to jointly evaluate candidate features from the dimensions of appearance similarity and motion consistency, thereby eliminating mismatched point pairs. For back-end fusion, an error compensation framework cascading an Extended Kalman Filter (EKF) and an LSTM network is constructed. The front-end EKF performs preliminary IMU state estimation and tightly-coupled fusion with visual observations. Subsequently, the back-end LSTM network conducts deep temporal modeling of the nonlinear errors present in the EKF residuals, predicting the position error compensation, which is then fed back to the EKF front-end. Simultaneously, a three-level closed-loop optimization mechanism is designed to achieve deep synergy between back-end compensation and front-end correction through adaptive covariance resetting, sliding window smoothing, and online bias calibration. Experimental results on the EuRoC public dataset demonstrate that the proposed method achieves absolute trajectory errors of 0.130 and 0.251 m on the MH_01 and V1_01 sequences, respectively, which is comparable in accuracy to the advanced algorithm Air-SLAM. On a self-collected dataset simulating an underground coal mine environment, the positioning error under normal roadway conditions is 0.705 m, representing a 5.4% improvement over Air-SLAM. Under conditions simulating dust and intense light interference, the positioning error is 0.820 m, a 12.8% improvement over Air-SLAM. During periods of severe visual degradation, the LSTM module reduces the average positioning error from 0.508 m to 0.319 m, an optimization margin of 37.2%. Results show that the proposed method can effectively suppress feature mismatches and IMU cumulative drift in complex underground environments, significantly enhancing the accuracy and robustness of the positioning system under extreme conditions, thereby providing technical support for the long-distance autonomous navigation of roadheading equipment.

     

/

返回文章
返回