Advance Search
JIANG Song,CUI Zhixiang,DAI Bibo,et al. SLAM-based localization method of coal mine underground robot with adaptability to dark illumination environment[J]. Coal Science and Technology,2025,53(5):349−361. DOI: 10.12438/cst.2024-0181
Citation: JIANG Song,CUI Zhixiang,DAI Bibo,et al. SLAM-based localization method of coal mine underground robot with adaptability to dark illumination environment[J]. Coal Science and Technology,2025,53(5):349−361. DOI: 10.12438/cst.2024-0181

SLAM-based localization method of coal mine underground robot with adaptability to dark illumination environment

More Information
  • Received Date: February 02, 2024
  • Available Online: May 09, 2025
  • Under the background of intelligent mine construction, the application of intelligent equipment has increasingly become the main content of mine intelligent transformation. Intelligent robots in coal mine that are designed for inspecting and dangerous area surveying and doing other tasks depends on the construction of digital map of underground coal mine and the localizing of the robot itself. But most of the traditional localizing methods are inefficient or even ineffective in the underground. Simultaneous Localization and Mapping (SLAM) has become a better choice for underground intelligent robot localization methods. However, due to the high cost of lidar and the poor performance of camera in low illumination environment, it is necessary to design a SLAM localization method that takes into account both low cost and adaptability to low illumination environment. Therefore, a localization method of robot with underground dark light environment adaptability in coal mine is proposed. Firstly, the real images of the gallery of a coal mine in Fengxian County, Baoji City, Shaanxi Province and the dataset of the camera and IMU required for SLAM were collected. According to the images, non-matching dark light and normal light dataset was made, and 3560 images were obtained after data amplification. An EnlightenGAN image enhancement network combined with self-attention module is designed, which takes into account the dependence of different regions of the image without relying on the paired dataset. Based on the ORB–SLAM3 framework, the whole local image detection is introduced to screen the input image, and an improved IMU initialization strategy based on analytical solution is introduced to improve the initialization speed, and the improved image enhancement network is transplanted to enhance the low illumination and uneven illumination images. Experiments on the EuRoC dataset show that the image enhancement-based underground coal mine robot localization method can reduce ERMS by 12.17% and ESD by 14.35% in low-light environments. In two actual coal mine roadway scenarios, the low-light environment can be identified, and the increasing number of feature points are extracted and the drift phenomenon of positioning trajectory is reduced by the SLAM system and. Finally, the localizing effect of the system is improved in the dark area of the roadway.

  • [1]
    张守祥,张学亮,张磊,等. 综采巡检机器人关键技术研究[J]. 煤炭科学技术,2022,50(1):247−255.

    ZHANG Shouxiang,ZHANG Xueliang,ZHANG Lei,et al. Research on key technology of patrol robot in fully-mechanized mining face[J]. Coal Science and Technology,2022,50(1):247−255.
    [2]
    TOPOLSKY D,TOPOLSKAYA I,PLAKSINA I,et al. Development of a mobile robot for mine exploration[J]. Processes,2022,10(5):865. doi: 10.3390/pr10050865
    [3]
    CHANG Y,EBADI K,DENNISTON C E,et al. LAMP 2.0:A robust multi-robot SLAM system for operation in challenging large-scale underground environments[J]. IEEE Robotics and Automation Letters,2022,7(4):9175−9182. doi: 10.1109/LRA.2022.3191204
    [4]
    MOKSSIT S,LICEA D B,GUERMAH B,et al. Deep learning techniques for visual SLAM:A survey[J]. IEEE Access,2023,11:20026−20050. doi: 10.1109/ACCESS.2023.3249661
    [5]
    刘毅,贾旭芬,田子建. 一种基于同态滤波原理的井下光照不均图像处理方法[J]. 工矿自动化,2013,39(1):9−12.

    LIU Yi,JIA Xufen,TIAN Zijian. A processing method for underground image of uneven illumination based on homomorphic filtering theory[J]. Industry and Mine Automation,2013,39(1):9−12.
    [6]
    LORE K G,AKINTAYO A,SARKAR S. LLNet:A deep autoencoder approach to natural low-light image enhancement[J]. Pattern Recognition,2017,61:650−662. doi: 10.1016/j.patcog.2016.06.008
    [7]
    ZHANG Y H,GUO X J,MA J Y,et al. Beyond brightening low-light images[J]. International Journal of Computer Vision,2021,129(4):1013−1037. doi: 10.1007/s11263-020-01407-x
    [8]
    孔二伟,张亚邦,李佳悦,等. 面向煤矿井下低光照图像的增强方法[J]. 工矿自动化,2023,49(4):62−69,85.

    KONG Erwei,ZHANG Yabang,LI Jiayue,et al. Enhancement methods for low-light images in coal mines[J]. Industrial and Mining Automation,2023,49(4):62−69,85.
    [9]
    MENG Y Y,KONG D Q,ZHU Z F,et al. From night to day:GANs based low quality image enhancement[J]. Neural Processing Letters,2019,50(1):799−814. doi: 10.1007/s11063-018-09968-2
    [10]
    GOODFELLOW I,POUGET-ABADIE J,MIRZA M,et al. Generative adversarial networks[J]. Communications of the ACM,2020,63(11):139−144. doi: 10.1145/3422622
    [11]
    JIANG Y F,GONG X Y,LIU D,et al. EnlightenGAN:Deep light enhancement without paired supervision[J]. IEEE Transactions on Image Processing,2021,30:2340−2349. doi: 10.1109/TIP.2021.3051462
    [12]
    KLEIN G,MURRAY D. Parallel tracking and mapping for small AR workspaces[C]//2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality. Piscataway,NJ:IEEE,2007:225−234.
    [13]
    ENGEL J,SCHÖPS T,CREMERS D. LSD-SLAM:Large-scale direct monocular SLAM[M]. Cham:Springer International Publishing,2014:834−849.
    [14]
    MUR-ARTAL R,MONTIEL J M M,TARDÓS J D. ORB-SLAM:A versatile and accurate monocular SLAM system[J]. IEEE Transactions on Robotics,2015,31(5):1147−1163. doi: 10.1109/TRO.2015.2463671
    [15]
    MUR-ARTAL R,TARDÓS J D. ORB-SLAM2:An open-source SLAM system for monocular,stereo,and RGB-D cameras[J]. IEEE Transactions on Robotics,2017,33(5):1255−1262. doi: 10.1109/TRO.2017.2705103
    [16]
    郭科,方俊永,王潇,等. 一种视觉SLAM中运动模糊应对方法[J]. 哈尔滨工业大学学报,2019,51(11):116−121.

    GUO Ke,FANG Junyong,WANG Xiao,et al. Algorithm for dealing with motion blur in visual SLAM[J]. Journal of Harbin Institute of Technology,2019,51(11):116−121.
    [17]
    ZHU D X,JI K K,WU D,et al. A coupled visual and inertial measurement units method for locating and mapping in coal mine tunnel[J]. Sensors,2022,22(19):7437. doi: 10.3390/s22197437
    [18]
    高扬,曹王欣,夏洪垚,等. 低可见度环境下基于同步定位与构图的无人驾驶汽车定位算法[J]. 交通运输工程学报,2022,22(3):251−262.

    GAO Yang,CAO Wangxin,XIA Hongyao,et al. A driverless vehicle localization algorithm based on simultaneous localization and mapping in low visibility environment[J]. Journal of Transportation Engineering,2022,22(3):251−262.
    [19]
    CHEN J H,SHEN Y H,ZHU Q X,et al. Motion blur processing method for visual SLAM system based on local residual blur discrimination network[J]. Journal of Mechanical Science and Technology,2022,36(7):3653−3666. doi: 10.1007/s12206-022-0640-6
    [20]
    QUAN Y Z,FU D,CHANG Y F,et al. 3D convolutional neural network for low-light image sequence enhancement in SLAM[J]. Remote Sensing,2022,14(16):3985. doi: 10.3390/rs14163985
    [21]
    ZHANG H,GOODFELLOW I,METAXAS D,et al. Self-attention generative adversarial networks[EB/OL]. (2019−01−14)[2023−09−09]. https://arxiv.org/abs/1805.08318.
    [22]
    ZUÑIGA-NOËL D,MORENO F A,GONZALEZ-JIMENEZ J. An analytical solution to the IMU initialization problem for visual-inertial systems[EB/OL]. 2021:2103.03389. https://arxiv.org/abs/2103.03389v1.
    [23]
    WEI C,WANG W J,YANG W H,et al. Deep retinex decomposition for low-light enhancement[EB/OL]. 2018:1808.04560. https://arxiv.org/abs/1808.04560v1.
    [24]
    GUO C,LI C,GUO J,et al. Zero-reference deep curve estimation for low-light image enhancement[EB/OL]. (2020−01−19)[2023−09−09]. https://arxiv.org/abs/2001.06826v2.
  • Related Articles

    [1]LEI Sheng, ZHANG Jinhu, LI Yanpeng, LIU Peiyuan. Research on image restoration algorithm of uneven illumination in coal mine based on HSV space[J]. COAL SCIENCE AND TECHNOLOGY, 2024, 52(S2): 384-392. DOI: 10.12438/cst.2023-1539
    [2]WANG Yuanbin, GUO Yaru, LIU Jia, WANG Xu, WU Bingchao, LIU Meng. Low illumination image enhancement algorithm of CycleGAN coal mine based on attention mechanism and Dilated convolution[J]. COAL SCIENCE AND TECHNOLOGY, 2024, 52(S2): 375-383. DOI: 10.12438/cst.2023-1597
    [3]TIAN Zijian, YANG Kang, WU Jiaqi, CHEN Wei. LMIENet enhanced object detection method for low light environment inunderground mines[J]. COAL SCIENCE AND TECHNOLOGY, 2024, 52(5): 222-235. DOI: 10.12438/cst.2023-0675
    [4]TIAN Zijian, WU Jiaqi, ZHANG Wenqi, CHEN Wei, ZHOU Tao, YANG Wei, WANG Shuai. An illuminance improvement and details enhancement method on coal mine low-light images based on Transformer and adaptive feature fusion[J]. COAL SCIENCE AND TECHNOLOGY, 2024, 52(1): 297-310. DOI: 10.13199/j.cnki.cst.2023-0112
    [5]WANG Manli, ZHANG Hang, LI Jiayue, ZHANG Changsen. Deep neural network-based image enhancement algorithm for low-illumination images underground coal mines[J]. COAL SCIENCE AND TECHNOLOGY, 2023, 51(9): 231-241. DOI: 10.12438/cst.2022-1626
    [6]GONG Yun, XIE Xinyu. Research on coal mine underground image recognition technology based on homomorphic filtering method[J]. COAL SCIENCE AND TECHNOLOGY, 2023, 51(3): 241-250. DOI: 10.13199/j.cnki.cst.2021-0774
    [7]CHENG Deqiang, QIAN Jiansheng, GUO Xingge, KOU Qiqi, XU Feixiang, GU Jun, GAO Yachao, ZHAO Jinsheng. Review on key technologies of AI recognition for videos in coal mine[J]. COAL SCIENCE AND TECHNOLOGY, 2023, 51(2): 349-365. DOI: 10.13199/j.cnki.cst.2022-0359
    [8]HU Eryi, LI Mengya, WANG Yiran, LYU Donghan, SUN Yizhuang. Research on dust removal method for vision system of coal mine robot[J]. COAL SCIENCE AND TECHNOLOGY, 2020, 48(7).
    [9]HU Eryi, LYU Donghan, WANG Chuntao, SUN Yizhuan, LI Mengya. Design of intelligent safety charging system for coal mining robot[J]. COAL SCIENCE AND TECHNOLOGY, 2020, 48(2).
    [10]ZHAO Xiaohu, LIU Shanshan, SHEN Xueru, YOU Peng. Research on processing algorithm of image in undergroundcoal mine based on CS framework[J]. COAL SCIENCE AND TECHNOLOGY, 2018, (2).
  • Cited by

    Periodical cited type(1)

    1. 朱磊,张潇文,张楠. 基于SLAM的矿井移动机器人定位算法. 金属矿山. 2025(05): 272-277 .

    Other cited types(0)

Catalog

    Article views (49) PDF downloads (22) Cited by(1)
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return