Advance Search

WU Ligang,CHEN Le,LYU Yuanyuan,et al. A lightweight-based method for real-time monitoring of lump coal on conveyor belts[J]. Coal Science and Technology,2023,51(S2):285−293

. DOI: 10.12438/cst.2023-1217
Citation:

WU Ligang,CHEN Le,LYU Yuanyuan,et al. A lightweight-based method for real-time monitoring of lump coal on conveyor belts[J]. Coal Science and Technology,2023,51(S2):285−293

. DOI: 10.12438/cst.2023-1217

A lightweight-based method for real-time monitoring of lump coal on conveyor belts

Funds: 

2022 Shanxi Provincial Basic Research Program Funding Project (202303021211330); 2022 Shanxi Province Higher Education Science and Technology Innovation Plan Innovation Platform Funding Project (2022P009)

More Information
  • Received Date: August 25, 2023
  • Available Online: March 13, 2024
  • Coal is an essential national energy source, which is mainly conveyed by the conveyor belts in the process of coal production and transportation. However, when transferred by means of the conveyor belt, lump of coal affects the safe operation of the conveyor belt. For the problem of lump coal monitoring during coal transportation, so the AMGC YOLOv5(AHE Mosaic Ghost CBAM YOLOv5) lightweight neural network based method for the real time monitoring of lump coal on conveyor belt is proposed. First, Image data pre-processing using adaptive histogram equalization (AHE), reducing the impact of coal dust, dust and underground coal mine light on target monitoring, and to enhance the clarity and contrast of the data set. At the same time combined with Mosaic data to increase the richness of the data set. Subsequently, The Ghost Net lightweight neural network is introduced to make full use of the relationship between feature extraction and redundancy characteristics of feature maps, and combine traditional convolutional operation with lightweight linear operation, which greatly reduces the number of parameters of the model and the amount of floating point computation while ensuring the detection precision. Eventually, combined with Convolutional Block Attention Module (CBAM) mechanism to complete the channel feature extraction and spatial feature extraction sequentially. To enhance the feature extraction process, improve the ability to characterize, and reduce interference from background images. The experimental results showed that: The improved AMGC YOLOv5 algorithm in terms of model lightweight, The number of network layers is reduced by 145, and the model volume is compressed by 58.8 M.The number of parameters and floating point calculations are cut by about 63.60% and 68.86%.Training hours were reduced by about 0.76 hours , and GPU usage was reduced by about 21.78%.In addition, in terms of model performance, Precision was improved by about 0.91%, and real-time monitoring efficiency was improved by about 38.05% from 68.34 FPS to 94.34 FPS. It can be seen that AMGC YOLOv5 not only realizes lightweight, but also can effectively improve the model's various detection performance.

  • [1]
    毕东月. 基于深度学习的输煤皮带故障视觉检测方法研究[J]. 中国安全生产科学技术,2021,17(8):84−90. doi: 10.11731/j.issn.1673-193x.2021.08.013

    BI Dongyue. Research on visual detection method for fault of coal conveyor belt based on deep learning[J]. Journal of Safety Science and Technology,2021,17(8):84−90. doi: 10.11731/j.issn.1673-193x.2021.08.013
    [2]
    任怀伟,王国法,赵国瑞,等. 智慧煤矿信息逻辑模型及开采系统决策控制方法[J]. 煤炭学报,2019,44(9):2923−2935.

    REN Huaiwei,WANG Guofa,ZHAO Guorui,et al. Smart coal mine logic model and decision control method of mining system[J]. Journal of China Coal Society,2019,44(9):2923−2935.
    [3]
    张 佳, 尹君驰, 王 宏, 等. 输送带输煤采样技术研究现状及发展趋势[J]. 煤炭科学技术,2022,50(9):200−206.

    ZHANC Jia, YIN Junchi, WANC Hong, et al. Research status and development trend of belt coal sampling technology[J]. Coal Science and Technology,2022,50(9):200−206.
    [4]
    王海军, 王洪磊. 带式输送机智能化关键技术现状与展望[J]. 煤炭科学技术,2022,50(12):225−239.

    WANG Haijun, WANG Honglei. Status and prospect of intelligent key technologies of belt conveyorr[J]. Coal Science and Technology,2022,50(12):225−239.
    [5]
    章 赛,纪 凡,卢才武,等. 低照度下改进YOLOX的煤矿无人电机车轨道障碍物检测方法[J/OL]. 安全与环境学报,2013:1−12. https//DOI: 10.13637/j.issn.1009-6094.2023.0349.

    ZHANG Sai,JI Fan,LU Caiwu, et al. An improved YOLOX detection method for tracking obstacles of unmanned electric locomotive in coal mines under low lighting [J/OL]. Journal of Safety and Environment,2013:1−12. https//DOI: 10.13637/j.issn.1009-6094.2023.0349.
    [6]
    毛清华,李世坤,胡 鑫,等. 基于改进YOLOv7的煤矿带式输送机异物识别[J]. 工矿自动化,2022,48(12):26−32.

    MAO Qinghua,LI Shikun,HU Xin,et al. Foreign object recognition of belt conveyor in coal mine based on improved YOLOv7[J]. Journal of Mine Automation,2022,48(12):26−32.
    [7]
    郝 帅,张 旭,马 旭,等. 基于CBAM-YOLOv5的煤矿输送带异物检测[J]. 煤炭学报,2022,47(11):4147−4156.

    HAO Shuai,ZHANG Xu,MA Xu,et al. Foreign object detection in coal mine conveyor belt based on CBAM-YOLOv5[J]. Journal of China Coal Society,2022,47(11):4147−4156.
    [8]
    蔡秀凡,谢金辰. YOLOv4煤矸石石检测方法研究[J]. 煤炭工程,2022,54(8):157−162.

    CAI Xiufan,XIE Jinchen. YOLOv4-based detection method of coal and gangue[J]. Coal Engineering,2022,54(8):157−162.
    [9]
    张 渤,谢金辰,张后斌. 矿井下输送带大块物体检测[J]. 煤炭技术,2021,40(4):154−156

    ZHANG Bo,XIE Jinchen,ZHANG Houbin. Detection of large objects in transportation belt undermine[J]. Coal Technology,2021,40(4):154−156.
    [10]
    吴守鹏,丁恩杰,俞 啸. 基于改进FPN的输送带异物识别方法[J]. 煤矿安全,2019,50(12):127−130.

    WU Shoupeng,DING Enjie,YU Xiao. Foreign body identification of belt based on improved FPN[J]. Safety in Coal Mines,2019,50(12):127−130.
    [11]
    WANG F Y,ZHANG Z G,LI R F, et al. Coal falling abnormal detection based on image similarity in power plant[A]. 2022 5th International Conference on Energy,Electrical and Power Engineering (CEEPE)[C]. 2022:1087−1090.
    [12]
    刘普壮. 基于改进YOLO算法的煤矸石识别方法与实验研究[D]. 淮南:安徽理工大学,2022.

    LIU Puzhuang. Research on coal and gangue recognition method and experiment based on improved YOLO algorithm [D]. Huainan:AnHui University of Science and Technology,2022.
    [13]
    BO J W,ZHANG C T,FAN C L,et al. Ore conveyor belt sundries detection based on improved YOLOv3[J]. Computer Engineering and Applications,2021,57(21):248−255.
    [14]
    杜京义,陈 瑞,郝 乐,等. 煤矿带式输送机异物检测[J]. 工矿自动化,2021,47(8):77−83.

    DU Jingyi,CHEN Rui,HAO Le,et al. Coal mine belt conveyor foreign object detection[J]. Journal of Mine Automation,2021,47(8):77−83.
    [15]
    胡璟皓,高 妍,张红娟,等. 基于深度学习的带式输送机非煤异物识别方法[J]. 工矿自动化,2021,47(6):57−62,90.

    Hu Jinghao,GAO Yan,ZHANG Hongjuan,et al. Research on the identification method of non-coal foreign object of belt conveyor based on deep learning[J]. Journal of Mine Automation,2021,47(6):57−62,90.
    [16]
    WU L,LYU Y,CHEN L,et al. Detection of lump coal based on lightweight network and attention mechanism[C]//2023 China Automation Congress (CAC),Chongqing,China,2023:5489−5494.
    [17]
    ALEXEY B,WANG C Y,LIAO H Y M. YOLOv4:optimal speed and precision of object detection[C]//2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); Image and Video Processing (eess. IV),2020:2004.10934.
    [18]
    HAN Kai ,WANG Yunhe ,TIAN Qi , et al. Ghost Net:more features from cheap operations[C]//2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR),2020 :1580−1589.
    [19]
    WOO S,PARK J,LEE J Y, et al. CBAM:convolutional block attention module[C]//The 15th European Conference,Munich,Germany:Springer 2018,3−19.
    [20]
    吴利刚,张 梁. 基于轻量化神经网络的石窟壁画破损检测方法[J/OL]. 信息与控制,2023:1−11. https://doi. org/ 10.13976/j. cnki. xk. 2023.2456.

    WU Ligang,ZHANG Liang. Damage detection method for grotto murals based on lightweight neural Network [J/OL]. Information and Control,2023:1−11.https//doi.org/10.13976/j.cnki.xk.2023.2456.
    [21]
    WU L,ZHANG L,CHEN L,et al. A Lightweight and multisource information fusion method for real-time monitoring of lump coal on mining conveyor belts[J]. International Journal of Intelligent Systems,2023,5327122:1−11 .
    [22]
    吴利刚,陈 乐,张 梁,等. 基于轻量化与多信息融合的输送带块煤实时监测方法[J/OL]. 控制工程,2023:1-8. https://doi. org/10.14107/ j. cnki. kzgc. 20230434.

    WU Ligang,CHEN Le. Real time monitoring method of lump coal on conveyor belt based on lightweight and vulti-information Fusion [J/OL]. Control Engineering of China,2023:1-8. https//doi.org/10.14107/j.cnki.kzgc.20230434.
    [23]
    任志玲,朱彦存. 改进CenterNet算法的煤矿皮带运输异物识别研究[J]. 控制工程,2023,30(4):703−711.

    REN Zhiling,ZHU Yancun. Research on foreign object detection of coal mine belt transportation with improved CenterNet algorithm[J]. Control Engineering,2023,30(4):703−711.
    [24]
    谭 恒,张红娟,靳宝全,等. 基于机器视觉的煤矿带式输送机跑偏检测方法[J]. 煤炭技术,2021,40(5):152−156.

    TAN Heng,ZHANG Hongjuan,JIN Baoquan,et al. Method for detecting deviation of coal mine belt conveyor based on machine vision[J]. Coal Technology,2021,40(5):152−156.
    [25]
    张旭辉,闫建星,张 超,等. 基于改进YOLOv5s+DeepSORT的煤块行为异常识别[J]. 工矿自动化,2022,48(6):77−86,117.

    ZHANG Xuhui,YAN Jianxing,ZHANG Chao,et al. Coal block abnormal behavior identification based on improved YOLOv5s + DeepSORT[J]. Journal of Mine Automation,2022,48(6):77−86,117.
  • Cited by

    Periodical cited type(1)

    1. 王希如,贾仁山,曹玉莹,刘银川,高新悦,吴佳鑫,贾银江. 应用MCCW-YOLOv7-tiny研究轻量级玉米田间杂草识别算法. 东北农业大学学报. 2025(01): 124-138 .

    Other cited types(1)

Catalog

    Article views (70) PDF downloads (22) Cited by(2)
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return