Advance Search
LI Yongan,CHEN Tengjie,WANG Hongwei,et al. Multi task detection method for operating status of belt conveyor based on DR-YOLOM[J]. Coal Science and Technology,2025,53(S1):454−467. DOI: 10.12438/cst.2024-0566
Citation: LI Yongan,CHEN Tengjie,WANG Hongwei,et al. Multi task detection method for operating status of belt conveyor based on DR-YOLOM[J]. Coal Science and Technology,2025,53(S1):454−467. DOI: 10.12438/cst.2024-0566

Multi task detection method for operating status of belt conveyor based on DR-YOLOM

More Information
  • Received Date: April 28, 2024
  • Available Online: April 18, 2025
  • The detection of the operating status of underground belt conveyors in coal mines is the key to the safe operation of belt conveyors. However, most detection methods for the operating status of belt conveyors can only handle a single detection task, making it difficult to achieve simultaneous detection of multiple tasks. A multi task detection method for the operation status of belt conveyors based on DR-YOLOM is proposed to address the current difficulty in achieving comprehensive detection with existing technologies. A single network is used to simultaneously recognize large-sized coal blocks, detect belt edges, and detect coal flow status. Compared with using a separate model for each task, integrating three different necks and heads into a model with a shared backbone can save a lot of computing resources and inference time. Firstly, the image semantic information collected in low illumination and dusty transportation tunnels is weak, which makes the model's ability to extract target semantic information poor. Therefore, the Bottleneck structure in C2f modules of the backbone network P6 and P8 layers is replaced with an Extended Residual Module (DWR), reducing the number of parameters while improving the model's ability to extract multi-scale contextual semantic information. Secondly, as the model requires target recognition and segmentation of different types of tasks, an efficient layer aggregation network (RepGFPN) with skip layer connection structure is adopted to optimize the feature fusion part, greatly improving the detection accuracy of the model for different detection tasks while controlling the number of model parameters and inference speed; Finally, to address the detection tasks of three different label shapes, the Inner CIOU loss function is introduced to compensate for the weak generalization ability of the CIoU loss function in different detection tasks. In order to verify the applicability and robustness of the DR-YOLOM algorithm, U-net and DeepLabV3+network models were selected to compare and analyze the segmentation performance of the DR-YOLOM multi task detection model. Faster RCNN and Yolov8 were used to compare the performance of object detection, and the loss function and accuracy curve before and after model improvement were compared. The results show that compared to mainstream single detection algorithms, DR-YOLOM multi task detection algorithm has better comprehensive detection ability, and this algorithm can ensure high target recognition accuracy, segmentation accuracy, and appropriate inference speed with a small number of parameters. Among them, the mAP50 for large-scale coal block recognition is 90%, the mIoU for belt edge segmentation and coal flow segmentation are 78.7% and 96.6%, respectively, and the number of model parameters is 4.43 M. The inference speed can reach 40 frames per second, which is 1.3%, 0.7%, and 2.1% higher than the basic models mAP50 and mIoU, respectively. Finally, in order to verify the practicality of the DR-YOLOM algorithm, an inspection robot was used to collect video data in the laboratory, and the DR-YOLOM multi task detection algorithm was used to detect the collected video data. The experimental results show that the DR-YOLOM multi task detection algorithm can meet the requirements of multi task detection for the operation status of belt conveyors.

  • [1]
    王国法,杜毅博,徐亚军,等. 中国煤炭开采技术及装备50年发展与创新实践:纪念《煤炭科学技术》创刊50周年[J]. 煤炭科学技术,2023,51(1):1−18.

    WANG Guofa,DU Yibo,XU Yajun,et al. Development and innovation practice of China coal mining technology and equipment for 50 years:Commemorate the 50th anniversary of the publication of Coal Science and Technology[J]. Coal Science and Technology,2023,51(1):1−18.
    [2]
    周坪,马国庆,周公博,等. 智能化带式输送机健康监测技术研究综述[J]. 仪器仪表学报,2023,44(12):1−21.

    ZHOU Ping,MA Guoqing,ZHOU Gongbo,et al. Health monitoring technology for the intelligent belt conveyor:A review[J]. Chinese Journal of Scientific Instrument,2023,44(12):1−21.
    [3]
    王海军,王洪磊. 带式输送机智能化关键技术现状与展望[J]. 煤炭科学技术,2022,50(12):225−239.

    WANG Haijun,WANG Honglei. Status and prospect of intelligent key technologies of belt conveyor[J]. Coal Science and Technology,2022,50(12):225−239.
    [4]
    马宏伟,毛清华,张旭辉. 矿用强力带式输送机智能监控技术研究进展[J]. 振动 测试与诊断,2016,36(2):213−219,396.

    MA Hongwei,MAO Qinghua,ZHANG Xuhui. Intelligent monitoring technology study process for steel cord conveyor belt in coal mine[J]. Journal of Vibration,Measurement & Diagnosis,2016,36(2):213−219,396.
    [5]
    吴利刚,陈乐,吕媛媛,等. 基于轻量化的输送带块煤实时监测方法[J]. 煤炭科学技术,2023,51(S2):285−293.

    WU Ligang,CHEN Le,LYU Yuanyuan,et al. Real time monitoring method for lightweight conveyor belt lump coal[J]. Coal Science and Technology,2023,51(S2):285−293.
    [6]
    高涵,赵培培,于正,等. 基于特征增强与Transformer的煤矿输送带异物检测[J]. 煤炭科学技术,2024,52(7):199−208.

    GAO Han,ZHAO Peipei,YU Zheng,et al. Coal mine conveyor belt foreign object detection based on feature enhancement and Transformer[J]. Coal Science and Technology,2024,52(7):199−208.
    [7]
    杨志方,张立亚,郝博南,等. 基于双流融合网络的运输机皮带跑偏检测方法[J/OL]. (2023−05−30) [2024−04−23]. http://kns.cnki.net/KCMS/detail/detail.aspx? filename=MTKJ20230526004&dbname=CJFD&dbcode=CJFQ.

    YANG Zhifang,ZHANG Liya,HAO Bonan,et al. Detection method of conveyor belt deviation based on double-stream fusion network[J/OL]. (2023−05−30) [2024−04−23]. http://kns.cnki.net/KCMS/detail/detail.aspx? filename=MTKJ20230526004&dbname=CJFD&dbcode=CJFQ.
    [8]
    李纪栋,蒲绍宁,翟超,等. 基于视频识别的带式输送机煤量检测与自动调速系统[J]. 煤炭科学技术,2017,45(8):212−216.

    Li Jidong,Pu Shaoning,Zhai Chao,et al. Coal quantity detection and automatic speed control system for belt conveyors based on video recognition[J]. Coal Science and Technology,2017,45(8):212−216.
    [9]
    代伟,赵杰,杨春雨,等. 基于双目视觉深度感知的带式输送机煤量检测方法[J]. 煤炭学报,2017,42(S2):547−555.

    DAI Wei,ZHAO Jie,YANG Chunyu,et al. Detection method of coal quantity in belt conveyor based on binocular vision depth perception[J]. Journal of China Coal Society,2017,42(S2):547−555.
    [10]
    韩涛,黄友锐,张立志,等. 基于图像识别的带式输送机输煤量和跑偏检测方法[J]. 工矿自动化,2020,46(4):17−22.

    HAN Tao,HUANG Yourui,ZHANG Lizhi,et al. Detection method of coal quantity and deviation of belt conveyor based on image recognition[J]. Industry and Mine Automation,2020,46(4):17−22.
    [11]
    ZHANG M C,JIANG K,CAO Y S,et al. A new paradigm for intelligent status detection of belt conveyors based on deep learning[J]. Measurement,2023,213:112735. doi: 10.1016/j.measurement.2023.112735
    [12]
    WANG J Y,JONATHAN WU Q M,ZHANG N. You only look at once for real-time and generic multi-task[J]. IEEE Transactions on Vehicular Technology,2024,73(9):12625−12637. doi: 10.1109/TVT.2024.3394350
    [13]
    邵蓉波,肖立志,廖广志,等. 基于多任务学习的测井储层参数预测方法[J]. 地球物理学报,2022,65(5):1883−1895.

    SHAO Rongbo,XIAO Lizhi,LIAO Guangzhi,et al. Multitask learning based reservoir parameters prediction with geophysical logs[J]. Chinese Journal of Geophysics,2022,65(5):1883−1895.
    [14]
    李茂,肖洋轶,宗望远,等. 基于改进YOLOv8模型的轻量化板栗果实识别方法[J]. 农业工程学报,2024,40(1):201−209.

    LI Mao,XIAO Yangyi,ZONG Wangyuan,et al. Detecting chestnuts using improved lightweight YOLOv8[J]. Transactions of the Chinese Society of Agricultural Engineering,2024,40(1):201−209.
    [15]
    孙龙,张荣芬,刘宇红,等. 监控视角下密集人群口罩佩戴检测算法[J]. 计算机工程,2023,49(9):313−320.

    SUN Long,ZHANG Rongfen,LIU Yuhong,et al. Mask wearing detection algorithm for dense crowds from a monitoring perspective[J]. Computer Engineering,2023,49(9):313−320.
    [16]
    刘凤春,张靖,薛涛,等. YOLO-VDCW:一种新的轻量化带钢表面缺陷检测算法[J]. 中国冶金,2024,34(6):125−135.

    LIU Fengchun,ZHANG Jing,XUE Tao,et al. YOLO-VDCW:A new lightweight surface defect detection algorithm for strip steel[J]. China Metallurgy,2024,34(6):125−135.
    [17]
    樊红卫,刘金鹏,曹现刚,等. 低照度尘雾下煤、异物及输送带早期损伤多尺度目标智能检测方法[J]. 煤炭学报,2024,49(S2):1259−1270.

    FAN Hongwei,LIU Jinpeng,CAO Xiangang,et al. Intelligent multi-scale target detection method for early damage of coal,foreign objects,and conveyor belts under low illumination dust and mist[J]. Journal of China Coal Society,2024,49(S2):1259−1270.
    [18]
    陈伟,江志成,田子建,等. 基于YOLOv8的煤矿井下人员不安全动作检测算法[J]. 煤炭科学技术,2024,52(S2):267−283.

    CHEN Wei,JIANG Zhicheng,TIAN Zijian,et al. etection algorithm for unsafe actions of underground personnel in coal mines based on YOLOv8[J]. Coal Science and Technology,2024,52(S2):267−283.
    [19]
    WEI H R,LIU X,XU S C,et al. DWRSeg:Rethinking efficient acquisition of multi-scale contextual information for real-time semantic segmentation[J/OL]. (2022−12−02) [2024−04−23]. https://arxiv.org/abs/2212.01173.
    [20]
    裴少通,张行远,胡晨龙,等. 基于ER-YOLO算法的跨环境输电线路缺陷识别方法[J]. 电工技术学报,2024,39(9):2825−2840.

    PEI Shaotong,ZHANG Hangyuan,HU Chenlong,et al. The defect detection method for cross-environment power transmission line based on ER-YOLO algorithm[J]. Transactions of China Electrotechnical Society,2024,39(9):2825−2840.
    [21]
    侯公羽,陈钦煌,杨振华,等. 基于改进YOLOv5的安全帽检测算法[J]. 工程科学学报,2024,46(2):329−342.

    HOU Gongyu,CHEN Qinhuang,YANG Zhenhua,et al. Helmet detection method based on improved YOLOv5[J]. Chinese Journal of Engineering,2024,46(2):329−342.
    [22]
    LIU S,QI L,QIN H F,et al. Path aggregation network for instance segmentation[C]//2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Piscataway,NJ:IEEE,2018:8759−8768.
    [23]
    XU X Z,JIANG Y Q,CHEN W H,et al. DAMO-YOLO:A report on real-time object detection design[J/OL]. (2022−11−23) [2024−04−23],https://arxiv.org/abs/2211.15444?context=cs.CV.
    [24]
    王媛彬,韦思雄,吴华英,等. 基于改进YOLOv5s的矿井下安全帽佩戴检测算法[J/OL]. (2024−03−23) [2024−04−24]. http://kns.cnki.net/KCMS/detail/detail.aspx?filename=MTKJ20240320006&dbname=CJFD&dbcode=CJFQ.

    WANG Yuanbin,WEI Sixiong,WU Huaying,et al. Detection algorithm of helmet wearing in underground mine based on improved YOLOv5s[J/OL]. (2024−03−23) [2024−04−24]. http://kns.cnki.net/KCMS/detail/detail.aspx?filename=MTKJ20240320006&dbname=CJFD&dbcode=CJFQ.
    [25]
    ZHANG H,XU C,ZHANG S J. Inner-IoU:More effective intersection over union loss with auxiliary bounding box[J/OL]. (2023−11−06) [2024−04−24],https://arxiv.org/abs/2311.02877.
    [26]
    程德强,徐进洋,寇旗旗,等. 融合残差信息轻量级网络的运煤皮带异物分类[J]. 煤炭学报,2022,47(3):1361−1369.

    CHENG Deqiang,XU Jinyang,KOU Qiqi,et al. Lightweight network based on residual information for foreign body classification on coal conveyor belt[J]. Journal of China Coal Society,2022,47(3):1361−1369.
    [27]
    方崇全. 煤矿带式输送机巡检机器人关键技术研究[J]. 煤炭科学技术,2022,50(5):263−270.

    FANG Chongquan. Research on key technology of inspection robot for coal mine belt conveyor[J]. Coal Science and Technology,2022,50(5):263−270.
  • Related Articles

    [1]SUN Lin, CHEN Sheng, YAO Xulong, ZHANG Yanbo, TAO Zhigang, LIANG Peng. Research on multi-objective detection method for incomplete information in coal mine underground[J]. COAL SCIENCE AND TECHNOLOGY, 2024, 52(S2): 211-220. DOI: 10.12438/cst.2023-1293
    [2]CHEN Wei, REN Peng, AN Wenni, TIAN Zijian, ZHANG Fan. Mine object detection based on space attention in coal mine edge intelligent surveillance images[J]. COAL SCIENCE AND TECHNOLOGY, 2024, 52(S2): 201-210. DOI: 10.12438/cst.2022-2140
    [3]RUAN Shunling, WANG Jing, GU Qinghua, LU Caiwu. Research on mining area obstacle detection model for edge computing[J]. COAL SCIENCE AND TECHNOLOGY, 2024, 52(11): 141-152. DOI: 10.12438/cst.2024-0664
    [4]GAO Han, ZHAO Peipei, YU Zheng, XIAO Tao, LI Xiaoli, LI Liangxian. Coal mine conveyor belt foreign object detection based on feature enhancement and Transformer[J]. COAL SCIENCE AND TECHNOLOGY, 2024, 52(7): 199-208. DOI: 10.12438/cst.2023-1336
    [5]YANG Zhifang, ZHANG Liya, HAO Bonan, LIU Yuan, ZHAO Qing. Conveyor belt deviation detection method based on dual flow network[J]. COAL SCIENCE AND TECHNOLOGY, 2023, 51(S2): 259-267. DOI: 10.13199/j.cnki.cst.2023-0215
    [6]WAN Wenqing, TIAN Bailin, FENG Haiming, CHENG Xingming, LI Ping, REN Anxiang. Research on multi-parameters detection method of mine belt conveyor based on laser ranging[J]. COAL SCIENCE AND TECHNOLOGY, 2020, 48(8): 131-138.
    [7]CHENG Yongxin. Technology research on optical fiber sensing detection for belt conveyor fire in coal mine[J]. COAL SCIENCE AND TECHNOLOGY, 2019, (2).
    [8]Li Jidong Pu Shaoning Zhai Chao Li Xiangqian, . Coal quantity detection and automatic speed regulation system of belt conveyor based on video identification[J]. COAL SCIENCE AND TECHNOLOGY, 2017, (8).
    [9]LI Xian-guo MIAO Chang-yun FU Yi YANG Yan-li ZHONG Wei-liang, . Fault detection method and joint elongation calculating for coal mining conveyor belt[J]. COAL SCIENCE AND TECHNOLOGY, 2015, (3).
    [10]Study on Longitudinal Tearing Detection System of Conveyor Belt Based on ARM9[J]. COAL SCIENCE AND TECHNOLOGY, 2011, (12).

Catalog

    Article views (29) PDF downloads (25) Cited by()
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return