Interference state intelligent recognition method for shearer drum and hydraulic support guard plate of improved YOLOv5s algorithm

MAO Qinghua; HU Xin; WANG Menghan; ZHANG Xuhui; XUE Xusheng

doi:10.12438/cst.2023-0757

Volume 52 Issue 2

Feb. 2024

Turn off MathJax

Article Contents

Abstract

References

COAL SCIENCE AND TECHNOLOGY > 2024 > 52(2): 253-263. > DOI: 10.12438/cst.2023-0757

MAO Qinghua，HU Xin，WANG Menghan，et al. Interference state intelligent recognition method for shearer drum and hydraulic support guard plate of improved YOLOv5s algorithm[J]. Coal Science and Technology，2024，52（2）：253−263

. DOI: 10.12438/cst.2023-0757

Citation:

. DOI: 10.12438/cst.2023-0757

Citation:

. DOI: 10.12438/cst.2023-0757

PDF (5478 KB)

Interference state intelligent recognition method for shearer drum and hydraulic support guard plate of improved YOLOv5s algorithm

MAO Qinghua^{1, 2,},
HU Xin^{1, 2},
WANG Menghan^{1, 2},
ZHANG Xuhui^{1, 2},
XUE Xusheng^{1, 2}

1.
School of Mechanical Engineering, Xi’an University of Science and Technology, Xi’an 710054, China
2.
Shaanxi Key Laboratory of Mine Electromechanical Equipment Intelligent Detection and Control, Xi’an 710054, China

Funds:

General Funding Project of Shaanxi Provincial Science and Technology Department and Shaanxi Coal Industry (Group) Co., Ltd. Joint Fund (2019JLM-39); Shaanxi Provincial Science and Technology Innovation Team Funding Project (2018TD-032)

More Information

Received Date: May 22, 2023
Available Online: February 25, 2024

Graphical Abstract

Abstract

Abstract

For the problem of interference between shearer drum and hydraulic support guard plate, an interference state intelligent recognition method for shearer drum and hydraulic support guard plate of improved YOLOv5s algorithm is proposed. The use of boundary constraint and non-linear contextual regularization based on the group's previous proposed method of defogging and dust removal to clarify the video image, improve the quality of the monitoring video image of the comprehensive mining face. The YOLOv5s model is improved by replacing the ordinary convolutional Conv in the YOLOv5s backbone network with Ghost convolution, the improved algorithm greatly reduces the number of model parameters and improves the model recognition speed. At the same time, the coordinate attention mechanism is introduced to improve the model's ability to extract the features from the guard plate and shearer, and improve the recognition accuracy. The soft non-maximum suppression algorithm (Soft-NMS) anchor frame screening method is used to reduce the problem of missed detection due to overlapping guard plates. For the problem of determining the interference state of shearer drum and hydraulic support guard plate, the method for determining anchor box overlap degree between hydraulic support guard plate and shearer drum. The improved YOLOv5s algorithm is compared with YOLOv5s and YOLOv3-tiny algorithm. The results indicate that compared with the original YOLOv5s model, the recognition accuracy of this method has been improved by about 8.1%, and GFLOPs have been reduced by 1.86 times. mAP@.5 was increased to 97.2%, and the average recognition speed is 169 frames/s. The improved YOLOv5s algorithm is used to validate the interference state recognition effect for video images of shearer drum and hydraulic support guard plate in in actual fully mechanized mining faces, and the results show that the recognition accuracy of interference state between the coal shearer drum and the hydraulic support guard plate is 96%.
- shearer drum,
- hydraulic support guard plate,
- YOLOv5s,
- interference state,
- video image,
- intelligent recognition

FullText(HTML)

References (22)

References

[1]	钱鸣高,许家林,王家臣. 再论煤炭的科学开采[J]. 煤炭学报,2018,43 (1):1−13. QIAN Minggao,XU Jialin,WANG Jiachen. Further on the sustainable mining of coal[J]. Journal of China Coal Society,2018,43(1):1−13.
[2]	宋秋爽,袁智,宋振铎,等. 综采成套装备试验平台关键技术研究[J]. 煤炭科学技术,2017,45(8):194−199. SONG Qiushuang,YUAN Zhi,SONG Zhenduo,et al. Study on test platform key technology of complete fully-mechanized mining equipment[J]. Coal Science and Technology,2017,45(8):194−199.
[3]	任怀伟,王国法,赵国瑞,等. 智慧煤矿信息逻辑模型及开采系统决策控制方法[J]. 煤炭学报,2019,44(9):2923−2935. REN Huaiwei,WANG Guofa,ZHAO guorui,et al. Smart coal mine logic model and decision control method of mining system[J]. Journal of China Coal Society,2019,44(9):2923−2935.
[4]	任怀伟,赵国瑞,周杰,等. 智能开采装备全位姿测量及虚拟仿真控制技术[J]. 煤炭学报,2020,45(3):956−971. REN Huaiwei,ZHAO Guorui,ZHOU Jie,et al. Key technologies of all position and monitoring and virtual simulation and control for smart mining equip-ment[J]. Journal of China Coal Society,2020,45(3):956−971.
[5]	王国法,赵国瑞,任怀伟. 智慧煤矿与智能化开采关键核心技术分析[J]. 煤炭学报,2019,44(1):34−41. WANG Guofa,ZHAO Guorui,REN Huaiwei. Analysis on key technologies of intelligent coal mine and intelligent mining[J]. Journal of China Coal Society,2019,44(1):34−41
[6]	王妙云,张旭辉,马宏伟,等. 远程控制综采设备碰撞检测与预警方法[J]. 煤炭科学技术,2021,49(9):110−116. WANG Miaoyun,ZHANG Xuhui,MA Hongwei,et al. Collision detection and pre-warning method for remotely controlled fully-mechanized mining equipment[J]. Coal Science and Technology,2021,49(9):110−116. doi: 10.13199/j.cnki.cst.2021.09.016.
[7]	王渊,李红卫,郭卫,等. 基于图像识别的液压支架护帮板收回状态监测方法[J]. 工矿自动化,2019,45(2):47−53. WANG Yuan,LI Hongwei,GUO wei,et al. Monitoring method of recovery state of hydraulic support guard plate based on image recognition[J]. Industry and Mine Automation,2019,45(2):47−53.
[8]	满溢桥. 液压支架护帮板与采煤机滚筒截割干涉监测技术研究[D]. 北京:中国矿业大学(北京),2019. MAN Yiqiao. Research on the monitoring technology of cutting interference between hydraulic support face guard and shearer drum[D]. Beijing :China University of Mining and Technology-Beijing,2019.
[9]	LI J,LIANG X,SHEN S M,et al. Scale-aware Fast R-CNN for Pedestrian Detection[J]. IEEE Transactions on Multimedia,2015,20(4).
[10]	WU Y, LIM J, YANG MH. Object tracking benchmark[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2015, 37（9）: 1834−1848. WU Y,LIM J,YANG MH. Object tracking benchmark[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2015,37(9):1834−1848.
[11]	LECUN Y,BOSER B,DENKER J S,et al. Backpropagation Applied to Handwritten Zip Code Recognition[J]. Neural Computation,2014,1(4):541−551.
[12]	REDMON J,DIVVALA S,GIRSHICK R et al. You only look once:unified,real-time object detection[C]//IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Las Vegas:IEEE,2016:779–788.
[13]	REN Shaoqing,HE Kaiming,GIRSHICK R,et al. Faster R-CNN:towards real-time object detection with region proposal networks[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2017,39(6):1137−1149.
[14]	唐士宇,朱艾春,张赛,等. 基于深度卷积神经网络的井下人员目标检测[J]. 工矿自动化,2018,44(11):32−36. TANG Shiyu,ZHU Aichun,ZHANG Sai,et al. Target detection of underground personnel based on deep convolutional neural network[J]. Industry and Mine Automation,2018,44(11):32−36.
[15]	杜京义,陈瑞,郝乐,等. 煤矿带式输送机异物检测[J]. 工矿自动化,2021,47(8):77−83. DU Jingyi,CHEN Rui,HAO Le,et al. Coal mine belt conveyor for foreign object detection[J]. Industry and Mine Automation,2021,47(8):77−83.
[16]	唐聪,凌永顺,郑科栋,等. 基于深度学习的多视窗SSD目标检测方法[J]. 红外与激光工程,2018,47(1):302−310. TANG Cong,LIN Yongshun,ZHENG Kedong,et al. Object detection method of multi-view SSD based on deep le-arning[J]. Infrared and Laser Engineering,2018,47(1):302−310.
[17]	LIU W,ANGUELOV D,ERHAN D, et al. Ssd:Single shot multibox detector[C]//European conference on computer vision. Springer,Cham,2016:21−37.
[18]	魏强,白尚旺,龚大立,等. 融合图像去雾与Tiny-YOLOv3的护帮板状态检测研究[J]. 太原科技大学学报,2022,43(1):15−22,28. WEI Qiang,BAI Shangwang,GONG Dali et al. Research on defogging of fusion image and Tiny-YOLOv3 state detection of guard plate [J]. Journal of Taiyuan University of Science and Technology,2022,43(1):15−22,28.
[19]	张旭辉,闫建星,麻兵,等. 基于改进YOLOv5s的护帮板异常检测方法研究[J]. 工程设计学报,2022,29(6):665−675. ZHANG Xuhui,YAN Jianxing,MA Bing,et al. Research on Abnormal Detection Method of Shield Plate based on Improved YOLOv5s[J]. Chinese Journal of Engineering Design,2022,29(6):665−675.
[20]	MAO Q,WANG Y,ZHANG X,et al. Clarity method of fog and dust image in fully mechanized mining face[J]. Machine Vision and Applications,2022,33(2):1−16.
[21]	HAN K,WANG Y,TIAN Q, et al. Ghostnet:More features from cheap operations[C]//Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 2020:1580−1589.
[22]	HOU Q B,ZHOU D Q,FENG J S. Coordinate attention for efficient mobile network design [C]//Proceedings of 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Nashville:IEEE,2021: 13708–13717.

[1]	YANG Zebin, LI Hao, MA Liqiang, MAI Longquan. FDEM-CFD coupling analysis of spatiotemporal evolution of mining-induced overburden fracture-water inflow in shallow and thick coal seam under river[J]. COAL SCIENCE AND TECHNOLOGY, 2024, 52(6): 176-184. DOI: 10.12438/cst.2023-1161
[2]	WANG Hai, HUANG Xuanming, ZHANG Yan, CAO Haidong, SUN Hao, MIAO Hechao, TIAN Zenglin. Flexible magnetic suction impermeable membrane of vertical curtain water interception technology for strong seepage loose layer of coal mines[J]. COAL SCIENCE AND TECHNOLOGY, 2023, 51(9): 180-188. DOI: 10.12438/cst.2022-0165
[3]	HE Xiaolang, PU Zhiguo, DING Xiang, DUAN Dongwei. Improved methods for prediction of mine water inflow and determination of accuracy of results[J]. COAL SCIENCE AND TECHNOLOGY, 2020, 48(8): 229-236.
[4]	GAN Shengfeng, QIAO Wei, LEI Lijian, LI Lu, SHAN Jingxin, WU Weixing. Study on hydrogeological features and mine water inflow prediction in Zhaoxian Mine[J]. COAL SCIENCE AND TECHNOLOGY, 2018, (7).
[5]	HE Bao, LI Zhennan, ZHAO Shijie. Prediction on water inflow of surface mine based on multi-elementnonlinear regression analysis[J]. COAL SCIENCE AND TECHNOLOGY, 2018, (5).
[6]	Hu Weiyue Yan Li, . Analysis and consideration on prediction problems of mine water inflow volume[J]. COAL SCIENCE AND TECHNOLOGY, 2016, (1).
[7]	CAO Zhu-jun ZHOU Jian-jun SONG Hong-juan, . Directional Drilling Technology Applied to Goaf Water Control in Underground Mine[J]. COAL SCIENCE AND TECHNOLOGY, 2014, (10).
[8]	Correlational Analysis Method Applied to Prediction of Mine Water Inflow Quantity[J]. COAL SCIENCE AND TECHNOLOGY, 2013, (6).

Cited By

Cited by

Periodical cited type(8)

1.	朱俊. 塔山煤矿主平硐岩性变化出水段注浆堵水技术措施. 江西煤炭科技. 2025(01): 97-100+110 .
2.	王路，张东升，李强，韩学森，熊鹏辉，谢勇，王嗣桐. 基于砂化层破碎带冲蚀—渗流耦合模型的多孔介质水-砂混合流运移规律研究. 矿业安全与环保. 2025(02): 136-144 .
3.	邓启锐，刘飞，高建峰，王杰，许珂，南忠辉，徐士哲. 基于灌注桩帷幕的饱和黄土段井筒支护技术研究与实践. 能源与环保. 2025(04): 109-116 .
4.	雷亚军，范钢伟，杨建辉，任闯难，牛鸿波，范张磊. 煤矿斜井过动水砂层帷幕注浆扩散封堵机理及应用. 中国矿业. 2024(05): 187-195 .
5.	裴祖兴，颜其林. 凤凰颈泵站改造工程素混凝土截渗墙施工方法. 四川水泥. 2024(07): 174-176 .
6.	石银斌，杨志斌，李文平，王海，吕文波，惠磐科，雷占. 煤矿区复合地层等厚度水泥土截水帷幕性能的影响因素试验研究. 煤矿安全. 2024(07): 198-205 .
7.	朱俊. 塔山煤矿副平硐中部出水段注浆治理方案设计. 煤矿现代化. 2024(06): 126-129 .
8.	李文平，张跃宏，杨志斌，苗贺朝. 应用TRD工法的截水帷幕质量影响因素研究. 中国煤炭地质. 2023(12): 47-51 .

Other cited types(0)

Get Citation

PDF

XML

Article views (163) PDF downloads (70) Cited by(8)

Interference state intelligent recognition method for shearer drum and hydraulic support guard plate of improved YOLOv5s algorithm

Abstract

References

Related Articles

Cited by

Periodical cited type(8)

Other cited types(0)

Catalog

Related

Interference state intelligent recognition method for shearer drum and hydraulic support guard plate of improved YOLOv5s algorithm

Abstract

References

Related Articles

Cited by

Periodical cited type(8)

Other cited types(0)

Catalog

Related

Export File

Citation

Format

Content