| Citation: |
WANG Manli，ZHANG Hang，LI Jiayue，et al. Deep neural network-based image enhancement algorithm for low-illumination images underground coal mines[J]. Coal Science and Technology，2023，51（9）：231−241. DOI: 10.12438/cst.2022-1626
|
Due to the complexity of the spatial environment and poor lighting conditions in underground coal mines, the images obtained by vision devices are prone to problems such as insufficient contrast and poor texture details, which seriously affect the reliability of the work of vision devices and limit further image-based intelligent applications. To improve the contrast of low-illumination images in underground mines while enhancing their texture details, a deep neural network-based low-illumination image enhancement model is proposed, which contains three sub-networks, namely, decomposition network, illumination adjustment network and reflection reconstruction network. The decomposition network decomposes the underground coal mine image into light and reflection components; the light adjustment network effectively reduces the parameters of the model using depth-separable convolutional structure and strengthens the feature extraction ability of the network; in addition, the MobileNet network structure is introduced to further lighten the light adjustment network while maintaining its feature extraction accuracy and effectively realizing the contrast adjustment of light components; the reflection reconstruction network introduces a residual network structure to improve the contrast adjustment of light components. Finally, the processed illumination and reflection components are fused based on Retinex theory to obtain enhanced images, which achieve contrast enhancement and detail enhancement of underground mine images, overcoming the problems of detail loss, blurred edges, and lack of contrast and clarity of the enhanced image that exist in existing enhancement algorithms. Numerical experiments show that the proposed model can effectively enhance the texture details of the image while improving the contrast of underground mine images, and has good stability and robustness, which can well meet the needs of low-light image enhancement in coal mines.
| [1] |
钱鸣高. 煤炭的科学开采[J]. 煤炭学报,2010,35(4):1−6. doi: 10.13225/j.cnki.jccs.2010.04.007
QIAN Minggao. Scientific mining of coal[J]. Journal of China Coal Society,2010,35(4):1−6. doi: 10.13225/j.cnki.jccs.2010.04.007
|
| [2] |
GUO X,LI Y,LING H. LIME: Low-Light image enhancement via illumination map estimation[J]. IEEE Transactions on Image Processing,2017,26(2):982−993. doi: 10.1109/TIP.2016.2639450
|
| [3] |
SHU Hang,WANG Jin,ZHENG Haimiao,et al. Naturalness preserved enhancement algorithm for non-uniform illumination images[J]. IEEE Transactions on Image Processing,2013,22(9):3538−3548. doi: 10.1109/TIP.2013.2261309
|
| [4] |
CHULWOO L,CHUL L,YOUNG-YOON L,et al. A power-constrained contrast enhancement for emissive displays based on histogram equalization[J]. IEEE Transactions on Image Processing,2012,21(1):80−93. doi: 10.1109/TIP.2011.2159387
|
| [5] |
LI Mading, LIU Jiaying, YANG Wenhai, et al. Structure-revealing low-light image enhancement via robust retinex model[C]// IEEE Transactions on Image Processing, 2018, 27(6): 2828−2841.
|
| [6] |
XUAN D, PANG Y A, WEN J G. Fast efficient algorithm for enhancement of low lighting video[C]// IEEE International Conference on Multimedia & Expo, 2011: 1−6.
|
| [7] |
LORE K G,AKINTAYO A,SARKAR S. LLNet: A deep autoencoder approach to natural low-light image enhancement[J]. Pattern Recognition,2017,61(6):650−662. doi: 10.1016/j.patcog.2016.06.008
|
| [8] |
LI C,GUO C,HAN L,et al. Low-light image and video enhancement using deep learning: a survey[J]. Computer Vision and Pattern Recognition,2021,61(4):1−12.
|
| [9] |
LU Kun,ZHANG Lihong. TBEFN: A two-branch exposure-fusion network for low-light image enhancement[J]. IEEE Transactions on Multimedia,2021(23):4093−4105.
|
| [10] |
WANG W, CHEN W, YANG W, et al. GLADNet: Low-light enhancement network with global awareness[C]// 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition, 2018: 1−13.
|
| [11] |
WEI C,WANG W,YANG W,et al. Deep retinex decomposition for low-light enhancement[J]. Computer Vision and Pattern Recognition,2018:1−12.
|
| [12] |
ZHANG Y, ZHANG J, GUO X. Kindling the darkness: a practical low-light image enhancer[C]// ACM MM, 2019: 1632−1640.
|
| [13] |
ZHANG Y,GUO X,MA J,et al. Beyond brightening low-light images[J]. International Journal of Computer Vision,2021,129(4):1013−1037. doi: 10.1007/s11263-020-01407-x
|
| [14] |
ZHANG Y, DI X, ZHANG B, et al. Self-supervised image enhancement network: training with low light images only, 2020: 1−14.
|
| [15] |
RONNEBERGER O,FISCHER P,BROX T. U-Net: Convolutional networks for biomedical image segmentation[J]. Springer International Publishing,2015,99:1−1.
|
| [16] |
CLEVERT D, UNTERTHINER T, HOCHREITER S. Fast and accurate deep network learning by exponential linear units (ELUs)[J]. Computer Science, 2015: 1−14.
|
| [17] |
IMTIAZ M S, WAHID K A. Image enhancement and space-variant color reproduction method for endoscopic images using adaptive sigmoid function[C]// Engineering in Medicine & Biology Society, Conf Proc IEEE Eng Med Biol Soc, 2014: 3905−3908.
|
| [18] |
HOWARD A G, ZHU Menglong, CHEN Bo, et al. MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications[J]. Computer Vision and Pattern Recognition, 2017: 1−9.
|
| [19] |
CHEN LC, ZHU Y, PAPANDREOU G, et al. Encoder-decoder with atrous separable convolution for semantic image segmentation[C]// Proceedings of the European conference on computer vision (ECCV), 2018: 801−818.
|
| [20] |
王满利, 田子建. 基于非下采样轮廓波变换的矿井图像增强算法[J]. 煤炭学报, 2020, 45(9): 3351−3362.
WANG Manli, TIAN Zijian: Mine image enhancement algorithm based on non-subsampled contourlet transform[J]. Journal of China Coal Society, 2020, 45(9): 3351−3362.
|
| [21] |
SETIADI D. PSNR vs SSIM: imperceptibility quality assessment for image steganography[J]. Multimedia Tools and Applications, 2020: 1−22.
|
| [22] |
曹现刚,郝朋英,王 鹏,等. 多因素光照条件下高质量图像获取方法研究[J]. 煤炭科学技术,2023,51(1):455−463.
CAO Xiangang,HAO Mingying,WANG Peng,et al. Study on high quality image acquisition under multi - factor illumination[J]. Coal Science and Technology,2023,51(1):455−463.
|
| [23] |
龚 云,颉昕宇. 基于同态滤波方法的煤矿井下图像增强技术研究[J]. 煤炭科学技术,2023,51(3):241−250. doi: 10.13199/j.cnki.cst.2021-0774
GONG Yun,XIE Xinyu. Research on coal mine underground image recognition technology based on homomorphic filtering method[J]. Coal Science and Technology,2023,51(3):241−250. doi: 10.13199/j.cnki.cst.2021-0774
|
Supported by: Beijing Renhe Information Technology Co., Ltd. 
DownLoad: