For real-time classification of rock-masses in hard-rock tunnels, quick determination of the rock lithology on the tunnel face during construction is essential. Motivated by current breakthroughs in artificial intelligence technology in machine vision, a new automatic detection approach for classifying tunnel lithology based on tunnel face images was developed. The method benefits from residual learning for training a deep convolutional neural network (DCNN), and a multi-scale dilated convolutional attention block is proposed. The block with different dilation rates can provide various receptive fields, and thus it can extract multi-scale features. Moreover, the attention mechanism is utilized to select the salient features adaptively and further improve the performance of the model. In this study, an initial image data set made up of photographs of tunnel faces consisting of basalt, granite, siltstone, and tuff was first collected. After classifying and enhancing the training, validation, and testing data sets, a new image data set was generated. A comparison of the experimental findings demonstrated that the suggested approach outperforms previous classifiers in terms of various indicators, including accuracy, precision, recall, F1-score, and computing time. Finally, a visualization analysis was performed to explain the process of the network in the classification of tunnel lithology through feature extraction. Overall, this study demonstrates the potential of using artificial intelligence methods for in situ rock lithology classification utilizing geological images of the tunnel face.