Abstract: In this paper, an image description algorithm based on object detection and part of speech analysis is proposed to solve the problem of low correlation between the description content and image in the existing image description method that based on attention mechanism. Based on the attention mechanism, this method extracts information from the picture by the target detection algorithm, and processes it by the recurrent neural network with the attention mechanism to generate the image description statement. In the process of generating words, the algorithm predicts the part of speech of each word, and then selects different neural networks according to the prediction results, so it improves the correlation between the description statement and the original image. The experimental results show that in many objective description evaluation criteria, the description statements generated by the algorithm in this paper have different degrees of improvement compared with the existing algorithms, at the same time, the content of the picture can be more accurately and smoothly described in the subjective evaluation.

Key words: image description, recurrent neural network, attention mechanism, target detection, deep learning, natural language processing