The objective of the project is to predict the captions for the input image. The dataset consists of 8k images and 5 captions for each image. The features are extracted from both the image and the text captions for input. The features will be concatenated to predict the next word of the caption. CNN is used for image and LSTM is used for text. BLEU Score is used as a metric to evaluate the performance of the trained model.

We use the dataset available at https://www.kaggle.com/datasets/adityajn105/flickr8k

• VGG16 Network
• CNN-LSTM Network

Here's, the visual representation of the model architecture, including the input and output shapes of each layer.

BLEU-1 Score : 0.544

BLEU-2 Score : 0.319