M.S. AAI Capstone Chronicles 2024

of an image the model attended to when predicting the next token in a sequence, which adds a measure of interpretability and explainability that the CNN-LSTM models do not have.

Figure 8 ​

Sample Attention Maps for each Visual Attention Model

223