All Questions
2 questions
1
vote
0
answers
683
views
Multi-Head Attention in ViT
I need help to understand the multihead attention in ViT. Here's the code I found from GitHub:
...
0
votes
0
answers
51
views
Why is self-attention used for image classification?
I'm wondering why you would use Self-Attention across an entire image for image classification. What are the advantages of Self-Attention compared to a pure MLP?
- 1