I don't have computer vision background, yet when I read some image processing and convolutional neural networks related articles and papers, I constantly face the term, multimodal embedding. Can anybody provide some intuition behind this term?

I usually encounter this term in image captioning and image recognition.


The link shows what multimodal embeddings are. Multimodal refers to an admixture of media, e.g., a picture of a banana with text that says "This is a banana." Embedding means what it always does in math, something inside something else. A figure consisting of an embedded picture of a banana with an embedded caption that reads "This is a banana." is a multimodal embedding.

| cite | improve this answer | |
  • 2
    $\begingroup$ Thanks, Carl! That link really helped me to get through those papers. $\endgroup$ – kanik garg Dec 17 '17 at 12:32

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.