New answers tagged word-embeddings
1
vote
How is an embedding space optimized with respect to the loss function?
If we create a very simple NN with only one Embedding Layer in the model, it could be seen more clearly. For example, in the model:
Input: [batch_num, 2] ...
0
votes
Interconnections between embeddings layer and LSTM layer
LSTM (as well as all recurrent neural networks) process one input vector, in this case corresponding to one word, at a time.
In each step, the RNN cell reads the input vector and updates its hidden ...
Top 50 recent answers are included
Related Tags
word-embeddings × 253natural-language × 120
word2vec × 112
neural-networks × 86
machine-learning × 61
embeddings × 19
lstm × 17
recurrent-neural-network × 14
classification × 13
keras × 13
text-mining × 10
language-models × 10
python × 9
tensorflow × 9
bag-of-words × 7
topic-models × 6
cosine-similarity × 6
feature-engineering × 5
autoencoders × 5
sentiment-analysis × 5
transformers × 5
doc2vec × 5
pca × 4
categorical-encoding × 4
softmax × 4