Questions tagged [doc2vec]

Doc2vec (aka paragraph2vec, aka sentence embeddings) modifies the word2vec algorithm to unsupervised learning of continuous representations for larger blocks of text, such as sentences, paragraphs or entire documents.

Filter by
Sorted by
Tagged with
0
votes
0answers
7 views

Doc2Vec models comparing $t$ and $t-1$

I have data for 10 years. Each year contains a set of documents $D$ in $t$. Each document consists of text and corresponds to a unique ID which does not change over time $T$. So ID $7814$ in year $3$ ...
0
votes
0answers
26 views

Improve the accuracy of semantic text matching

I have a corpus of ~200K sentences of variable length, the median length is 16 words. My goal is for a given sentence to find other sentences with a similar meaning. I tried several approaches: using ...
0
votes
0answers
24 views

How PV-DBOW works

The authors of the Paragraph Vector paper describe PV-DBOW with: 2.3. Paragraph Vector without word ordering: Distributed bag of words The above method considers the concatenation of the ...
0
votes
1answer
63 views

High Precision and low recall score for TF-IDF when using KNN algorithm

I have twitter data which is labelled with the sentiment(Postive, Negative, Neutral) and I have evaluated the performance of Tf-Idf and Doc2Vec feature extractor using the KNN algorithm and logistic ...
2
votes
1answer
113 views

Pre-processing: lemmatizing and stemming make a better doc2vec?

I have a project which I will turn documents of a corpus into doc2vec. I was reading that when people convert a document to bag of words they try to improve the bag of words by removing stopwords, ...
0
votes
1answer
827 views

how to improve doc2vec model

I would like to do some sentence embedding on around 500 sentences. The purpose is to find for new sentences, the most similar ones within the 500 sentences. Unfortunately, for now its definitely not ...
0
votes
1answer
154 views

Different accuracy scores for the vectors generated by Doc2Vec model trained on same hyper parameters

I am using doc2vec to generate vectors for sentences in training and testing datasets. The generated vectors are used to classify sentences using ensemble classifiers. The classifier is showing two ...
1
vote
1answer
210 views

How should I formalize Doc2Vec Matrix Dimension?

Below, I have a simple diagram explaining the matrix dimension of word2vec. My goal is to expand this graph to incorporate document vectors for doc2vec. However, I'm having trouble understanding the ...
1
vote
1answer
1k views

How to train sentence/paragraph/document embeddings?

I'm well aware of word embeddings (word2vec or Glove) and I know of four papers treating the subject of more general embeddings : Distributed Representations of Sentences and Documents - Quoc V. Le,...
5
votes
1answer
280 views

Why have a tanh layer, max pooling layer and then another tanh layer

I have been reading a Facebook paper, read here, and am confused about certain features of the architecture. I do not understand why they have a tanh layer, max-pooling layer, and then another tanh ...
0
votes
0answers
946 views

Clustering using doc2vec

is it okay to cluster documents by learned document vectors?. I think similar documents should have similar vectors. from this fact it is okay to cluster documents using for instance k-means. However, ...
0
votes
1answer
518 views

Can any one give explanation on LSA and what is different from NMF?

LSA is better way for extracted new concepts from large text documents collections .. in the following example : i have spend lot of time in Google to get explanation about the following My ...
3
votes
2answers
3k views

Doc2Vec for large documents

I have about 7000000 patents that I would like to do find the document similarity of. Obviously with a sample set that big it will take a long time to run. I am just taking a small sample of about ...