3
$\begingroup$

I have about 7000000 patents that I would like to do find the document similarity of. Obviously with a sample set that big it will take a long time to run. I am just taking a small sample of about 5600 patent documents and I am preparing to use Doc2vec to find similarity between different documents. From many of the examples and the Mikolov paper he uses Doc2vec on 100000 documents that are all short reviews. My documents are much longer than reviews, like 3000+ words each, but I have way fewer of them. Should I still use Doc2vec on this limited sample set? Or should I use something like Word Mover Distance and Word2Vec since I have perhaps almost as many words as Mikolov's paper but fewer documents. Gensim has pre-trained Word2vec. I don't really understand Doc2vec/Word2vec very well, but can I use that corpus to train Doc2vec? Anyone have any suggestions?

Note: I have already implemented LDA/LSI and cosine sim of: TF-IDF. I'm looking to see which method gets the most accurate similarity measure so I can test similarity measures over time.

$\endgroup$
2
$\begingroup$

Yes, I would try Doc2Vec with that. The build_vocab() method in gensim is akin to word2vec, in any case (i.e. only for Distributed Memory algorithm, not the DBOW which does not make word vectors). You can test the words similarities in DM route after training and see how they compare. Then also you can test the documents' also.

Another word embedding method is supposed to be good: GLoVE. There are some good tutorials in the blogosphere for doc2vec - as well as the gensim ipython notebook you could follow to get going. My intuition is that it works better with smaller short texts like tweets than longer documents, but you can try in any case.

$\endgroup$
0
$\begingroup$

Due to the complexity of a patent document and the specifications of a patent such as abstract, description, and claims are quite different and they tends to be used in different classification purposes. For instance, a description tends to be large several pages, and claims to be several paragraphs.

In patent representation, it would be wise to split a patent document into three smaller documents respectively and these documents will be used to train the doc2vec model.

In this case, feature representation of a patent can be used as a concatenation (or with a certain weighting) of the feature representation of each specification (abstract/desc/claims)

$\endgroup$
  • $\begingroup$ Welcome to CV. Your answer is pretty short. Can you extend it please? $\endgroup$ – Ferdi Sep 16 '17 at 8:22

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.