Tagged Questions
0
votes
3answers
81 views
Is there any dataset or api that gives a list of infrequent words? [closed]
I'm actually working on an information retrieval project, and I want to extract words that are of significance from a sentence. This is somewhat opposite to stopwords.
In a sentence like: He was a ...
2
votes
1answer
610 views
Euclidean Distance b/t unit vectors or cosine similarity where vectors are document vectors
I was reading Similarity Measures and suddenly my whole world was falling apart. I have implemented a search engine using clustering techniques. For clustering, I used k means which uses Euclidean ...
2
votes
0answers
61 views
Software library for Hidden Markov Modeling of a large text database
Given
we have a large database of texts (e.g. product descriptions)
and we want to extract multiple types of information (e.g. brand, release date, features, price, etc.)
what's a good library to ...
7
votes
2answers
201 views
Understanding and applying sentiment analysis
I was just having been assigned a project of conducting sentiment analysis for some document collections. By Googling, a lot of sentiment-related research has popped up.
My questions are:
What are ...
2
votes
0answers
232 views
Similarity calculations for arrays
First of all, my apologies if I mess up the terminology. I've been out of math for several years, so I'm certain I'm going to use terms incorrectly. Also, though I concentrated mathematics in college, ...
3
votes
2answers
667 views
Comparing cosine similarities for tf-idf vectors for documents with different length
I'm computing cosine similarities between 2 vectors.
These vectors are information retrieval query and document representations respectively.
They have been computed using tf-idf weights.
Since my ...
22
votes
6answers
878 views
Statistical classification of text
I'm a programmer without statistical background, and I'm currently looking at different classification methods for a large number of different documents that I want to classify into pre-defined ...
