The tag has no usage guidance.

learn more… | top users | synonyms

0
votes
1answer
380 views

K-Fold Cross validation and F1 Measure Score for Document Retrieval using TF-IDF weighting and some customised weighting schemes

I am developing a search engine system based on the vector space model, and I am confused on what approach I should take to evaluate the system. My case is this: I have a set of indexed documents ...
1
vote
1answer
353 views

Clustering of documents that are very different in number of words

I have a corpus of 643 documents with different sizes and my goal is to cluster them according their topics and label each cluster with semantic name for its main topic. I have tired different ...
2
votes
1answer
105 views

What is the standard procedure for evaluating a user-based CF algorithm with a dataset offline?

I have read some papers and other materials about the evaluation of recommender systems (RS). Most of them discuss the various properties of RS (e.g. accuracy, diversity, etc.), and metrics for ...
2
votes
2answers
402 views

Other documents features than tf-idf for clustering?

What are other feature representations for documents that are used for clustering textual documents? The only representation I'm aware of is tf-idf. Are there other ones?
1
vote
0answers
77 views

Mutual Information for clustering

I'm working on a document clustering application and decided to use Normalized Mutual Information as one of the measures of effectivenes. But I don't really understand how to implement this in that ...
1
vote
0answers
66 views

MAE/MSE with or without square root

I read some papers about recommender systems and information retrieval, where Mean Absolut Error and Mean Squared Error are mentioned. But I've found some differences between the formal definition of ...
0
votes
1answer
28 views

Discounted cumulated gain

I've a little question regarding the Discounted Cumulated Gain (DCG) (Sorry, I couldn't find the papers of Järvelin and Kekäläinen). Can this evaluation-metric be used when a information retrieval ...
4
votes
3answers
502 views

Summary statistics of the precision-recall curve

From what I understand, one can use the AUC of the ROC curve as a summary statistic of the full curve. Q1. Are there any similar summary statistics that one can use on a single precision-recall ...
1
vote
0answers
102 views

Is that overfitting?

Given a document-term matrix $X$, where $$X(d, t) = \textit{occurrences of 't' in 'd'}$$, it's possible to compute it's Truncated Singular Value Decomposition:$$X_k = U_k \Sigma_k V_k^T$$ Then, for a ...
0
votes
3answers
194 views

Is there any dataset or api that gives a list of infrequent words? [closed]

I'm actually working on an information retrieval project, and I want to extract words that are of significance from a sentence. This is somewhat opposite to stopwords. In a sentence like: He was a ...
4
votes
1answer
677 views

A parellel between LSA and pLSA

In the original paper of pLSA the author, Thomas Hoffman, draw a parallel between pLSA and LSA data structures that I would like to discuss with you. Background: Taking inspiration the Information ...
1
vote
0answers
143 views

Using sentiment lexicons or all words processing for sentiment analysis?

I am learning sentiment analysis to apply it to twitter real time data to predict user's mood. I ponder about using which alternative way to do that data mining job. Use all words to process and ...
1
vote
0answers
34 views

Evaluation and Testsets for NNMF

I am trying to evaluate my recommender system which uses Non-negative Matrix Factorization. Some things that I evaluate are How does the size of the feature matrix affect the recommendations How ...
3
votes
1answer
2k views

Euclidean Distance b/t unit vectors or cosine similarity where vectors are document vectors

I was reading Similarity Measures and suddenly my whole world was falling apart. I have implemented a search engine using clustering techniques. For clustering, I used k means which uses Euclidean ...
2
votes
2answers
626 views

How do you predict a continuous value from many booleans & a continuous value?

Hello: I am a computer science student working as a research assistant in an undergrad IR lab, feeling spectacularly out of my element. Given an input of a single continuous value and a vector of ...
2
votes
0answers
95 views

Software library for Hidden Markov Modeling of a large text database

Given we have a large database of texts (e.g. product descriptions) and we want to extract multiple types of information (e.g. brand, release date, features, price, etc.) what's a good library to ...
7
votes
2answers
389 views

Understanding and applying sentiment analysis

I was just having been assigned a project of conducting sentiment analysis for some document collections. By Googling, a lot of sentiment-related research has popped up. My questions are: What are ...
3
votes
0answers
332 views

Similarity calculations for arrays

First of all, my apologies if I mess up the terminology. I've been out of math for several years, so I'm certain I'm going to use terms incorrectly. Also, though I concentrated mathematics in college, ...
5
votes
1answer
411 views

Choosing a measure of similarity to quantify similarity between individuals on a set of personality scales

I have a bunch of users. Each user has a number of personality attributes, such as "fitness level" or "eco-consciousness", rated on a scale from 1 to 5. I want to calculate how similar two users are, ...
2
votes
0answers
173 views

How to to calculate the topic distribution of a document

I have a simple (may be stupid) question. I want to calculate Kullback–Leibler divergence on two documents. It requires probability distribution of each document. I do not know how to calculate ...
3
votes
1answer
767 views

Using latent Dirichlet allocation for information retrieval

I am working on understanding various document ranking algorithms like (TF-IDF, LSI, language models, etc) by actually implementing them. I want to understand LDA and using various resources to ...
4
votes
2answers
545 views

How to compute term frequency and find clusters in a dataset composed of strings?

I am currently looking for some Information Retrieval techniques. I have a SQL database table containing strings. It has 1000 records, each being a random sentence I picked from random web sites. I ...
4
votes
2answers
2k views

Comparing cosine similarities for tf-idf vectors for documents with different length

I'm computing cosine similarities between 2 vectors. These vectors are information retrieval query and document representations respectively. They have been computed using tf-idf weights. Since my ...
2
votes
2answers
671 views

KL divergence calculation

I am wondering that how one can calculate KL-divergence on two probability distributions. For example, if we have ...
7
votes
2answers
1k views

Can one use Cohen's Kappa for two judgements only?

I am using Cohen's Kappa to calculate the inter-agreement between two judges. It is calculated as: $ \frac{P(A) - P(E)}{1 - P(E)} $ where $P(A)$ is the proportion of agreement and $P(E)$ the ...
17
votes
2answers
4k views

Measuring Document Similarity

To cluster (text) documents you need a way of measuring similarity between pairs of documents. Two alternatives are: Compare documents as term vectors using Cosine Similarity - and TF/IDF as the ...
27
votes
7answers
2k views

Statistical classification of text

I'm a programmer without statistical background, and I'm currently looking at different classification methods for a large number of different documents that I want to classify into pre-defined ...