1
vote
0answers
13 views

Learning to Rank: query-dependent vs. query-independent features

I've been doing some reading about learning to rank - specifically lambdaMART - and one thing I am confused about is the role of features. When training a model, should one only use query-dependent ...
0
votes
0answers
28 views

What is the best algorithm for finding attacks from log file [closed]

I m working on forensic analysis of web logs. I have generated the DoS attack dataset and i m having the attack dataset of log files (unlabeled dataset) taken from Dr. Anton Chuvakin. I need to look ...
0
votes
1answer
39 views

Automatic labeling of training set

I have once meet the following question, given a training set, is that possible to do the automatic labelling? In addition, if this training set consists of plain text files, is that possible to know ...
1
vote
2answers
70 views

Dataset and papers for baseline [closed]

I'm doing a project about Topic Detection and Tracking in text. I need to perform a baseline so I can compare existing results with mine. I read some papers where they use datasets that are not so ...
1
vote
2answers
84 views

Most important journals in data mining/ML, NLP and IR?

Can you please provide with me with the names of the most important journals in data mining, machine learning, natural language processing and information retrieval?
0
votes
1answer
149 views

K-Fold Cross validation and F1 Measure Score for Document Retrieval using TF-IDF weighting and some customised weighting schemes

I am developing a search engine system based on the vector space model, and I am confused on what approach I should take to evaluate the system. My case is this: I have a set of indexed documents ...
2
votes
2answers
154 views

Other documents features than tf-idf for clustering?

What are other feature representations for documents that are used for clustering textual documents? The only representation I'm aware of is tf-idf. Are there other ones?
0
votes
0answers
49 views

Unusual Precision-Recall Curve

Looking at precision-recall curves to evaluate an information retrieval system. Typically, these are done with a set of samples, with what users have picked out of a set of given items. I have an ...
3
votes
1answer
370 views

A parellel between LSA and pLSA

In the original paper of pLSA the author, Thomas Hoffman, draw a parallel between pLSA and LSA data structures that I would like to discuss with you. Background: Taking inspiration the Information ...
1
vote
0answers
29 views

Evaluation and Testsets for NNMF

I am trying to evaluate my recommender system which uses Non-negative Matrix Factorization. Some things that I evaluate are How does the size of the feature matrix affect the recommendations How ...
2
votes
2answers
198 views

How do you predict a continuous value from many booleans & a continuous value?

Hello: I am a computer science student working as a research assistant in an undergrad IR lab, feeling spectacularly out of my element. Given an input of a single continuous value and a vector of ...
2
votes
0answers
71 views

Software library for Hidden Markov Modeling of a large text database

Given we have a large database of texts (e.g. product descriptions) and we want to extract multiple types of information (e.g. brand, release date, features, price, etc.) what's a good library to ...
7
votes
2answers
275 views

Understanding and applying sentiment analysis

I was just having been assigned a project of conducting sentiment analysis for some document collections. By Googling, a lot of sentiment-related research has popped up. My questions are: What are ...
1
vote
2answers
539 views

KL divergence calculation

I am wondering that how one can calculate KL-divergence on two probability distributions. For example, if we have ...