0
votes
0answers
12 views

Tutorial on Radial Basis Function Networks?

I want to learn about Radial Basis Function Neural Networks, can you please suggest a good introduction or tutorial? All the introductions I found are rather short or incomplete or so.
0
votes
1answer
30 views

Performing hierarchical clustering on a large data set

I have been applying complete linkage on about 5,000 points using matlab with no problem. I want to extend this method to much more elements. It would take me a long time to process my data to test ...
1
vote
2answers
97 views

Not very known but effective data mining algorithms?

I recently came a cross Matrix Factorization for classification or recommendations. I was very shocked that it was one of the most effective techniques in the Netflix competition. But actually I think ...
0
votes
1answer
21 views

Evaluation indexes hypothesis for clustering

I read on the cluster analysis page of wikipedia: For example, k-means clustering can only find convex clusters, and many evaluation indexes assume convex clusters. On a data set with non-convex ...
2
votes
0answers
11 views

Record linkage when sources have different fields

I have read a little about record linkage, but it seems to me that a requirement is that all fields in both sources can be compared. For example, with sources A and B, an assumption is that we can ...
1
vote
0answers
19 views

Comparison of cophenetic correlation coefficients on different data sets

I applied the same hierarchical clustering (weighted) on two data sets: The first is a 'raw' data set, on which I didn't do anything, and the second on the same data set after I filtered it by ...
0
votes
0answers
22 views

Literature for prediction models where each training example has a different amount of data?

This could be a machine learning question as much as a statistics question, but I think this is the best place to put the question. Here are three different examples of problems where each ...
0
votes
0answers
22 views

Converting a spearman correlation to a euclidian dissimilarity

I am applying ward hierarchical clustering on a data set for which I have pairwise similarities. Since hierarchical clustering need a dissimilarity matrix, I am trying to convert my similarity matrix ...
0
votes
0answers
27 views

What would you use as your default model for comparison?

I have a question. Say you are given with like 1500 instances as your dataset, in which instance will be categorized into 1 of the 3 classes. You're supposed to come up with the best model from the ...
1
vote
0answers
11 views

What sort of feedback button should I implement to measure the difficulty of a task

---background info--- My company has built a Search Engine Optimisation product that can suggest monthly prioritised SEO activities (task suggestions), that will have the most benefit to the end user. ...
0
votes
0answers
29 views

Converting a similarity to a dissimilarity [duplicate]

I am working on a clustering problem for which I have to manually choose the number of clusters. I have a visualization tool that helps me decide whether the clusters are good. In order to ...
-1
votes
1answer
19 views

Converting FuzzykMeans to SphericalFuzzyKMeans?

I grabbed an implementation of FuzzyKMeans (FuzzyCMeans) from the nightly build of the Apache Commons Math library, but I now realize I need to use Cosine Similarity instead of the Euclidean Distance. ...
1
vote
1answer
52 views

What kind of model is used by 20 Questions?

Which kind of machine learning concept / model is used in 20 Questions? Is this kind of thing best solved by a neural network? Where I can read something about it?
0
votes
0answers
28 views

Best Methods for data-mining neuroimaging data with 1000 subjects

I am part of a team tasked with performing exploratory analysis of a large data set containing neuro-imaging scans. For each scan I will likely calculate some variable that relates to brain function - ...
-1
votes
1answer
45 views

Clustering algorithms assigning probability values

I have a distance matrix for some data I want to cluster. However, I don't just want to assign elements to clusters, but I also want to assign a probability for each element to belong to each cluster. ...
0
votes
0answers
28 views

Constructing a covariance matrix and finding first principal component

So far in the topic of principal component analysis, I seem to be jumping around in understanding these various topics, and have a few questions that I need to help solidify my overall understanding. ...
0
votes
0answers
18 views

Need subspace partition algorithm, not necessarily a full classifier

The image above represents a hypothetical data set of interest. For some set of points in N-dimensional space (each attribute of the data set corresponds to one dimension), I want to identify ...
0
votes
0answers
22 views

Tuning the inflation parameter in mcl

I read on the mcl documentation that the inflation parameter can be used to tune the granularity of the clusters. I am not very familiar with graph theory. What is the granularity of the clusters? Can ...
0
votes
3answers
60 views

Converting a distance to a similarity

I am working on a graph clustering algorithm (mcl). It gives the opportunity to give weights to the edges. The weights must be similarities, but I have a distance. The values of this distance range ...
1
vote
2answers
49 views

Model instability in data mining. When it is big enough to discredit a model and how to measure it?

Let's say I have two models. One has cumulative lift on test data 4.322578, second 2.84488. The only advantage of the second over the first consists in the quality of having the cumulative lift curve ...
2
votes
0answers
26 views

Choice of an evaluation metric for a graph clustering algorithm

I have instances for which the only thing I know is 70% of the distance matrix. I know some of these points form groups of correlated points (each point of a group is "close" to every point of the ...
2
votes
2answers
139 views

Using the gap statistic to compare algorithms

I want to compare the performances of two clustering algorithms that give me different numbers of clusters. I recently learned about the gap statistic. However, from what I have learned, this ...
0
votes
1answer
39 views

How to define silhouette for one cluster?

I want to compare two clustering algorithms. I took data that the first algorithm gathered in one cluster. The second algorithm gave 3 clusters for the same points. In order to compare the results, I ...
0
votes
3answers
90 views

Scalability of Markov Clustering

I want to do graph clustering on a large dataset (A graph with 600,000 Nodes and tens of millions of edges). I read about Markov clustering. I saw this algorithm involved the calculation of a ...
-2
votes
1answer
41 views

k-medoids algorithm with incomplete distance matrix

I want to apply k-medoids algorithm using an incomplete distance matrix as input. How can I handle the lack of information of this matrix? Just ignoring the missing distances? Or is there a better ...
1
vote
1answer
34 views

k-core clustering algorithm

I am trying to cluster data. Each point in this dataset is connected to some other points. I want to define clusters "depending on how much the points are connected to each other". After some ...
1
vote
0answers
33 views

Random initialization with k-means clustering

I read on my machine learning course (on coursera) that random initialization performed several times and then taking the cluster with the lowest cose could help when the number of clusters is ...
2
votes
3answers
87 views

Performing PCA with only a distance matrix

I want to cluster a massive dataset for which I have only the pairwise distances. I implemented a k-medoids algorithm, but it's taking too long to run so I would like to start by reducing the ...
1
vote
0answers
35 views

How to extract structured information from a text string?

I have a text string containing unstructured data and I would like to analyze it in order to extract structured information. In particular, this text string specifies when a service is operational ...
8
votes
1answer
154 views

Where and why does deep learning shine?

With all the media talk and hype about deep learning these days, I read some elementary stuff about it. I just found that it is just another machine learning method to learn patterns from data. But my ...
0
votes
0answers
46 views

Time Period Predictive Modeling

I have been implementing some classification algorithms (Naive Bayes, SVM etc) recently on the iris data sets to get head start into the data science field. I enjoy working on machine learning ...
0
votes
0answers
24 views

Density estimation using knn

I am dealing with sentiment results of web articles. Sentiment is represented with two int values, +ve and -ve. For given article "xyz" I am getting different sentiments while testing at different ...
0
votes
1answer
57 views

Content-control (web filtering) using machine learning

I'm trying to build a content-control (web filtering) application using machine learning (just for training purposes). For example define gaming sites. I'm somewhat familiar with machine learning ...
0
votes
0answers
42 views

Gather insights from quarterly financial forecast data

I am trying to analyze a quite large (~25,000 rows) dataset of financial forecasts. The forecasts are usually not derived from algorithms, but come from a large number of analysts who forecast the ...
1
vote
1answer
103 views

Which of the following is a data mining task?

Which of the following is a data mining task? Select one: A. Search Google for “Indian National Flag”. B. Giving a 100% correct prognosis of the future success or failure for a new business. C. ...
0
votes
1answer
36 views

Add classification filter in Weka

There is a filter in Weka called "Add Classification". One can choose a classification algorithm and then can get the classification labels provided by the model generated by the algorithm, the ...
0
votes
1answer
31 views

Would one frequent term affect the textual document classification quality?

I'm trying to classify twitter messages. For example I collected some tweets about an earthquake and trained a classifier over it. A specific hashtag about the earthquake appears in almost all of the ...
-2
votes
2answers
99 views

Naive Bayes model [duplicate]

i am trying to implement the naive bayes algorithm in java. But i have a few confusions on the naive bayes model. What is the model of naive bayes? Is it a table ?how we can make prediction from the ...
2
votes
2answers
150 views

What are the must-read papers on data mining and machine learning? [closed]

What do you think are the papers that each graduate student in machine learning and data mining should be aware of?
1
vote
2answers
84 views

Most important journals in data mining/ML, NLP and IR?

Can you please provide with me with the names of the most important journals in data mining, machine learning, natural language processing and information retrieval?
0
votes
1answer
44 views

Extract Information from Traded volumes

Assume that we want to extract information from a constantly updating table like stock trading volume, where a banker can buy or sell at specific price. The table has the following 4 columns: price, ...
2
votes
1answer
105 views

Difference of Prediction between Graph Representation and Data Matrix Representation

In data mining, data can be usually represented in different forms such as records of a matrix, graphs or ordered data. While we find in research different papers addressing methods or solutions for ...
2
votes
2answers
101 views

Feature selection on microarray for supervised classification

I'm studying the task of feature selection on biological microarray, thats is high dimensional dataset (thousands of features) with small number of data points (lees than one hundred). This feature ...
0
votes
3answers
86 views

Classification performance and the feature set selection

I am now working on a classification problem. The generated feature set can be separated into two group. I did a comparison study: use all of the features; use the features of group 1 only; and use ...
2
votes
1answer
136 views

Performance metrics to evaluate unsupervised learning

With respect to the unsupervised learning (like clustering), are there any metrics to evaluate performance?
1
vote
2answers
45 views

Class labels in data partitions

Suppose that one partitions the data to training/validation/test sets for further application of some classification algorithm, and it happens that training set doesn't contain all class labels that ...
1
vote
2answers
240 views

notebook or desktop PC for datamining projects [duplicate]

I'm beginner in datamining. I will do datamining projects, tasks as data modeling(run different dm algorithms), preprocessing(ETL,complex SQL quieries). Is it sufficient for that tasks to use ordinary ...
0
votes
0answers
34 views

the relationship between training set size and precision/recall

With respect to a classification problem, I once heard the following comment: Adding more positive training cases can increase the recall; and adding more negative training cases can increase the ...
0
votes
1answer
100 views

Modifying decision function in LibSVM

The decision function for C-support vector classification is $sign(wT\phi(x)+b)=sgn(\sum_{i=1}^{l}y_i\alpha_iK(x_i,x)+b)$ How can I modify it to ...
0
votes
1answer
123 views

Feature selection and cross validation

I'm working on a project and I would like to know if the following strategy is good/correct. Sorry if this is a basic/stupid idea (I'm new to this). The input is a dataset with 2.500 features and ...