The tag has no usage guidance.

learn more… | top users | synonyms

1
vote
0answers
21 views

How to convert standardized line graphs into a function?

I have graphed revenues from 4 different products of the same variety (ie. four different movies and the revenues they brought in). The axes are: x is the weeks and y is the revenues; with the lines ...
1
vote
0answers
21 views

Evaluation of a ternary classifier

Are there standard evaluation procedures for non-binary classifiers? In my case I have "nested" classes, being absence and presence of an effect the first and usual binary categorization, but ...
0
votes
0answers
14 views

how i transform data from high dimension (feature space) to euclid space of original data

suppose i have X= 2^11 data with D=3 applying polynomial kernel function (kernel trick)to find kernel matrix K as kn*n kernel matrix ,solve eigen value problem to find principal axis and PC ....
0
votes
2answers
20 views

comparing set sizes of algorithms that explain strings from a blackbox algorithm

Let's say that i have a blackbox algorithm that takes no parameters, does not halt, and produces values at some rate. Now then, let's say that over 10000 values, the string always follows symbol 'A' ...
0
votes
0answers
8 views

How to model Dynamic Bayesian Network for represent mixture of gaussian hidden markov model

I have Mixture of Gaussian Hidden Markov Model of some process and i found some research represent Mixture of Gaussian Hidden Markov Model by Dynamic Bayesian Network and they told this can increasing ...
0
votes
0answers
29 views

How to evaluate the uncertainty of prediction in CRF?

I use MALLET for sequence tagging task using CRF. I want to detect the input sequences for which the tagging is of a low certainty. How can I do that?
0
votes
0answers
14 views

Attribute value pair - matching with machine learning

I am totally new to machine learning area. I am trying to understand one type of question that I have been thinking of how to do since awhile but could not be able to wrap my head around with a ...
-1
votes
1answer
66 views

Batch Active Learning for Classification

Say we have unlimited unlabeled data and we can ask an oracle for labels. We can use active learning to choose the most informative data samples for labeling, thus minimizing data labeling cost. If we ...
1
vote
0answers
38 views

Learning a transition function of a Markov decision process using infrequently sampled data

I have a dataset of battery trials, where a battery has been charged and discharged in different regimes, and its capacity was measured periodically to reflect the effect of the charging and ...
0
votes
2answers
47 views

perfect feature extraction doesn't exist?

Anyone is aware of any proofs that "perfect feature extraction doesn't exist" (on any domain, language, vision, etc). Either philosophical or mathematical, are fine.
0
votes
1answer
72 views

Algorithm to select predictors in Logistic Regression

I need to find a computer-driven way to come up with a model in logistic regression for an exploratory study using R. Usually I would just use the leaps or bestglm packages to find the best subset, ...
0
votes
2answers
99 views

R Caret - Repeated CrossValidation, finalModel and ROC curves

I got a problem understanding the meaning of the finalModel when using a repeated CV. ...
-1
votes
2answers
41 views

How to find similar kind of project specification using Clustering Algorithm?

I have budget estimation of some bio-medical projects and their specification details. Could any one suggest me how to do clustering algorithm to find the similar kind of specification. Which ...
0
votes
0answers
23 views

measure the convergence rate of SVM under cross-validation

I want to measure the convergence rate of my SVM based classifier, i,e how many data points are necessary to build an accurate classifier. I have an initial learning set from which I remove X% (X from ...
3
votes
1answer
84 views

What are the Fundamentals of Applied Statistics?

Would the knowledge of the following topics suffice for a crash course on fundamentals of applied statistics? Basics of Probability Descriptive Statistics Estimation Theory Hypothesis Testing The ...
0
votes
1answer
50 views

Recognition of digit of size other than those in the training set using DNNs

I have a DNN trained on MNIST data (image 1 for digit '4') that recognizes images from the test set with high precision. Each digit is centered and all of them are roughly of the equal size. Will it ...
0
votes
0answers
37 views

How do the following three courses on statistical learning theory differ

I have no prior knowledge about statistical learning theory so I have no idea how broad this discipline is. Doing a search online I found Stanford, MIT and ETH Zurich all have this course with its ...
0
votes
0answers
38 views

Uplift Model in Matlab

I was wondering if anyone had an idea how to implement an uplift model in Matlab. I have data for marketing campaign a company I am studying ran. I would like to test the impact of the marketing ...
0
votes
1answer
62 views

Which are the topics in machine learning that a newbie have to pick up if he is interested in the area of pattern recognition?

This question is asked by a newbie who is interested in machine learning but is absolutely new to it. ML is a very wide topic and it is too much for a newbie to learn everything, then start focusing ...
0
votes
0answers
22 views

Identifying Changepoints in Learning Data

I have a "changepoint" problem that I do not understand. The data for my MWE comes from one human player as s/he played the same video game for 31 one-hour sessions (no more than one session per ...
1
vote
1answer
38 views

what is the relationship between covariance matrix and its variance parameter in linear mixed model

In parameter estimation for linear mixed model for unknown variance, I met some statements saying that "we assume G (as variance) is only known up to its variance ...
0
votes
0answers
52 views

How to find parameters by output

I'm new to machine learning. I have a problem like this - i have an object O with many parameters, say 30 (a1 - a30). Each parameter is integer 0 <= N <= 100. O is being sent to a function F, ...
2
votes
0answers
40 views

Why is VC dimension important?

Wikipedia says that VC dimension is the cardinality of the largest set of points that a algorithm can shatter. For instance, a linear classifier has a cardinality n+1. My question is why do we care? ...
2
votes
0answers
143 views

Background required for understanding “Elements of Statistical Learning” [closed]

What background knowledge is required for understanding "Elements of Statistical Learning"? Is there more approachable book which covers similar topics"? I have considered following books: 1) ...
3
votes
0answers
218 views

nnet: Decay vs Learning Rate

I am dealing with the nnet package in R. I know that the momentum $\alpha$ is used to decrease the fluctuations in weight changes over consecutive iterations. The ...
0
votes
1answer
289 views

Setting random seed for neural network

I'm training a neural network for a particular problem which can be predicted with 100% accuracy. However, the problem is that results tend to vary between 99% and 100% even if I train 10 different ...
0
votes
0answers
111 views

Speech recognition using baum welch and GMMs

I have been working on a speech recognition program for a while now, implemented in java, it uses HMMs as structure model and Baum welch for training using gaussian mixture models. Features are ...
2
votes
0answers
76 views

Forming a likelihood (and/or conditional distribution of a random variable) from an implicit function

EDIT: This is now written in a more minimalist form for statistics/econometrics audience rather than the more Bayesian learning or Bayesian Nash Equililbrium style. My problem involves finding the ...
0
votes
0answers
6 views

training/learning a function from domain and range alone?

Usually in supervised learning we have a data set $D$, which informs you for a certain input $x_i$ we expect a certain corresponding output $y_i$, and the appropriate function $f$ is trained by ...
0
votes
0answers
44 views

suitable flexibility of statistical learning method and number of predictors and number of samples

Out of a flexible and an inflexible statistical learning method, which one is expected to perform better when the number of samples is extremely large and the number of predictors is small? the ...
1
vote
0answers
57 views

Perceptron Learning Algorithm: what is the probability that the viewed data is linearly separable, after some number of steps?

My understanding is that the PCA: will not converge if the data is not linearly separable might take exponentially many iterations, even if the data is linearly separable I'm wondering if, after $...
2
votes
1answer
506 views

How does linear SVMs function in multi dimensional feature space

Can someone please explain me how does linear SVMs function in multi dimensional feature space ? I'm not able to picture how a linear SVM can perform classification in more than 2 dimensions. Also, ...
0
votes
0answers
27 views

Multi-label multinomial logistic regression

I have stock data with about 50000 features and 20 labels. Each of the label can take one of three values: -1, 0, 1. I've divided the data in 9:1 ratio so that nine tenth of the data is used to ...
0
votes
0answers
27 views

VC Dimension of the set of canonical hyperplanes

This is a proof of the theorem about VC Dimension of the set of canonical hyperplanes from Professor Mohri's lecture slide. I'm having difficulty with understanding the inequality$$ \forall i \in [...
0
votes
1answer
51 views

Automation level calculation

Suppose you have an end to end process which contains a series of tasks to be completed. You also have process automated at certain tasks but the rest of the tasks are completely manual. Also, these ...
0
votes
1answer
72 views

Independence of data points assumption

While reading an ML book, I realized that most of the time, the input data points are correlated with each other, and hence their observation is not independent. But then, why do we assume that the ...
2
votes
1answer
81 views

Why do we have to be concerned about the problem of overfitting on the training set?

For a hypothesis set $H=\{h_1,...,h_M\}$, randomly sampled training set $D_{train}$, and a learned hypothesis $g$ using $D_{train}$, the VC-bound of a finite hypothesis set tells us $$ P[|E_{in}(g)-...
12
votes
1answer
285 views

In statistical learning theory, isn't there a problem of overfitting on a test set?

Let's consider the problem about classifying the MNIST dataset. According to Yann LeCun's MNIST Webpage, 'Ciresan et al.' got 0.23% error rate on MNIST test set using Convolutional Neural Network. ...
3
votes
1answer
81 views

In learning theory, why can't we bound like $P[|E_{in}(g)-E_{out}(g)|>\epsilon] \leq 2e^{-2\epsilon^{2}N}$?($g$ is our learned hypothesis)

Given Data $D_{in}$, number of data $N=|D_{in}|$, and hypothesis set $H=\{h_1,h_2, ...,h_M\}$. For a fixed hypothesis $h$, for example $h_1$, we can derive $$P[|E_{in}(h_1)-E_{out}(h_1)|>\epsilon]...
7
votes
1answer
283 views

What does VC dimension tell us about deep learning?

In basic machine learning we are taught the following "rules of thumb": a) the size of your data should be at least 10 times the size of the VC dimension of your hypothesis set b) a neural network ...
1
vote
2answers
80 views

Mixed model for learning data

I’m working with data from a learning experiment in birds and I have some doubts I hope you can help me clarify. I'm interested in comparing the performance in a learning task between male and female ...
0
votes
1answer
114 views

Classifier for weighted class label

Is there any rule-based classifier which be able to classify samples with weighted class labels. In other word, different confidence in tagging samples. My problem deals with learning samples from ...
2
votes
1answer
33 views

Information content of a set of random variables

Suppose there is some distribution $F$ not known to us. However, we can get information about this distribution by means of samples, i.e. we have a set of random variables from this distribution. ...
0
votes
0answers
85 views

Remove column which has weak correlation between other

I have data set which contains 12 feature columns. The last one has Pearson correlations between 0.001 and 0.09. For Spearman and Kendall correlations are worth. Can improve the performance of ...
1
vote
1answer
180 views

Nonlinear Autoregressive model parameter estimation from time series

I'm working on a nonlinear multivariate autoregressive model of order 1 (markovian). It is a discrete-time dynamical system which models exchange of mass between compartments in a compartmental model ...
0
votes
1answer
25 views

Viability of software dev - Use of and requirements of NN

Hello I would like to know this two things regarding the viability of producting a software, so: 1) Are available on internet some OCR libraries for free? Can I train my own NN having only a laptop? (...
3
votes
2answers
254 views

Mixing proportion $\pi$ in Mixtures of Gaussians

I am trying to understand a little better mixtures of Gaussians and their generative approach in general. For a mixture of Gaussians we start with this formula: $$p(x)=\sum_{k=1}^{K}\pi_{k}\cdot N(x|\...
0
votes
0answers
19 views

What can I possibly get from my data to find what I need?

I am an end-user of a program. This program returns an output based on an input (a file + a database). I have made a few tests with differents files and databases, then constructed a CSV file of the ...
1
vote
0answers
47 views

Normal learning - multiple signals

I'm having trouble with the exercise below. I know that $E(η_t|z_t)= E(η_t) + [Cov(η_t,z_t)/Var(z_t)](z_t - E(z_t)) $ but still can't show 'b'. I imagine I'm missing something very simple... Can ...