# All Questions

169,117 questions
Filter by
Sorted by
Tagged with
7 views

6 views

### RandomForest , confidence interval for class membership probabilities

I would like to calculate confidence intervals for predicted probabilities of a class membership obtained with randomForest. I know I could use predict.all in randomForest(), which gives me the ...
15 views

13 views

### Hypothesis tests in Machine Learning: Independence assumption violated?

Assuming I have a training set that is used to train 3 different random forest models. The values of the response variable $y$ are the same for all of the 3 models. But the predictors $x$ differ ...
6 views

### Which output activation is recommended when predicting a variable with a lower but not an upper bound?

I need to predict something using a neural network. The output values are bound to be non-negative, but there's not really an upper bound. I do know that the output is never going to be higher than a ...
12 views

### Probability of drawing two differently colored balls in a partition of equally sized partitions

If I randomly distribute, say, 100 red and 10 blue balls onto a field of 10000 square meters (100*100 m), how would one calculate the chance of having at least one red and at least on blue in the same ...
19 views

### When should we use splines in regression? What's the justification?

I am examining the direct causal effect of x on y. Let's assume we a model as follows y ~ x Shows no significant effect of x on y. The reason may be that x ...
7 views

### training variational autoencoder - loss is 0 val loss is 0

I am training a VAE in Keras on the colab. The issue that I am encountering is that after the first epoch the loss is 0 and the validation loss is 0 (but the model didn't learn anything). this is the ...
10 views

### How to calculate and interpret a marginal treatment effect (local instrumental variable)? (Intuition through simple example.)

I am working on the intuition behind local instrumental variables (LIV), also known as the marginal treatment effect (MTE), developed by Heckman & Vytlacil. I have worked some time on this and ...
4 views

### DAG: causal direction unknown

I have a DAG as follows. Interested in the direct effect of E on O. Plus interested in publishing an article with a sound methodology. There definitely (read: highly probably) is a causal direction ...
8 views

### Probability of FP in One Dataset

I read the following Notes: how this probability is calculated? (I think FP Rate from these 3 Data on Axis).
71 views

### Is there a test that uses $|{\mu_A}-{\mu_B}|\le \delta$ as the null hypothesis?

In the usual t-test, the null hypothesis is that "the difference between the means of the two groups is zero". My Question: Is there a test that uses "the difference between the means ...
6 views

### How to control for Co-variate shift in test data set compared to train data for regression task?

I am working on a regression project. But I am facing the problem of covariate shift in features due to time delay.Test data was collected a year later due to which there has been some change in ...
12 views

### Changing L2 regularization constant in logistic regression proportionally to the number of columns/rows in the dataset

I'm trying to use scikit LogisticRegression to solve a multiclass text classification problem with variying number of columns (unigrams) in the trainging datasets. From what I understood, L2 ...
4 views

### improve detect filter microphone deepspeech [closed]

We saw an error when we connected the microphone to the neural network in deepspeech https://github.com/mozilla/DeepSpeech For example, the user says Hi And software in the output H Typing. What ...
12 views

### Obscure Error when Fitting CatBoostClassifier in Python

I am receiving an obscure error when attempting to fit a CatBoostClassifier to training data. I have created a simple dataset below to help illustrate the problem: ...
10 views

### Transforming Logistic Regression Model

I have a Logistic Regression Model in R ...
4 views

### How to Calculate the Pearson correlation coefficient between the bits of a 32 bit Hash value

I am new to statistics. I am checking the uniformity of the hash functions. There are examples to find the correlation between two values. I don't know how to find the correlation between the bits of ...
4 views

### MLE for the number of samples given $k$ largest values

I'm given the $k$ largest of $n$ i.i.d. samples, and I wish to estimate $n$. Let $F(v)=p(X\leq v)$. Then I believe that the probability of having exactly $k$ of $n$ samples greater than $v$ is ...
9 views

### General question about oversampling with TSNE or PCA

I have an unbalanced dataset and I am planning to use over-sampling (resampling) and finally, I want to use PCA or TSNE for a better demonstration of the data (the data has more than 50 dimensions). I ...
5 views

### random effect with one observation per group improves AIC drastically — explain

Now that I've posted an example (for a different purpose) at How will random effects with only 1 observation affect a generalized linear mixed model? (resulting in creating an account here, and being ...
23 views

### Proof that the mutual information I(X;Y) between two random variables X and Y is 0 if and only if X and Y are independent

On the Wikipedia of mutual information it says that $I(X;Y)=0$ if and only if $X$ and $Y$ are independent. I can proof that if $X$ and $Y$ are independent, then $I(X;Y)=0$, because $p(x,y)=p(x)p(y)$. ...
21 views

### Does this scatter plot suggest non-linearity?

As part of assumption testing for ordinary least squares (OLS), I am examining the linearity between the variables in my model. I'm using scatterplots between the independent variables (IVs) and ...
5 views

### When using Linear Discriminant Analysis and k nearest neighbours in classification, which is better?

I am currently performing classification on the Iris dataset. I used both LDA and kNN methods to classify the data. I found both to be highly accurate and cannot decide which one is more appropriate ...
9 views

### Appropriate model for classification problem with monthly observations for same customer

I'm looking for some help understanding what the appropriate method would be for the classification problem(well really I want the probabilities) at hand. The event that is being predicted is whether ...
15 views

### Which hypothesis test should I use for this given situation?

Let's say I have lot of users who spend money on various items. Considering Item A: For this item, I want to find whether there is a statistical difference in average spending in the month of October ...
5 views

### May Skilling's Nested Sampling Estimate parameters in hierarchical model?

May Skilling's Nested Sampling integration technique Estimate parameters in hierarchical model?
16 views

### MLE in Time Series

Can someone describe how MLE is calculated for a time series model? Conceptually I understand that: Likelihood = Conditional Probability = P ( data I theta ) where data are the observations and theta ...
14 views

### Is a variable on scale 1-100 considered ratio or interval level?

Is the variable at ratio or interval level if it can take any value between 1 and 100 but not 0? I cannot determine using the definitions of ratio and interval variables.
4 views

### Memoryless conditional expectation of shifted function exponential

Related to this, is the following valid: \begin{align} E[f(X-t) \mid X>t] = \int f(y-t) f_{X|X>t}(y) dy = \int f(x) f_{X|X>t}(x+t)dx = \int f(x) f_X(x) dx = E[f(X)] \end{align} where I make ...
35 views

### Shape of MSE in polynomial regression

In polynomial regression, an increase in the degree of freedom can cause high variance and low bias. So model overfits on the training set and loses its generalization. On the other hand with a low ...
5 views

### Are there problems with using Ordered Quantile (ORQ) normalization for Multivariate Analysis?

This is intended as a general question, as a Google search for -- "Ordered Quantile" "ORQ" normalization "Multivariate Analysis" -- returns nothing. This option is listed ...