0
votes
0answers
26 views

How to check that the selected features are not overfitting

I'm trying to select best features for sentiment classification for a set of reviews, and using penalized SVM and Logistic regression to perform such task. by basically iterating over different ...
1
vote
1answer
123 views

Curious distribution

While checking my Android App Rating I saw this It's almost a quadratic progression! Is there any explanation for such a rating?
3
votes
1answer
46 views

Is stratified meta-analysis more or less objective than meta-regression?

Reviewer asked me why I use meta-regression as a way how to deal with heterogeneity among effect sizes instead of conducting stratified meta-analysis. I tried to google "stratified meta-analysis" and ...
1
vote
0answers
25 views

Maximum Entropy classifier, high precision but low recall

I'm working on a sentiment analysis study of twitter data using the Maximum Entropy classifier. I've gathered dozens of thousands of tweets. To produce features, I used unigram, bigram and dictionary. ...
1
vote
1answer
52 views

Hourly predictions using time series

I'd like to build a model based on time series. I have a dataset with records every 30 minutes for three months. What is the difference between modeling these data with the following kinds of ...
0
votes
1answer
22 views

Finding maximum likelihood estimates of parameters of multiple normal populations

I've just started studying maximum likelihood and likelihood ratio tests. I've calculated the maximum likelihood of a normal population with unknown mean and variance. However, I've been given this ...
2
votes
1answer
30 views

A reference for Pearson's chi-squared testing

I am wondering if there is a reference for the Pearson's chi-squared test suitable for technically-sophisticated audience that simply presents when the test (in its various forms) is appropriate and ...
0
votes
0answers
9 views

Add data series to highlight cases on a box plot (Excel, SPSS or R) [migrated]

first time user of this forum - guidance on how to provide enough information is very appreciated. I am trying to replicate the presentation of data used in the Medical education field. This will help ...
0
votes
0answers
14 views

Application of Inclusion-Exclusion Principle for circular arrangements

N people are invited to a dinner party and they are sitting on a round table. Each person is sitting on a chair there are exactly N chairs. So each person has exactly two neighboring chairs, one on ...
0
votes
1answer
34 views

What is maxout in neural network?

Anyone can explain what does maxout layer do in neural network? How to perform it? What does it different to normal activation function? I try to read the 2013 "Maxout Network" paper by Goodfellow et ...
2
votes
0answers
19 views

Empirical confidence bands

Suppose I would like to evaluate how well, the following kernel density estimator $$\hat f (x) = \frac{1}{nh}\sum_{i=1}^nK\left(\frac{x-X_i}{h}\right)$$ works. I simulate data 1000 times and obtain ...
0
votes
0answers
7 views

How to add a fixed variance structure do a GAM

I am using GAM to fit a smooth line to represent the recovery of timber stocks following forest harvest. The data is heterogenous and I do not want to transform it. I understand that a nice way to ...
0
votes
0answers
20 views

Confidence interval of a function of Maximum Likelihood estimates

I know the distribution of $x$. The distribution of $x$ is a function of $Y$ i.e. $P(X=x \space |\space Y)$. I observe one $x_i$ in nature and I want to calculate a confidence interval for the actual ...
0
votes
0answers
5 views

How would you get the standardized coefficients in errors-in-variables (EIV) regression?

I had some occasions to use the EIV regression in Stata, (and R, with the program built by Culpepper & Aguinis, 2011, "Using analysis of covariance (ANCOVA) with fallible covariates"), but I ...
2
votes
1answer
21 views

Confusion about confusion matrix, or why 'power of test' + $\beta$ = 1?

Consider a confusion table summarizing the outcomes of $n$ tests of hypothesis $H_0$ for $n$ independent experiments: ...
5
votes
2answers
143 views

Statistical significance of birth month of professional boxers

I looked at the birth dates of the top 100 ranked professional boxers of all time (67 of them to be exact). 40% of them were born during certain 3 month-long time periods. If birth date of boxers ...
5
votes
1answer
38 views

What is the best visualization for Cramér's V?

When visualizing a linear correlation between two continuous variables, one uses a scatter plot, usually in combination with the Pearson product-moment correlation coefficient. When doing the same for ...
3
votes
1answer
28 views

Best clustering algorithm for real estate data

I want to cluster real estate data to determine average price patterns in city and rural regions. My data set contains size, number of dorms, bathrooms and coordinates of the properties. Which would ...
2
votes
1answer
15 views

Normality requirements across tests

I would like to understand the reason why normality is required in many tests. T-tests: I read that what needs to be normal is the sampling distribution rather than the sample distribution. But since ...
0
votes
1answer
16 views

Combining multiple p-values

Is there any statistically relevant way to combine multiple p-values measuring different hypotheses but that are all trying to measure the same thing "in spirit"? Eg, if I wanted to measure some ...
0
votes
0answers
8 views

How to analyse categories ranked 1 to 5 between two groups

I currently have 5 categories. I asked two groups to rank activities from 1 to 5: 1 is the most preferred activity and 5 the least preferred activity. How could I analyse this to see if there is a ...
0
votes
0answers
19 views

cumulative uncertainty with time series predictive model

So I have a time-series with a set of variables a, b, c... and another measured variable y. What I do is using the initial state of a,b,c and y (at t0), I predict what y "should" be at the next time ...
3
votes
3answers
164 views

Why Normalizing Factor is Required in Bayes Theorem?

Bayes theorem goes $$ P(\textrm{model}|\textrm{data}) = \frac{P(\textrm{model}) \times P(\textrm{data}|\textrm{model})}{P(\textrm{data})} $$ This is all fine. But, I've read somewhere: ...
1
vote
0answers
28 views

Two-proportion z test: is it best for my problem, and can I pool data from multiple “replicate” populations?

I am examining populations (cultures) of yeast cells and scoring them for a particular trait. The data is categorical; within a population, a yeast cell either has the trait or it does not. I wish ...
0
votes
0answers
10 views

Combining different metrics to calculate composite score

Let's assume I have 3 metrics to evaluate a student. 1)Test Marks (0-50) 2)Weight of the student (KGs) 3)% Attendance (0%-100%) I want to calculate a total composite score which is a function of ...
0
votes
0answers
6 views

fixed-effect nested factors in R with only SOME combinations present

I have a large data wth numerical response and two categorical factors: date and site. There are about 350 dates and 25 sites, but not all sites have observations on every single date (most have only ...
0
votes
0answers
11 views

Confused about cross validation for model stacking

I'm reading section 8.8 of Elements of Statistical Learning, and though I keep reading the section on calculating the ensemble weights I'm missing something. It says that the stacking weights are ...
0
votes
0answers
23 views

Model failed to converge

I'm doing a variable selection for the interaction gender:type2 now ...
0
votes
0answers
23 views

What are parametric models? [duplicate]

The term Parametric Models does not sound unfamiliar to me, but I do not exactly know what they are. Can you please briefly explain what model is parametric and ...
3
votes
0answers
31 views

Weibull Mixture question

Is it possible that a mixture of Weibull RVs is also Weibull distributed, and if yes, what are the necessary conditions?
2
votes
1answer
55 views

Recommendation: Fast algorithm for logistic random effects?

What is the fastest algorithm for fitting a simple logistic 'random effects' type model, with only one level of categorical predictors? Another way of putting it might be a logistic regression with ...
0
votes
0answers
42 views

Correcting data for mean but also variance

My data: I have data that range from 0 to 2 for numerous individuals. The scores are more or less normally distributed and vary continuously, but the scores are always between 0 at the minimum and 2 ...
0
votes
0answers
16 views

Probability-generating function of two independent Poisson random variables [duplicate]

Let $X_1, X_2$ be two independent Poisson random variables with mean $\lambda_1, \lambda_2$, and $S_2 = a_1 X_1+a_2 X_2$, where the $a_1$ and $a_2$ are constants. Is it correct, that ...
0
votes
0answers
16 views

Linear mixed models

I have some spatial measurement for two quantities, x and y. y is my dependent variable that I am looking to build a linear mixed effects model.Each point in space (lat,long) has one value of x, for ...
2
votes
2answers
38 views

Classification Algorithms

Rather than due a google search and hope to find "the best" or an exhaustive list of classification algorithms I thought it might be easier to pose my questions here, and then get advice from you ...
0
votes
0answers
6 views

How to keep modified/downloaded package [migrated]

R noobie here. I'm am trying to use a package that I download off of github using source_gist, but it appears that I need to re-download it every time I quit R ...
1
vote
1answer
41 views

Curvilinear relationship with moderator

I am trying to moderate a curve and determine which equation I should follow. A simple curvilinear relationship has the following equation: (1) $Y = b_0 + b_1X + b_2X^2$ (i.e. a linear term and a ...
0
votes
1answer
49 views

What to do after running an exploratory factor analysis?

Say I asked 1000 people to evaluate 10 items about one product. The data looks like ID item1 item2 …item10 1 2 3….. After running an explorative factor ...
6
votes
1answer
41 views

Determining probability mass function (PMF) using Bayesian approach

For instance, a person is trying to determine the light intensity (unit: Candela) from a source that he knows must be coming from one of the 3 mediums (A, B, and C). From his experience he have ...
3
votes
0answers
31 views

Characterize this discrete distribution

Suppose we have $k$ buckets, with an infinite number of balls in each bucket. The balls within one bucket are indistinguishable, those between buckets are. We assign to bucket $i$ a probability $p_i$ ...
0
votes
1answer
17 views

Multiple Regression - Converting Standardized Coefficients to Unstandardized

I recently performed a multiple linear regression using a standardized set of data, and I was wondering if it possible to convert the standardized coefficients from the regression into usable ...
2
votes
3answers
26 views

Ordinal variable with 'don't know'

Can a variable that contains 'don't know' as a response be ordinal? For example, say the variable corresponds to responses to the question 'Do you agree with ...?' where the responses are: Agree ...
0
votes
2answers
18 views

Paired T test vs 2 sample t test

I have been given data that includes 20 different households and what each household spends on grocery and restaurant. I need to run a t test and I'm not sure if I should use a paired t test or a 2 ...
8
votes
5answers
109 views

What is the relationship between $p$ values and Type I errors

In hypothesis testing we set an accepted level of Type I error probability $\alpha$ and observe whether a sample statistic is equally likely or less likely to be observed if the null hypothesis was ...
0
votes
0answers
23 views

What is the derivative of a matrix with respect to f? The matrix has softmax function in it

I need the derivative of W, which has the following expression. W is matrix which contains entries from softmax function. I couldn't find the derivative.
0
votes
0answers
7 views

Sample size in the Latin Hypercube simulation to calculate P90, average and P10 and number of variables relation

I am preparing some simulations to determine the P90, average and P10 of a parameter. How many runs do I need to have to get a reliable answer (let's say 5% margin of error and 95% confidence)? It ...
-1
votes
0answers
15 views

Sample Mean and Sample Standard Deviation [on hold]

How do I calculate sample mean from the question like below: A company has following samples of leaking goods with gaps 0.290, 0.104, 0.207, 0.145, 0.104,0.124. I couldn't understand the question ...
1
vote
0answers
9 views

Recaculating control limits when an out of control situation is displayed

When plotting control charts if a point plots outside the control limits then the reason for that point to plot outside is checked and if an assignable cause is found to be the cause then after ...
2
votes
2answers
27 views

Imputing using CFA for use in a Cox regression

I am using CFA (confirmatory factor analysis) to create a measurement model of social capital that is to be used in a Cox regression. Because of missing data I first impute the incomplete data by MICE ...
-1
votes
0answers
11 views

Moderating a curve [on hold]

I have a paper that has a main relationship with a negative curve. It actually looks like a left leaning hockey stick. We have three moderators - two that strengthen the negative slope and one that ...

15 30 50 per page