Tagged Questions

94 views

Combining p-values from different statistical tests applied on the same data

Although the title of the question appears trivial, I would like to explain that it is not that trivial in the sense that it's different from the question of applying the same statistical test in ...
47 views

Which test of significance should be used on a survey question with multiple response

I asked a simple survey question and gave 12 options where an individual can choose from 1-12 items. I calculated the frequencies of each item by taking the number of responses to the particular item ...
21 views

One experiment with many (dependent!) hypotheses for motif prediction in dna sequences

I am having the following problem. I have a group of words which are all permutations of each other. On a random dataset of DNA sequences I can calculate the distribution of the number of word ...
100 views

When can we look at the significance of pairwise comparisons rather than an interaction term?

I will defend my Master's thesis on Thursday, and I have a doubt about an analysis that I have to present. In my experiment, I had two independent variables: Age category (SU = senior unemployed ...
151 views

Pairwise Correlations--Multiple Comparison Correction

I have a dataset with two sets of variables defining each sample. I am performing pairwise correlations between each variable in the first set with every variable in the second set. I essentially ...
48 views

I have a non-signficiant ANOVA for a between subjects variable, but a significant planned comparison, is this allowed?

As the title states, I ran an ANOVA and have a non-significant p for a between subjects variable that I wanted to use pairwise comparisons. I designed the study though with a planned comparison ...
94 views

Implications of trying multiple tests for an analysis

Let's say I have a fixed set of data containing one variable. I'm interested in whether the variable shows a difference between two conditions. Now I perform a test and determine a p-value somewhere ...
295 views

Multiple t-tests vs. one-way ANOVA

I'm working on a classification problem and I have a very high F1 baseline of 85%. I have trained three classification models and I want to know which one is the best. How can I do so? I tried two ...
187 views

Statistical test for multiple comparison with dependent observations (MATLAB)

I want to use matlab to perform a statistical test to find if there's a significantly higher mean return in any of n different sample populations. However, I can only find post hoc (although they can ...
183 views

Multiple hypothesis testing and F tests?

Does the multiple hypothesis testing problem apply to the calculation of an F statistic for joint significance? It seems to me that the more variables you are including in your test for joint ...
52 views

3 groups of 8 with a different treatment each, over 45 minutes - confused as to stats test needed

I have three experimental groups. Each will provide a 15 minute baseline before an addition of either drug A, drug B or a saline control. Each group has an N of 8 as maximum, but possibly as low as 6 ...
2k views

How can you have a non-significant multiple regression model w/ significant predictors? [duplicate]

Possible Duplicate: Not-significant F but a significant coefficient in multiple linear regression How can a regression be significant yet all predictors be non-significant? Significance of ...
533 views

Practical significance, especially with percents: “standard” measure and threshold

I, like many people, dislike statistical significance testing. I would much rather measure "practical significance" / effect size. The problem is that I do not know of a "standard" way of doing so. ...
148 views

Alpha correction in a family of tests

Suppose that one runs 8 correlation analyses but in two separate batches: Would the alpha-correction apply to all 8 tests as a family or each of the 4 tests as a family? For example, if there are two ...
122 views

Probability of accidentally producing significant results

I have a problem, which I think should be very common, but I mostly have been taught stochastic at university and most of my statistics knowledge is self-taught. Hence I have no clue on how to look ...
207 views

Multiple comparisons for parameter significance in a sparse high dimensional regression model

I have a regularized linear regression model with a large number of parameters (~100,000) that has been optimized using a sparse fitting algorithm (coordinate descent with early stopping). The model ...
127 views

Statistical significance for correlated significance tests

I refer to this article http://www.scientificamerican.com/article.cfm?id=the-mind-reading-salmon. Is there a p-value equivalent for a set of significance tests, especially in the case where some of ...
7k views

Threshold for correlation coefficient to indicate statistical significance of a correlation in a correlation matrix

I have computed a correlation matrix of a data set which contains 455 data points, each data point containing 14 characteristics. So the dimension of the correlation matrix is 14 x 14. I was ...
160 views

How to compare results from two groups?

I'm getting confused with the analysis of one of my experiments. Here is how the results look like. There were P participants in the experiments and they were split into two groups P1 and P2. Every ...
1k views

Analysing questionnaire data

I want to test if there is a rivalry among two siblings in a family. I have 15 questions in my study and I let my 100 respondents ( distributed equally to two siblings) ranked them 1 to 15. How ...
149 views

Removing macro-level time variance

The title might be a bit misleading. Unfortunately statistics is not my area of forte, so gentle guidance along the right path is much appreciated. That said, here's my problem: I'm working on ...
218 views

Do the null hypotheses used for benjamini-hochberg have to be identical?

There are some cases where I would like to correct for multiple comparisons where the null hypotheses vary. For example, if I am performing a chi-squared test or a fisher's exact test on multiple ...
209 views

How can I control the false positives rate?

I feel I'm pretty new to this, since some time passed since my last statistics assignment, so please bear with me. I am analyzing results of a biological experiment. Basically, I'm looking at a some ...