Statistical significance refers to the probability that, if, in the population from which this sample were drawn the true effect were 0 (or some hypothesized value) a test statistic as extreme or more extreme than the one gotten in the sample could have occurred.

learn more… | top users | synonyms (2)

1
vote
0answers
15 views

Sample of one, extermination of fruit flies and daily life challenges

First of all, I'm very well aware that a sample of one is ridiculous in any normal scenario in the domain of statistics, and I know that any rationale from this would probably only have esoteric ...
0
votes
1answer
40 views

I got a dataset, there are about 400 variables,most of them are quite similar [on hold]

I got a dataset, there are about 400 variables, most of the variables are quite similar. Actually, I would like to say their number are pretty close, but I think they won't too correlated, since the ...
1
vote
1answer
39 views

What statistic to use

My 8 year old daughter is conducting an experiment to assess memory. She has 3 groups. Condition 1, Condition 2 and ...
0
votes
0answers
9 views

Creating Bin in graph by R from a set of data [on hold]

I have 1000 of data of mean temperature and daily rainfall of specific area. I need is to make a graph by using R software. I had already made the structure and summary of those given data. Now I have ...
0
votes
0answers
27 views

Testing of sensitivity for different algorithms

I have some queries I would like to discuss, I am doing some analysis for sensitivity. I am not from the field of statistics. I work with RNA-Seq data. The thing is I have found some genes which are ...
0
votes
2answers
15 views

Calculating chi-squared values for percentages?

I'm using scipy and I'd like to calculate the chi-squared value of a contingency table of percentages. This is my table, it's of relapse rates. I'd like to know if there are values that are ...
0
votes
0answers
4 views

How to compare series of foreclosure rates wrt to time and place

I have three categories of foreclosure rates in NYC (rates are number of foreclosures per 1000 homes). The three categories are: overall rates of foreclosure, rates for homes within a flood zone, and ...
0
votes
0answers
11 views

How can you calculate significance with 3 groups of uneven samples? [closed]

How can you calculate significance with 3 groups of uneven samples?
2
votes
0answers
21 views

Visualise significant differences in a contingency table?

I'm working with pandas and scipy, and I would like to find a quick way to visualise unusual values in a contingency table. Say this is my contingency table: ...
0
votes
2answers
31 views

Pearson correlation test for non-gaussian data

I want to perform significance test for correlation coefficient. However my data is not normally distributed. In my books I have found tests only for the normally distributed data. Is there such test ...
0
votes
1answer
13 views

Compare datasets from two machines [closed]

I have two data sets from two machines about their cpu, mem for n intervals of time. Machine 1 = [(cpu1, mem1), (cpu2, mem2), (cpu3, mem3), (cpu4, mem4), .... (cpuN, memN)] Machine 2 = [(cpu1, ...
10
votes
1answer
1k views

Could it be shown statistically that cars are used as murder weapons?

I heard a story recently in which someone said if they wanted to kill somebody (and get away with it) they would do it with their car. They cited various statistics about the number of auto-related ...
0
votes
0answers
18 views

which statistical significance to rely on?

Hello, I'm trying to estimate the relationship between oil price and gdp. My question is should I test for statistical significance for each estimator or should I test the statistical significance ...
1
vote
0answers
18 views

Statistical test for cumulative curves

I have three treatment groups represented in three cumulative curves. What is the best test to show differences among them.Knowing that treatments were observed cumulatively for only seven days.
1
vote
0answers
12 views

Test for pairs of small integers

I have two classifiers, say $A$ and $B$ and I am performing 10$\times$10-fold cross-validation on them and record the number of instances correctly classified from the test set. Unfortunately, the ...
0
votes
0answers
17 views

Consistent Questionnaire Responses

I want to ask please questionnaire responses in Likert Scale. I have got some respondents who had consistent answers for a large number of questions. For example, over 75% or 80% answers (in different ...
2
votes
3answers
528 views

How do you interpret a significant but weak correlation?

I have carried out a number of Pearson Chi Square tests on the relationship between tail lesions and abscessation in pigs. I have found a significant (p = 0.005) but weak (Cramers V = 0.288) ...
0
votes
0answers
16 views

Testing significance of a treatment inducing correlations over a time series

Example data In the example dataset, there are 3 distinct biological measurements, over 3 time points (0,12,24hrs) for 19 individuals. These individuals have been divided into 2 groups: treatment and ...
0
votes
0answers
9 views

probability life similarities in a population cross section

I have just read up on Bouchard's Minnesota Twins study that turned up some amazing identical similarities in the lives of some identical twins reared apart. Both had same jobs, married and divorced ...
0
votes
0answers
20 views

Significance of linear combination of two insignificant regression parameters

I'm running a model with an interaction term, of the general form: $Y=b_1X_1+b_2X_2+b_3X_1X_2$, whereby $X_2$ is a dummy variable and $X_1$ is continuous. Neither $X_1$ nor $X_2$ turn out as ...
2
votes
0answers
34 views

Testing correlation between two variables when there are other variables involved

I want to see if there is any correlation between number of pages in a paper and the citation it receives. If I just plot number of pages vs number of citations of a paper, I might get a correlation, ...
4
votes
1answer
151 views

What does “statistically insignificantly worse” mean?

I am reviewing a paper where I found this sentence repeatedly: A is statistically insignificantly worse than B I consider this to be confusing since, for me at least, it is not immediately clear ...
1
vote
0answers
19 views

Significance testing between two sets of Pearson's correlation coefficients

I have been reading through questions here to find an answer to my question but didn't find a satisfactory one. Here is my scenario: I have a system computing an algorithm on each of 100 units (so ...
1
vote
1answer
29 views

Testing the hypothesis on clustering

I have a number of samples. For each, there is a time course of multivariate data defined, with $t$ timepoints ($t < 50$) and $n$ variables ($n > 100$). We have noted that the time courses of a ...
1
vote
2answers
71 views

Test if two binomial distributions are statistically different from each other

I have three groups of data, each with a binomial distribution (i.e. each group has elements that are either success or failure). I do not have a predicted probability of success, but instead can ...
2
votes
1answer
113 views

Can we skip the lower order terms in interactions? [duplicate]

This question is about three-way interaction and the possibility of applying without second lower terms with keeping the main variables in the equation not like the other questions. In fact the other ...
0
votes
1answer
55 views

Imputation model: Pooled model is insignificant. How to interpret?

I have ordinal data on three IVs ranging from 1 to 5 as below: IV1: Not at all Important - Very Important IV2: Not at all Satisfied - Very Satisfied IV3: Performs much Worse - Performs much better ...
1
vote
0answers
28 views

How to test for a home bias in a data set?

I'm trying to think how I can test a data set I have, for transactions between buyers and sellers, for a home bias. My hypothesis is that buyers would rather buy from a merchant from their home ...
1
vote
0answers
41 views

Which post-hoc comparison to use and why

Hopefully this is now a much clearer picture of the question I want to answer: For each of 60 different plans I ran 35 simulation replications of my Agent Based Model (ABM) simulation. Then for each ...
1
vote
1answer
31 views

How can a distribution of cross-validated $R^2$ scores be used to determine whether one model is significantly better than another?

I have two models, A and B. I have performed 10-fold cross-validation on both of them, so now I have 10 $R^2$ scores for each. How can I determine whether one is significantly better than the other? ...
2
votes
1answer
47 views

Relative increase between two pairs of samples

Consider the following samples from four distributions: $a = \{20, 2, 200\} \qquad\qquad c = \{1, 10, 100\}$ $b = \{22, 2.2, 220\} \qquad\quad\:\,d = \{1.2, 12, 120\}$ I would like to say that the ...
1
vote
0answers
8 views

permutation test with a distribution of correct values

I want to test my classifier performance using a permutation test. I know how to test one actual value against a null distribution of values generated by randomly reassigning labels to my two classes. ...
1
vote
0answers
14 views

Likelihood Ratio as statistical test for Transfer Entropy with MatLab

I estimated a Transfer Entropy value TE(XY). Now I want to establish the statistical significance of the estimated value. Therefore I used the method of shuffled surrogates to estimate a shuffled ...
0
votes
0answers
25 views

main effect and interaction effect

I faced difficulty with my data analysis output. I had two factors with split plot design. Separately, the main effect of the two factors on soil pH was significant. But their interaction effect was ...
0
votes
0answers
11 views

How to calculate whether a change in expenditure is statisically significant

Sorry, this is probably very basic... I have data on expenditure over 3 years. This expenditure is made up of 2 products L and H. L has been increasing and H has been decreasing, so overall L+H is ...
23
votes
4answers
757 views

Is the “hybrid” between Fisher and Neyman-Pearson approaches to statistical testing really an “incoherent mishmash”?

There exists a certain school of thought according to which the most widespread approach to statistical testing is a "hybrid" between two approaches: that of Fisher and that of Neyman-Pearson; these ...
0
votes
1answer
18 views

Non-response bias (many waves, time span between waves not consistent)

I want to ask regarding non-response bias. I have sent my questionnaire on-line to SMEs in Malaysia. However, I have sent reminders many times (around 5 times). However, now I cannot recall when the ...
0
votes
0answers
27 views

Correcting for multiple testing on non-independent sliding windows

Question Values taken from adjecent windows in a sliding windows are corrolated. If I calculate a p-value from each window, how can I correct for the fact I have tested many windows, given that the ...
2
votes
2answers
51 views

Confidence intervals which contain 1 but the z test and p value are significant

I calculated the confidence intervals for the regression coefficients using the formula: SE X 1.96. I then took this value away from the regression coefficient to get the lower confidence level and ...
0
votes
0answers
20 views

How to down weight correlations in my microarray analysis?

Background: I have been tasked in one part of my analysis to reproduce a method used in another study as follows in bullet points form: Microarray data from a number of time points Calculate ...
0
votes
1answer
71 views

How can a regression be significant yet both predictors be non-significant? [duplicate]

I know this question has been asked in a slightly different form here. But my question differs and because of the forum rules I can't post on that thread. I have 2 independent variables, n=32, highly ...
0
votes
1answer
68 views

High Standard Deviation for Leave one out cross-validation?

I am using the leave one out cross-validation technique to evaluate my model. If the prediction on the test sample is right the output is 1 otherwise 0. So I have a array of N samples with 0's and 1's ...
0
votes
0answers
25 views

$J$ statistics to $p$-value of $J$ statistics an vice versa

I am not entirely sure if I should ask this question here, but does EViews has a function of converting J statistics to p-value of Jstats, or other way around. I am running several GMM estimations ...
0
votes
0answers
15 views

How To Determine Association Plot in R and p-value

I have created a contingency table and an association plot in R and I am not quite sure how to interpret it. Here is my contingency table: ...
0
votes
0answers
14 views

Statistical test Comparison of

I have some ordinal data (no. of exits from opiate treatment, by type (planned unplanned exits etc.). I want to know if last years figures have a statistical probability of being different from ...
0
votes
0answers
31 views

Bootstrapping results for p-values of trading rule profit significance

I want to obtain p-values for the significance of trading rule profits as described by LeBaron and Brock (1992). The author's use what is developed by Efron (1973) called Bootstrapping. It goes like ...
1
vote
0answers
20 views

Measure difference in answers on survey depending on item response options

For my thesis I sent out a questionnaire that has 10 questions. I set defaults: the first seven question had the default set to the desired answer and the last three questions had the default set to ...
0
votes
0answers
42 views

How to obtain t-value for significance of median

I collected analysts’ forecasts and calculated bias and accuracy such as: $bias=actual-forecast$ $accuracy=abs(actual-forecast)$ What I am wondering is now on how to calculate the t-statistic to ...
1
vote
0answers
19 views

Comparing 2 classifiers with different feature vectors based on same training and test data

Let us assume we have two classifiers C1 and C2 which are based on different feature vectors, ...
0
votes
0answers
28 views

3 way mixed ANOVA & pairwise comparisons effect size

im in desperate need of some help for my data analysis assignment! I have a 3 way mixed anova- where I have 2 sig main effects, one significant two way interaction and the sig three way ...