Statistical significance refers to the probability that, if, in the population from which this sample were drawn the true effect were 0 (or some hypothesized value) a test statistic as extreme or more extreme than the one gotten in the sample could have occurred.

learn more… | top users | synonyms (2)

0
votes
1answer
20 views

LR test on marginal effect

Say I have the following regression model: $$\text{Wage}_i = α·\text{YearsOfEduc}_i + β·\text{Age}_i + γ·\text{CompletedHighSchool}_i + \mbox{δ·$\text{NumOfSiblings}_i$} + ε·\text{Gender}_i + u_i$$ ...
0
votes
1answer
25 views

Wald test on marginal effect

Say I have the following regression equation: $$Wage_i = YearsOfEduc_i + Age_i + NumOfSiblings_i + u_i$$ How would I go about peforming a wald test of the hypothesis that for an individual with ...
0
votes
0answers
12 views

Benchmarking Software Exercises

I am building a website for practicing programming in various languages. The content is user driven; some users write exercises with test frameworks for validating solutions, and other users write ...
2
votes
0answers
9 views

Significance test for longer pronounciation

I have a set of words spoken by a group of native speakers and a group of non-native speakers. In each record I determined the length of the burst (a phonetic term). I believe non-native speakers tend ...
0
votes
0answers
20 views

Best size for control in Control/A/B/C/D split test

I'm doing some split testing on a website, and have multiple tests running along with a control. Say we have control/A/B/C/D. If we only had control/A, then I know I should make them both the same ...
0
votes
0answers
32 views

Determine if regression results are significantly better with method A or method B

I'm working on a regression case and I am using two methods, lets say method A and B. Due to the randomness in the optimisation techniques of these methods the output will always differ slightly. ...
10
votes
3answers
127 views

Bias in jury selection?

A friend is representing a client on appeal, after a criminal trial in which it appears that jury selection was racially biased. The jury pool consisted of 30 people, in 4 racial groups. The ...
1
vote
1answer
32 views

How should I interpret a factor that is significant both (1) in linear form in interaction with another factor and (2) in its quadratic form?

Our study aims to identify and understand how several ecological factors relate to parasite abundance in a colonial animal. However, we are uncertain on how to interpret a factor (density) that is ...
1
vote
1answer
7 views

What's the right test to use to find significance in a table of incidence rates?

I have some data about conversion rates on different browsers, as follows. ...
1
vote
0answers
16 views

Sample of one, extermination of fruit flies and daily life challenges

First of all, I'm very well aware that a sample of one is ridiculous in any normal scenario in the domain of statistics, and I know that any rationale from this would probably only have esoteric ...
0
votes
1answer
40 views

I got a dataset, there are about 400 variables,most of them are quite similar [closed]

I got a dataset, there are about 400 variables, most of the variables are quite similar. Actually, I would like to say their number are pretty close, but I think they won't too correlated, since the ...
1
vote
1answer
40 views

What statistic to use

My 8 year old daughter is conducting an experiment to assess memory. She has 3 groups. Condition 1, Condition 2 and ...
0
votes
0answers
9 views

Creating Bin in graph by R from a set of data [closed]

I have 1000 of data of mean temperature and daily rainfall of specific area. I need is to make a graph by using R software. I had already made the structure and summary of those given data. Now I have ...
0
votes
0answers
28 views

Testing of sensitivity for different algorithms

I have some queries I would like to discuss, I am doing some analysis for sensitivity. I am not from the field of statistics. I work with RNA-Seq data. The thing is I have found some genes which are ...
0
votes
2answers
17 views

Calculating chi-squared values for percentages?

I'm using scipy and I'd like to calculate the chi-squared value of a contingency table of percentages. This is my table, it's of relapse rates. I'd like to know if there are values that are ...
0
votes
0answers
4 views

How to compare series of foreclosure rates wrt to time and place

I have three categories of foreclosure rates in NYC (rates are number of foreclosures per 1000 homes). The three categories are: overall rates of foreclosure, rates for homes within a flood zone, and ...
0
votes
0answers
11 views

How can you calculate significance with 3 groups of uneven samples? [closed]

How can you calculate significance with 3 groups of uneven samples?
2
votes
0answers
23 views

Visualise significant differences in a contingency table?

I'm working with pandas and scipy, and I would like to find a quick way to visualise unusual values in a contingency table. Say this is my contingency table: ...
0
votes
2answers
31 views

Pearson correlation test for non-gaussian data

I want to perform significance test for correlation coefficient. However my data is not normally distributed. In my books I have found tests only for the normally distributed data. Is there such test ...
10
votes
1answer
1k views

Could it be shown statistically that cars are used as murder weapons?

I heard a story recently in which someone said if they wanted to kill somebody (and get away with it) they would do it with their car. They cited various statistics about the number of auto-related ...
0
votes
0answers
18 views

which statistical significance to rely on?

Hello, I'm trying to estimate the relationship between oil price and gdp. My question is should I test for statistical significance for each estimator or should I test the statistical significance ...
1
vote
0answers
18 views

Statistical test for cumulative curves

I have three treatment groups represented in three cumulative curves. What is the best test to show differences among them.Knowing that treatments were observed cumulatively for only seven days.
1
vote
0answers
12 views

Test for pairs of small integers

I have two classifiers, say $A$ and $B$ and I am performing 10$\times$10-fold cross-validation on them and record the number of instances correctly classified from the test set. Unfortunately, the ...
0
votes
0answers
17 views

Consistent Questionnaire Responses

I want to ask please questionnaire responses in Likert Scale. I have got some respondents who had consistent answers for a large number of questions. For example, over 75% or 80% answers (in different ...
2
votes
3answers
530 views

How do you interpret a significant but weak correlation?

I have carried out a number of Pearson Chi Square tests on the relationship between tail lesions and abscessation in pigs. I have found a significant (p = 0.005) but weak (Cramers V = 0.288) ...
0
votes
0answers
16 views

Testing significance of a treatment inducing correlations over a time series

Example data In the example dataset, there are 3 distinct biological measurements, over 3 time points (0,12,24hrs) for 19 individuals. These individuals have been divided into 2 groups: treatment and ...
0
votes
0answers
9 views

probability life similarities in a population cross section

I have just read up on Bouchard's Minnesota Twins study that turned up some amazing identical similarities in the lives of some identical twins reared apart. Both had same jobs, married and divorced ...
0
votes
0answers
20 views

Significance of linear combination of two insignificant regression parameters

I'm running a model with an interaction term, of the general form: $Y=b_1X_1+b_2X_2+b_3X_1X_2$, whereby $X_2$ is a dummy variable and $X_1$ is continuous. Neither $X_1$ nor $X_2$ turn out as ...
2
votes
0answers
34 views

Testing correlation between two variables when there are other variables involved

I want to see if there is any correlation between number of pages in a paper and the citation it receives. If I just plot number of pages vs number of citations of a paper, I might get a correlation, ...
5
votes
1answer
153 views

What does “statistically insignificantly worse” mean?

I am reviewing a paper where I found this sentence repeatedly: A is statistically insignificantly worse than B I consider this to be confusing since, for me at least, it is not immediately clear ...
1
vote
0answers
21 views

Significance testing between two sets of Pearson's correlation coefficients

I have been reading through questions here to find an answer to my question but didn't find a satisfactory one. Here is my scenario: I have a system computing an algorithm on each of 100 units (so ...
1
vote
1answer
29 views

Testing the hypothesis on clustering

I have a number of samples. For each, there is a time course of multivariate data defined, with $t$ timepoints ($t < 50$) and $n$ variables ($n > 100$). We have noted that the time courses of a ...
1
vote
2answers
77 views

Test if two binomial distributions are statistically different from each other

I have three groups of data, each with a binomial distribution (i.e. each group has elements that are either success or failure). I do not have a predicted probability of success, but instead can ...
2
votes
1answer
113 views

Can we skip the lower order terms in interactions? [duplicate]

This question is about three-way interaction and the possibility of applying without second lower terms with keeping the main variables in the equation not like the other questions. In fact the other ...
0
votes
1answer
55 views

Imputation model: Pooled model is insignificant. How to interpret?

I have ordinal data on three IVs ranging from 1 to 5 as below: IV1: Not at all Important - Very Important IV2: Not at all Satisfied - Very Satisfied IV3: Performs much Worse - Performs much better ...
1
vote
0answers
28 views

How to test for a home bias in a data set?

I'm trying to think how I can test a data set I have, for transactions between buyers and sellers, for a home bias. My hypothesis is that buyers would rather buy from a merchant from their home ...
1
vote
0answers
42 views

Which post-hoc comparison to use and why

Hopefully this is now a much clearer picture of the question I want to answer: For each of 60 different plans I ran 35 simulation replications of my Agent Based Model (ABM) simulation. Then for each ...
1
vote
1answer
31 views

How can a distribution of cross-validated $R^2$ scores be used to determine whether one model is significantly better than another?

I have two models, A and B. I have performed 10-fold cross-validation on both of them, so now I have 10 $R^2$ scores for each. How can I determine whether one is significantly better than the other? ...
2
votes
1answer
47 views

Relative increase between two pairs of samples

Consider the following samples from four distributions: $a = \{20, 2, 200\} \qquad\qquad c = \{1, 10, 100\}$ $b = \{22, 2.2, 220\} \qquad\quad\:\,d = \{1.2, 12, 120\}$ I would like to say that the ...
1
vote
0answers
10 views

permutation test with a distribution of correct values

I want to test my classifier performance using a permutation test. I know how to test one actual value against a null distribution of values generated by randomly reassigning labels to my two classes. ...
1
vote
0answers
16 views

Likelihood Ratio as statistical test for Transfer Entropy with MatLab

I estimated a Transfer Entropy value TE(XY). Now I want to establish the statistical significance of the estimated value. Therefore I used the method of shuffled surrogates to estimate a shuffled ...
0
votes
0answers
26 views

main effect and interaction effect

I faced difficulty with my data analysis output. I had two factors with split plot design. Separately, the main effect of the two factors on soil pH was significant. But their interaction effect was ...
0
votes
0answers
11 views

How to calculate whether a change in expenditure is statisically significant

Sorry, this is probably very basic... I have data on expenditure over 3 years. This expenditure is made up of 2 products L and H. L has been increasing and H has been decreasing, so overall L+H is ...
23
votes
4answers
761 views

Is the “hybrid” between Fisher and Neyman-Pearson approaches to statistical testing really an “incoherent mishmash”?

There exists a certain school of thought according to which the most widespread approach to statistical testing is a "hybrid" between two approaches: that of Fisher and that of Neyman-Pearson; these ...
0
votes
1answer
18 views

Non-response bias (many waves, time span between waves not consistent)

I want to ask regarding non-response bias. I have sent my questionnaire on-line to SMEs in Malaysia. However, I have sent reminders many times (around 5 times). However, now I cannot recall when the ...
0
votes
0answers
27 views

Correcting for multiple testing on non-independent sliding windows

Question Values taken from adjecent windows in a sliding windows are corrolated. If I calculate a p-value from each window, how can I correct for the fact I have tested many windows, given that the ...
2
votes
2answers
51 views

Confidence intervals which contain 1 but the z test and p value are significant

I calculated the confidence intervals for the regression coefficients using the formula: SE X 1.96. I then took this value away from the regression coefficient to get the lower confidence level and ...
0
votes
0answers
20 views

How to down weight correlations in my microarray analysis?

Background: I have been tasked in one part of my analysis to reproduce a method used in another study as follows in bullet points form: Microarray data from a number of time points Calculate ...
0
votes
1answer
73 views

How can a regression be significant yet both predictors be non-significant? [duplicate]

I know this question has been asked in a slightly different form here. But my question differs and because of the forum rules I can't post on that thread. I have 2 independent variables, n=32, highly ...
0
votes
1answer
72 views

High Standard Deviation for Leave one out cross-validation?

I am using the leave one out cross-validation technique to evaluate my model. If the prediction on the test sample is right the output is 1 otherwise 0. So I have a array of N samples with 0's and 1's ...