Statistical significance refers to the probability that, if, in the population from which this sample were drawn the true effect were 0 (or some hypothesized value) a test statistic as extreme or more extreme than the one gotten in the sample could have occurred.

learn more… | top users | synonyms (2)

0
votes
0answers
5 views

Further analysis for significance at three points in time, 1 group, 2 questions

The only information that I have is that each person completes a survey comparing job satisfaction and level of stress (higher scores represent higher satisfaction and stress) at 3 months, 6 months, ...
2
votes
1answer
28 views

Statistical significance test: One way Anova and Kruskal-Wallis test

I was comparing data between two groups and for each group there was six samples. My data are as follows: group 1: 103.56, 103.32, 103.32, 104.27, 103.56, 103.8 group 2: 97.16, 97.16, 96.69, 98.58, ...
1
vote
1answer
13 views

Two-stage cluster sampling problem

I'm having difficulty understanding the following problem. It seems like it is a two stage cluster sampling problem, but then the defective red lightbulbs make the question even more difficult. I'd ...
1
vote
1answer
21 views

Survey data: finding the most significant predictors?

I have about 5,000 responses to a survey in which users were asked how strongly they agreed with a statement on a 5-point Likert scale. This response is my dependent variable - I want to find out what ...
0
votes
0answers
2 views

How to test data migration quality on very large sample set

I am migrating 2M individual bio-specimens from one IT application to another (sample location data, 5 levels). While the data migration tools are "validated", I want to create a statistical model to ...
0
votes
1answer
55 views

Questions regarding Binary Logistic Regression

I am very new to statistics and is currently performing binary logistic regression analysis to test null hypothesis for my dissertation. First, both my independent variables and dependent variable ...
0
votes
0answers
50 views

calculate probability for passengers who caught with gun [on hold]

Can someone please give some clue? One strange phenomenon that sometimes occurs at U.S. airport security gates is that an otherwise law-abiding passenger is caught with a gun in his/her carry-on bag. ...
0
votes
0answers
58 views

what is true about s zscore [on hold]

What the relation between score and mean, median? whihc is true from this ...
0
votes
1answer
6 views

how do I test the relationship between infection and nurse:patient ratio

I am evaluating whether the prevalence of a specific infection in the ICU bears a relationship to the nurse:patient ratio over time. The infections are whole numbers (nominal variable)and the nurse: ...
1
vote
1answer
77 views

OLS vs IV estimates - Sign and Significance

Assume I have an equation with 1 endogenous variable, and many other exogenous variables. Also assume I have 2 valid instruments for the endogenous variable for IV estimation. If I were to estimate ...
1
vote
0answers
18 views

test to show statsticial change due to an intervention

I have a group of 222 test results that were reviewed separately by two interpreters X and Y. Based on their assessment, they were to assign management into 4 categories A, B, C and D. Then another ...
0
votes
1answer
27 views

Running many $t$-tests to find the most significant way to divide a dataset

I apologize for my stats illiteracy in advance–I'm not a stats guru by any stretch, but am trying to learn. To start, I'll just introduce what my data set looks like, then what I'd like to ...
0
votes
1answer
63 views

LR test on marginal effect

Say I have the following regression model: $$\text{Wage}_i = constant + α·\text{YearsOfEduc}_i + β·\text{Age}_i + γ·\text{CompletedHighSchool}_i + \mbox{δ·$\text{NumOfSiblings}_i$} + ...
0
votes
1answer
33 views

Wald test on marginal effect

Say I have the following regression equation: $$Wage_i = YearsOfEduc_i + Age_i + NumOfSiblings_i + u_i$$ How would I go about peforming a wald test of the hypothesis that for an individual with ...
0
votes
0answers
13 views

Benchmarking Software Exercises

I am building a website for practicing programming in various languages. The content is user driven; some users write exercises with test frameworks for validating solutions, and other users write ...
2
votes
0answers
9 views

Significance test for longer pronounciation

I have a set of words spoken by a group of native speakers and a group of non-native speakers. In each record I determined the length of the burst (a phonetic term). I believe non-native speakers tend ...
0
votes
0answers
22 views

Best size for control in Control/A/B/C/D split test

I'm doing some split testing on a website, and have multiple tests running along with a control. Say we have control/A/B/C/D. If we only had control/A, then I know I should make them both the same ...
0
votes
0answers
32 views

Determine if regression results are significantly better with method A or method B

I'm working on a regression case and I am using two methods, lets say method A and B. Due to the randomness in the optimisation techniques of these methods the output will always differ slightly. ...
12
votes
3answers
229 views

Bias in jury selection?

A friend is representing a client on appeal, after a criminal trial in which it appears that jury selection was racially biased. The jury pool consisted of 30 people, in 4 racial groups. The ...
1
vote
1answer
34 views

How should I interpret a factor that is significant both (1) in linear form in interaction with another factor and (2) in its quadratic form?

Our study aims to identify and understand how several ecological factors relate to parasite abundance in a colonial animal. However, we are uncertain on how to interpret a factor (density) that is ...
1
vote
1answer
9 views

What's the right test to use to find significance in a table of incidence rates?

I have some data about conversion rates on different browsers, as follows. ...
1
vote
0answers
16 views

Sample of one, extermination of fruit flies and daily life challenges

First of all, I'm very well aware that a sample of one is ridiculous in any normal scenario in the domain of statistics, and I know that any rationale from this would probably only have esoteric ...
1
vote
1answer
41 views

What statistic to use

My 8 year old daughter is conducting an experiment to assess memory. She has 3 groups. Condition 1, Condition 2 and ...
0
votes
0answers
28 views

Testing of sensitivity for different algorithms

I have some queries I would like to discuss, I am doing some analysis for sensitivity. I am not from the field of statistics. I work with RNA-Seq data. The thing is I have found some genes which are ...
0
votes
2answers
17 views

Calculating chi-squared values for percentages?

I'm using scipy and I'd like to calculate the chi-squared value of a contingency table of percentages. This is my table, it's of relapse rates. I'd like to know if there are values that are ...
0
votes
0answers
4 views

How to compare series of foreclosure rates wrt to time and place

I have three categories of foreclosure rates in NYC (rates are number of foreclosures per 1000 homes). The three categories are: overall rates of foreclosure, rates for homes within a flood zone, and ...
2
votes
0answers
23 views

Visualise significant differences in a contingency table?

I'm working with pandas and scipy, and I would like to find a quick way to visualise unusual values in a contingency table. Say this is my contingency table: ...
0
votes
2answers
31 views

Pearson correlation test for non-gaussian data

I want to perform significance test for correlation coefficient. However my data is not normally distributed. In my books I have found tests only for the normally distributed data. Is there such test ...
10
votes
1answer
1k views

Could it be shown statistically that cars are used as murder weapons?

I heard a story recently in which someone said if they wanted to kill somebody (and get away with it) they would do it with their car. They cited various statistics about the number of auto-related ...
0
votes
0answers
19 views

which statistical significance to rely on?

Hello, I'm trying to estimate the relationship between oil price and gdp. My question is should I test for statistical significance for each estimator or should I test the statistical significance ...
1
vote
0answers
18 views

Statistical test for cumulative curves

I have three treatment groups represented in three cumulative curves. What is the best test to show differences among them.Knowing that treatments were observed cumulatively for only seven days.
1
vote
0answers
13 views

Test for pairs of small integers

I have two classifiers, say $A$ and $B$ and I am performing 10$\times$10-fold cross-validation on them and record the number of instances correctly classified from the test set. Unfortunately, the ...
0
votes
0answers
17 views

Consistent Questionnaire Responses

I want to ask please questionnaire responses in Likert Scale. I have got some respondents who had consistent answers for a large number of questions. For example, over 75% or 80% answers (in different ...
2
votes
3answers
534 views

How do you interpret a significant but weak correlation?

I have carried out a number of Pearson Chi Square tests on the relationship between tail lesions and abscessation in pigs. I have found a significant (p = 0.005) but weak (Cramers V = 0.288) ...
0
votes
0answers
16 views

Testing significance of a treatment inducing correlations over a time series

Example data In the example dataset, there are 3 distinct biological measurements, over 3 time points (0,12,24hrs) for 19 individuals. These individuals have been divided into 2 groups: treatment and ...
0
votes
0answers
9 views

probability life similarities in a population cross section

I have just read up on Bouchard's Minnesota Twins study that turned up some amazing identical similarities in the lives of some identical twins reared apart. Both had same jobs, married and divorced ...
0
votes
0answers
21 views

Significance of linear combination of two insignificant regression parameters

I'm running a model with an interaction term, of the general form: $Y=b_1X_1+b_2X_2+b_3X_1X_2$, whereby $X_2$ is a dummy variable and $X_1$ is continuous. Neither $X_1$ nor $X_2$ turn out as ...
2
votes
0answers
34 views

Testing correlation between two variables when there are other variables involved

I want to see if there is any correlation between number of pages in a paper and the citation it receives. If I just plot number of pages vs number of citations of a paper, I might get a correlation, ...
5
votes
1answer
154 views

What does “statistically insignificantly worse” mean?

I am reviewing a paper where I found this sentence repeatedly: A is statistically insignificantly worse than B I consider this to be confusing since, for me at least, it is not immediately clear ...
1
vote
0answers
21 views

Significance testing between two sets of Pearson's correlation coefficients

I have been reading through questions here to find an answer to my question but didn't find a satisfactory one. Here is my scenario: I have a system computing an algorithm on each of 100 units (so ...
1
vote
1answer
29 views

Testing the hypothesis on clustering

I have a number of samples. For each, there is a time course of multivariate data defined, with $t$ timepoints ($t < 50$) and $n$ variables ($n > 100$). We have noted that the time courses of a ...
1
vote
2answers
83 views

Test if two binomial distributions are statistically different from each other

I have three groups of data, each with a binomial distribution (i.e. each group has elements that are either success or failure). I do not have a predicted probability of success, but instead can ...
2
votes
1answer
113 views

Can we skip the lower order terms in interactions? [duplicate]

This question is about three-way interaction and the possibility of applying without second lower terms with keeping the main variables in the equation not like the other questions. In fact the other ...
0
votes
1answer
55 views

Imputation model: Pooled model is insignificant. How to interpret?

I have ordinal data on three IVs ranging from 1 to 5 as below: IV1: Not at all Important - Very Important IV2: Not at all Satisfied - Very Satisfied IV3: Performs much Worse - Performs much better ...
1
vote
0answers
28 views

How to test for a home bias in a data set?

I'm trying to think how I can test a data set I have, for transactions between buyers and sellers, for a home bias. My hypothesis is that buyers would rather buy from a merchant from their home ...
1
vote
0answers
46 views

Which post-hoc comparison to use and why

Hopefully this is now a much clearer picture of the question I want to answer: For each of 60 different plans I ran 35 simulation replications of my Agent Based Model (ABM) simulation. Then for each ...
1
vote
1answer
31 views

How can a distribution of cross-validated $R^2$ scores be used to determine whether one model is significantly better than another?

I have two models, A and B. I have performed 10-fold cross-validation on both of them, so now I have 10 $R^2$ scores for each. How can I determine whether one is significantly better than the other? ...
2
votes
1answer
48 views

Relative increase between two pairs of samples

Consider the following samples from four distributions: $a = \{20, 2, 200\} \qquad\qquad c = \{1, 10, 100\}$ $b = \{22, 2.2, 220\} \qquad\quad\:\,d = \{1.2, 12, 120\}$ I would like to say that the ...
1
vote
0answers
10 views

permutation test with a distribution of correct values

I want to test my classifier performance using a permutation test. I know how to test one actual value against a null distribution of values generated by randomly reassigning labels to my two classes. ...
1
vote
0answers
16 views

Likelihood Ratio as statistical test for Transfer Entropy with MatLab

I estimated a Transfer Entropy value TE(XY). Now I want to establish the statistical significance of the estimated value. Therefore I used the method of shuffled surrogates to estimate a shuffled ...