Statistical significance refers to the probability that, if, in the population from which this sample were drawn the true effect were 0 (or some hypothesized value) a test statistic as extreme or more extreme than the one gotten in the sample could have occurred.

learn more… | top users | synonyms (2)

0
votes
0answers
11 views

What is the meaning of significant in statistics? [on hold]

I got a list of glossary terms which I have to find comprehensive definitions for. The last one is significant. What does significant mean in statistics?
0
votes
0answers
5 views

Interpreting results of Libreoffice Calc's TTEST function [duplicate]

I'm doing some data analysis on a small dataset (35 individuals) and I'm wondering whether my findings are statistically significant. Individuals are asked questions before and after a treatment, so ...
1
vote
1answer
16 views

Bootstrapping and comparing mean distributions

Is the following a reasonable approach to assess the statistical significance of the difference between two groups' For each group 1) Subsample with replacement 2) Take the mean of the subsample 3) ...
0
votes
1answer
12 views

Two-way ANOVA doesn't detect differences between conditions in a specific group?

OK, so let's say we have independent variables Condition (A or B) and Race (1 or 2 or 3). Then say we have a dependent variable X. We can run a two-way ANOVA to find out if there's an effect due to ...
1
vote
0answers
20 views

determining statistical significance of a mean of a mean

I have done an experiment in which I have 8 repetitions per test subject (for each of several measurements). Of this I took the mean. Then I did this for 8 test subjects in total. So basically I took ...
0
votes
1answer
15 views

Measuring degree of difference?

I am given two sets of data on the same product collected by two different people. How do I measure the degree of difference? Thank you in advance
0
votes
1answer
22 views

What is the correct test for determining if a group is significantly more popular than another?

I am changing one variable in a piece of software I am writing so that it has two variants. I am able to measure how many users continue to use the software a week after opening it for the first time. ...
0
votes
1answer
31 views

Right statistical test for my problem

I have a bunch of data like these: ...
1
vote
0answers
48 views

Testing for cluster structure in one dimension

I have a set of points along an interval. What is the best significance test to measure clustering of the points in the interval (deviation from a uniform distribution)? I've added two examples below ...
3
votes
1answer
34 views

KS test for Uniformity

I am attempting to use the KS-test to test whether a set of points is uniformly distributed over an interval, and I had a question about whether there may be a more optimal test for what I'm trying to ...
1
vote
1answer
30 views

How to find statistical significance on SPSS?

i have 3 separate variables - Depression, Anxiety and Stress - each of them have been answered as Yes or No. These were answered by Case group and the Control group. Now I need to find if each of ...
2
votes
2answers
61 views

Why does an insignificant regressor become significant if I add some significant dummy variables?

I'm doing a linear regression with cluster robust SE and I have the following conceptual problem: I have five regressors, of which four are statistically significant, while the remaining regressor is ...
1
vote
1answer
24 views

Testing ranks rather than actual numbers with parameteric tests

An answer on this page Non parametric analysis states: "You can perform ANOVA using ranks of your variable instead of variable itself. This will lead to the same results with Kruskal-Wallis ...
3
votes
1answer
30 views

Distances between successive points - Statistical Test

I have a set of experimental data which comprises distances between successive points: I also have a set of similar data that has been generated by a model that attempts to recapture the ...
0
votes
0answers
28 views

Complement of statistical significance test

I am applying statistical significance tests like the Kruskal-Wallis, Wilcoxon and ...
0
votes
0answers
9 views

How to find if any treatment is statistically better or worse in gene data given one standard method and 3 variations

Sorry I am a biologist and it appears am not quite confident enough for statistical analysis. I have datasets that represent different treatments on a biological system. It records how many genes have ...
5
votes
1answer
62 views

How to determine if a single variable is significantly different from 0?

I am working with data that has been reduced to values falling between -1 and 1. The formula is, "(number in tube 1- number in tube 2)/ (the sum of numbers in both tubes). Example: Tube 1 = 5 worms, ...
6
votes
4answers
65 views

$\chi^2$ tabulated value

I noticed that the critical $\chi^2$ value increases as the degrees of freedom increase in a $\chi^2$ table. Why is that?
0
votes
1answer
35 views

Statistical Significance

Our teacher told us If a test is rejected at 1% level of significance , then it will be rejected at 5% , 10% level of significance . I don't understand how does the rejection at 1% level of ...
0
votes
1answer
14 views

Regression: can I run specific models or do I need to run a full factorial model?

I am running a GEE (Generalized Estimating Equations) Linear Scale Response regression. I have 4 IVs: Time pressure and Approach as as factors, and BIS and BAS sensitivity as covariates. My DV is ...
0
votes
0answers
9 views

SPSS Binary logistic regression incoherent result after excluding outliers [duplicate]

I'm using binary logistic regression for my master thesis and after running the regression for a a few specific variables I get the following resutl: Then I created a filter to run the regression ...
0
votes
1answer
54 views

Does p value below 0.05 in mvShapiro.Test mean multivariate normality or not?

I am performing mvShapiro.Test from mvShapiroTest package. I get ...
0
votes
1answer
33 views

Testing for differences between populations of individuals with binomial data

So I am trying to compare between populuations and determine whether there is a difference in count based data. My data look like this: ...
0
votes
0answers
7 views

How to estimate a chance of getting in the first positions, given previous tries?

I perform a series of experiments that return a number N that is between 1 and MAX. MAX varies between experiments. For example: ...
1
vote
1answer
34 views

What value does one set, in general, for the null hypothesis of β0 in a linear regression model?

Say there is a linear regression model to estimate Y, that is: $Y_i = B_0 + B_1X_i + u$ When testing the significance of your sample regression model the null hypothesis for $B_1$ would naturally be ...
0
votes
1answer
39 views

Is it appropriate to use t-tests to find the most different outcomes?

I have a large CSV file of spending by individuals on different drugs. I want to find the drugs with the most different spending patterns by gender. The file looks a bit like this, but with 7.5k ...
0
votes
2answers
23 views

Test Control. A longitudinal study

I have two samples of the same size, one being the 'treated' group, and the other used as a 'control' group. Each group have a different univariate variable (stress level), repeatedly observed over ...
0
votes
0answers
25 views

Figuring out which test to use

It's been a while since I've taken a stat's class and I came across a problem I need to solve. I was hoping someone could point me in the right direction. I know a question similar to this has ...
0
votes
1answer
36 views

What is a good test for comparing frequency counts between two groups?

I am looking for statistical methods used to compare frequency of observations between two groups. I have two geographical locations with data on different soil types present. for example, my data ...
2
votes
2answers
28 views

Statistical test if one sample is placed higher in rank

I have a rank array, say from 0 to 100 (0 being the smallest and 100 being the largest). If my data contains 89, 91, 94, and 98, I can say my data is significantly high in the rank. In other words, ...
0
votes
1answer
21 views

How to quantify whether the difference between two groups is relevant?

I'm sorry that I am not at all an expert in statistics, so my question may sound vague, or very easy. I have a group of people that I divide into two categories, $A$ and $B$, depending on some ...
0
votes
2answers
30 views

Test for statistical significance in performance variability

I'm analysing data collected from a call centre activity in which agents are calling prospective leads. For each call made, if the lead coverts the call is a success and if the lead does not convert ...
0
votes
0answers
8 views

looking for statistical analysis of two animals per group

I have used two animals per group and compared two groups. is there any test of statistics that analyze sample size as low as two
4
votes
1answer
39 views

How to identify variables with significant loadings in principal component anlaysis

I have following example of principal component analysis using first 4 variables of iris data set (code in R): ...
2
votes
1answer
36 views

Testing whether variance across 6 values is significantly above zero

We estimated a network via the Ising model procedure. The network contains 11 variables, and therefore 55 pairwise associations (these are called edges). We estimated this network in 6 different ...
0
votes
1answer
26 views

Scientific P Value with adjusted R Square [duplicate]

I am running Spearman correlation between 2 variables weight and freight both being numeric. The output I have received from correlation is P value - 0.00E+000 and Rank R Squared is 0.61 and which ...
0
votes
0answers
37 views

Testing for effect of covariate in nonlinear mixed model, T-test or F-test?

I am using package nlme for nonlinear mixed model. I use SSlogis self-starting model( Bates Pinheiro, 2000) for my model. ...
0
votes
1answer
10 views

calculating significance of common genes from different comparisons

we are having difficulties calculating the significance of our between-group comparisons. We did multiple differential expression Analyses of different time-points and mutations. We analysed the ...
3
votes
0answers
56 views

Is it possible to validate this claim about gun shootings and SSRIs?

We have received an interesting question on Skeptics.SE: Is there a correlation between mass-murder and use of psychoactive prescription drugs such as SSRIs? My suspicion is that this is not ...
0
votes
0answers
16 views

Significance of excess return using geometric mean

Since I am writting an assignement about a contrarian-strategy I have to test if the excess returns are significant or not. I calculated the excess returns this way: geomean(pf_returns) - ...
0
votes
0answers
77 views

Majority Voting statistical test

What statistical test would be appropriate to test whether the number of votes of a winner is significant when there are more than 2 levels? For the case of 2 levels I found this answer. But is there ...
0
votes
0answers
13 views

Determining significance of change in a categorical variable following intervention

I'm currently stuck and could do with some help. I'm designing a study to assess change in a categorical variable following intervention. Specifically I'm looking at change in attachment style (AS) ...
0
votes
1answer
26 views

Should I use repeated meaure ANOVA?

I have 5 interaction techniques (eg., interaction 1 to 5) and I have recruited 15 participants to participate in my study. Each participant interacts with each of these 5 techniques only once. I will ...
1
vote
0answers
24 views

Which test(s) to use?

I’m having a dataset that needs to be analyzed but I’m a bit worried about picking the appropriate test(s). It’s been a while since I last really used statistics and SPSS. Therefore I would kindly ...
1
vote
2answers
58 views

Relationship between ROC curve and statistical significance in comparison of two groups

My question is about any possible relationship between the significance of a comparison test (Mann-Whitney U) and the ROC curve. If the comparison test is strongly significant, should we expect a ...
0
votes
0answers
9 views

Likert score significance testing between two surveys

I have two surveys taken one month apart. They contain 20 Likert-type questions (strongly agree, agree, neither agree or disagree, disagree, strongly disagree). I have added strongly agree and ...
3
votes
1answer
30 views

Correlation Analysis of Standarized Testing Data

I need some insight on how to correctly analyze some data using correlations. The nature of the data and research endeavor is as follows: I have two independent samples of different sizes that ...
0
votes
0answers
13 views

Significance on AB testing

I did a A/B test for music generation in which experimenters compare audio files generated from same musical score with method A and method B.There are three options A better than B, B better than A ...
0
votes
0answers
10 views

Test significanct differences across segments in a Latent Class?

I did a latent class (2 segments) on a group of people, suppose the segment size is n1 and n2, and parameter for each segment is b1 (with s1 the standard error) and b2 (with s2 the standard error). ...
2
votes
1answer
26 views

Studying the distribution of the p-value?

I have two data vectors $X=(X_1, X_2, \dots, X_n)$ and $Y=(Y_1, Y_2, \dots, Y_m)$ where $X_i \overset{iid}{\sim} P$ and $Y_i \overset{iid}{\sim} Q$, and I am performing a two-sample test (i.e KS test ...