Statistical significance refers to the probability that, if, in the population from which this sample were drawn the true effect were 0 (or some hypothesized value) a test statistic as extreme or more extreme than the one gotten in the sample could have occurred.

learn more… | top users | synonyms (2)

2
votes
0answers
37 views

Birthday “Paradox” — with a different perspective

Background: Many people are familiar with the so-called Birthday "Paradox" that, in a room of 23 people, there is a better than 50/50 chance that two of them will share the same birthday. In its more ...
0
votes
1answer
20 views

How can I statistically formulate football player attributes similar to Football Manager games or footballdatabase.eu?

I have collected player match history statistics like runs, shoots, passes and such. I would like to come up similar attribute values (psychical, mental, technical) to Football Manager game or ...
-2
votes
0answers
9 views

Statistical test needed for a pre-experimental study [on hold]

Hi I am doing a pre experimental study with one group. what all statistics I need to do for the confirmation of the results? i need to know the inferential statistics which has to be done for this ...
0
votes
2answers
22 views

Overall Significance vs. Individual Variable Significance in Mutliple Regression

I'm running a statistical analysis for work in which I'm trying to determine which (if any) key economic indicators influence our sales. Here is the summary data that I'm getting when I run a ...
0
votes
0answers
14 views

Test similar to Kruskal-Wallis test but for multidimensional vector

I need to do the similar kind of test as Kruskal-Wallis test, but for a multidimensional vector. Would you please kindly suggest such kind of test or provide some references for N-dimensional case
2
votes
2answers
56 views

Kruskal–Wallis Test not significant but Mann Whitney U significant

I have a non-normalized dependent variable and an independent variable broken down into 4 groups. As such, I used the Kruskal–Wallis analysis to look for significant differences in the ranks of the ...
-4
votes
0answers
20 views

inference Single sample [on hold]

Can someone Answer this question. Thanks in advance. 6.17 the one with black circle. Right now i have no idea how to approach and solve it.Any help would be highly appreciated. Thanks.
0
votes
0answers
25 views

Statistical Significance or Unambiguous Direction of Influence?

With this post I want to put forward an interpretation of the concept of "Statistical Significance" in the context of "frequentist" Hypothesis testing that rings very convincing to my ears. I am not ...
0
votes
0answers
11 views

Significant variables, but no improvement on predictive ability of model

When running binary logistic regression in SPSS, I obtain first a measure of the predictive ability of a model without independent variables (base model). This is then compared with that of the model ...
0
votes
0answers
9 views

Pre/Post analysis without control

Quite a newbie to this, any info or pointers are appreciated, but please be as precise as possible. If I have a feature in general that was launched mainly to improve the user experience, but ...
0
votes
1answer
56 views

Great model prediction, but no significant variables

I am performing a binary logistic regression. I have developed a simple model which I am testing using the SPSS application. This first determines the predictive ability of a baseline model without ...
1
vote
1answer
18 views

Statistical significance in binomial variable: how many tests needed?

I have a problem that occurs randomly, in approximately 2 % of tests. I am testing fixes, to prevent the error from occurring. The error occurring once would mean it is still happening and would ...
2
votes
1answer
62 views

Optimal Allocation

A campus population of size N=9000 is to be surveyed by a stratified sample for the prevalence of a certain disease based upon three strata of respective sizes $N_h$ = 1000, 3000, and 5000 for h = 1, ...
2
votes
0answers
118 views

Question about Dynkin Lehmann Scheffe Theorem

I'm self-studying for an examination, and I would like to understand how to use the Dynkin Lehmann Scheffe theorem for an applied question. I am using Bickel and Doksum's "Mathematical Statistics" ...
2
votes
3answers
28 views

Does the order of magnitude of sample values influence p-values and effect size?

When using an independent-samples t-test to compare two variables, do the absolute values of the samples affect the test statistic and the effect size? In other words, is it easier to obtain ...
0
votes
0answers
4 views

Testing dispersion of values between condition on a group

I may have a tricky question. I have a within design where every participant is tested in 2 conditions. I want to compare the dispersion of the measure, for the two condition, with the hypotheses that ...
0
votes
0answers
4 views

Two Data Collection Method Groups

I have collected around 20 respondents by post; and by email around 150 respondents. I would like to know whether I can combine the two groups, the independent sample t test shows that there is a ...
1
vote
1answer
18 views

Cronbach's Alpha low- significant results

One of my variables has a low Cronbach's Alpha. I continued to run an planned contrast to test my hypothesis and the results were significant. I understand that the results should be interpreted ...
0
votes
1answer
18 views

Finding If A Replacement Manufacturing Test System Fails More Units

I'm currently writing software that replaces an existing legacy system, which tests units against different engineering specifications. Since I'm currently verifying everything works, and I was able ...
1
vote
1answer
23 views

Reducing the number of interaction terms in a diff-in-diff model?

Is there a way to reduce the number of interaction terms in a diff-in-diff model to make the results easier to interpret/present? Background: I'm trying to run the following diff-in-diff regression: ...
1
vote
1answer
24 views

Confidence Interval and Signifcance test Question

I have done the first part of the question already I just need help on the second part. You read in a U.S Census Bureau that a 99% confidence interval for the mean income in 2005 of American ...
0
votes
0answers
11 views

How to treat “Missing Value Analysis” test results (problems)

I have a problem with Missing Value Analysis. I am using SPSS version 20. I am trying to test whether missing values are at complete random. As I know in order to ensure missing values are completely ...
0
votes
0answers
15 views

R - power.prop.test, prop.test, and unequal sample sizes in A/B tests

Say I want to know what sample size I need for an experiment in which I'm seeking to determine whether or not the difference in two proportions of success is statistically significant. Here is my ...
2
votes
0answers
15 views

Significant difference between proportions, found at sample size below that suggested by power analysis

I'm looking at data from experiments that have been run to look for a difference between proportions, 1-tailed. In many of these it has been found that there is a significant difference between the ...
2
votes
0answers
33 views

Are significance tests only about sampling error or other forms of variation also?

When we study differences between a treatment and control group in an experimental setting, we want to test whether those differences are big enough that we can conclude they are not simply due to ...
2
votes
2answers
165 views

Comparing performances during a race between 2 groups, which test should I use?

Imagine I organized a race between 2 types of ants. Type A and B. At the end of the race, I have the ranking, which looks something like : ...
5
votes
2answers
237 views

Interpreting one- and two-tailed tests

How do you report results that give you a p-value of 0.08 for a two-tailed test and a p-value of 0.04 for a one-tailed test? Generalizing the issue, if you obtain a p-value between 0.05 and 0.9999 ...
1
vote
0answers
59 views

F-statistic value is too high for my model

Number of obs = 501 , Method: Fixed-effects regression Number of groups = 101 F( 10, 100) = 3422.31 , Prob > F = 0.0000 , ...
0
votes
0answers
19 views
0
votes
1answer
30 views

R - Analyzing Relationship Between Two (or more) Binary Variables

Say I have two vectors: Action.Taken = c(0,1,0,0,1,1,0,1,0) Success = c(0,0,0,1,0,1,0,1,0) The first tells me whether or not a specific action was taken in a ...
1
vote
1answer
23 views

Many groups with a single large element and a lot of small ones - How to assess?

I have a sample of 100 groups, each with 50 elements. All elements in each group are characterized with a single "size" value. The sizes of all the elements in a group (with 50 elements) are ...
4
votes
2answers
140 views

Why is it wrong to refer to results as being “highly significant”?

Why do statisticians discourage us from referring to results as "highly significant" when the $p$-value is well below the conventional $\alpha$-level of $0.05$? Is it really wrong to trust a result ...
2
votes
1answer
39 views

correct statistical test to compare 2 poisson distributions

I know there are similar posts, and I've read a few of them already, but none of them give explanations that I actually understand. I'm completely new to statistics and am finding it more difficult ...
0
votes
0answers
33 views

What is a correct way to test these data for significance?

I have data on 1548 disease cases and 1137 controls. Specifically, for each person, I have a certain score $n$. I am interested in the following: First, for either group, I want to know if the ...
0
votes
1answer
24 views
2
votes
3answers
26 views

Kolmogorov-Smirnov of two heart rate samples

I'm accumulating a lot of vital signs from emergency department patients, and would like to assess if different features yield significantly different distributions. Eg. for heart rate I have 888.424 ...
1
vote
2answers
138 views

Is multiple logistic regression the right choice or should I use univariate logistic regression?

I have a set of data (~ 90 cases) and an outcome of a diagnostic test. I have collected factors that were determined before the test that could predict the outcome of the test. Now some of the data ...
0
votes
0answers
26 views

Combining several a/b tests

Imagine I have two ads (banners), A and B. They can be placed at several different positions on the page (only one banner is shown on the page). Each position can be viewed as a separate a/b test. I ...
0
votes
1answer
19 views

Confidence Interval Application to a time series

So I'm not sure if I 100% grasp confidence intervals. Say I have a huge data set of a bond prices from 1996 to present in MINUTES. Suppose I separate each data by day. If I were to use a Dickey Fuller ...
0
votes
1answer
45 views

FDR (multiple testing correction) with skewed p-value distribution

I am confused with multiple comparisons adjustments. I have a $p$-values with lot of ones ( due to many scores in foreground are 0) from a fisher-exact test. I get some $p$-values which are ...
1
vote
1answer
55 views

Doing post-hoc after a not significant interaction in mixed ANOVA

I conducted a mixed design ANOVA with two within-subjects factors: FactorA (2 levels), FactorB (2 levels), and one between-subjects factor: Group (2 levels). My main hypothesis regards the interaction ...
3
votes
2answers
190 views

Is p-value also the false discovery rate?

In http://surveyanalysis.org/wiki/Multiple_Comparisons_(Post_Hoc_Testing) It states "For example, if we have a p-value of 0.05 and we conclude it is significant the probability of a false discovery ...
4
votes
0answers
39 views

Nonparametric test for largely skewed count data

My research design looks as follows: an experimental game with 4 participants (human subjects), repeated for 20 rounds. During each round, participants are allowed to form bilateral coalitions which ...
1
vote
0answers
36 views

Identify points significantly outside a regression model

I would like to update my previous question "Methods to determine reliability of measurements using median and median absolute deviation". I have data from biological experiments, that look like ...
0
votes
1answer
17 views

Help comparing two data sets. Methods

I have a set of data from two nights worth of monitoring. The monitoring picks up how busy a server is in terms of the number of threads processing. A change has been made and we want to analyse if ...
1
vote
2answers
39 views

Significance test between two samples when positions matter

Let's say that I have two samples: A B C D 100 5 17 12 #<- Method 1 90 2 4 15 #<- Method 2 And want to compare to test whether method 1 ...
1
vote
1answer
33 views

Can I hypothesise an insignificant mediation? (Very basic stats)

This is for a simple psychology report. I was wondering if I could hypothesise an insignificant mediation. Eg: "...based on this research it is predicted that group identity is not a significant ...
2
votes
0answers
39 views

Methods to determine reliability of measurements using median and median absolute deviation

I have several datasets containing hundreds of variables, measured at the same time point and with the same method. Some of these variables have been measured more often and assume consistent values. ...
1
vote
1answer
24 views

which test can be used for testing if the week over week increase/decrease is significant

I read some posts about this on this forum, but didn't seem to find an easy to understand explanation. so trying to post it here, please help to explain a bit more as i am not an expert on this but ...
-1
votes
0answers
22 views

Generating density function from $\phi(t)= 1-|t|$

Given: $\phi_X(t) = \left\{ \begin{array}{l l} 1-|t| & \quad \text{if |t| ≤ 1}\\ 0 & \quad \text{otherwise} \end{array} \right.$ Find the density of X. Attempt: ...