Statistical significance refers to the probability that, if, in the population from which this sample were drawn the true effect were 0 (or some hypothesized value) a test statistic as extreme or more extreme than the one gotten in the sample could have occurred.

learn more… | top users | synonyms (2)

2
votes
0answers
6 views

Confidence Interval for Regression Line (simple linear regression)

So I've constructed a confidence interval for my regression line. However, because I have 2500 data points it is a very, very narrow interval (I can barely see it next to the regression line when I ...
1
vote
1answer
14 views

Is least square dummy variable model better than random effects model?

I have a panel dataset with one dependent and twelve independent variables. There are 50 individuals with data for 100 days. Theoretically, most of them should be significant. First, I checked for ...
0
votes
0answers
12 views

Statistic test that check difference of proportion in paired data

I want to announce that my algorithm (denoted by A) is better than some state-of -the-art algorithm (denoted by B) I have n samples which are sentences from the wall street journal and for each ...
0
votes
0answers
9 views

In General, how to calculate “X” levels of significance? [duplicate]

After looking over statistics I have come across many questions which involve finding % level of significance of a set of data. how is this generally solved ?
0
votes
0answers
18 views

my Wilcoxon is contradicting my Spearmans Rho [duplicate]

In brief, I'm trying to find out if 62 people perform better on test one or test two. I ran a spearman's rho and it came back positive and significant with a moderate strength. In other words, when ...
1
vote
1answer
17 views

large sample and significance

I have a very large sample (790 million rows), and in this case, even small difference are determined to be significant, p <0.0001. The 95% C.I.s are very sharp. In this case, these tests (t-test, ...
1
vote
1answer
17 views

Finding subset of data where the 'B' in A/B testing is true

Suppose that I have implemented a referral program in my product, in which I offer rewards to a user whenever one of their referrals uses my product. Say, we reward him with gift/prize 'A'. I am also ...
0
votes
0answers
6 views

Find a significance difference between two models

I am trying to determine if immigration status is a determinant of risk preferences. To do this, I am using the 2014 Health and Retirement Study data which has approximately ~20,000 participants and ...
0
votes
1answer
23 views

Why is my Spearman's Rho result contradicting my Wilcoxon matched pairs?

In brief I'm trying to find out if 62 people perform better on test one or test two. I ran a Spearman's rho and it has come back positive and significant with a moderate strength. I.E As the test 1 ...
0
votes
0answers
11 views

Statistical Analysis of a set of numbers [on hold]

so I have never taken a statistics class before, but have come across a problem which requires statistical analysis, so sorry if this is a very basic question. So I have a set of numbers: 1 , 3 , 4 ...
0
votes
0answers
14 views

Significance of differences using bootstrapping

I have a matrix that I divide into 4 quadrants: Upper left, upper right, lower left, lower right. I want to know whether the ratio of the lower quadrants is significantly difference from the ratio of ...
0
votes
0answers
22 views

Why Does Adding Variables to a Model Make it Non-Significant?

I have what I'm assuming to be a basic stats question. I am comparing the survival functions of three study groups (i.e., the "main" IV under investigation) using ...
0
votes
0answers
14 views

Finding Power Function for a LRT test

I am trying to solve the following problem: Let $X_1, . . . , X_n$ be a random sample from the $Uniform(θ, θ + 1)$ distribution. Derive the power function for the LRT for $H_0 : θ = θ_0\ vs.\ ...
1
vote
1answer
29 views

Meta Analysis with continues outcome - appropriate effect calculation

I am conducting a meta analysis with studies on psychological treatments with continues outcome variables. The included studies use two different scales (either 0-20 or 0-100) for each study i have ...
0
votes
0answers
19 views

Specific Differences B/T SPSS Grad Packs

I have been using the Trial Version of IBM's SPSS Statistics Desktop v. 24 I would like to purchase the most affordable option that enables a few but very specific features my research requires. ...
0
votes
0answers
58 views

Standard error explanation [on hold]

In which direction and how far away, in terms of standard errors, is the estimated  difference ( Diff x ) in Case 1 from the hypothesised value. So what I've done is calculated t0= estimate - ...
0
votes
1answer
15 views

one sample t test by grouping variable with more than 2 groups

I am having trouble finding any examples of one sample t test comparing the group mean to zero where the grouping is not binary, in R. For example comparing the heights by ethnicity to 5 ft (not ...
0
votes
0answers
28 views

How to deal with statistically insignificant factors?

I used $2^4$ factorial design to screen significance of the factors $A$, $B$, $C$ and $D$. It turned out that $A$ and $B$ were significant, whereas $C$ and $D$ were not. Since there is no need to ...
0
votes
0answers
6 views

Significance test for yearly collected average data

I have data from a random survey that is collected every year. One of the variables are the expenditures per person for health care spent in the corresponding year. Another variable is the percentage ...
1
vote
0answers
17 views

Sample size references

For calculating sample size in clinical research, I have encountered different ways. For example, using lognormal distributions or calculating using ICC. I am confused which method to apply. Could ...
0
votes
0answers
8 views

Finding outliers on LiDAR for forests

I'm working with LiDAR data in college and focusing on preprocessing. I'm still graduating and this is my first project. So, I used the library of c++, Point Cloud Library (PCL) to deal with the ...
0
votes
2answers
24 views

Independent or Dependent Samples

I want to perform a statistical test: Wilcoxon Signed Rank Test to test if there is a significant difference between them, but I don't know if the two samples are dependent or not? Context: I have a ...
1
vote
0answers
33 views

How to specify a significance test for intercept and slope between multiple latent groups

I have done a Latent Profile Analysis on 34 symptom-distress-items at beginning of psychotherapy treatment. I came up with 5 latent groups. The entropy of the model was 0.779 The average Latent ...
0
votes
0answers
17 views

Independence test for three categorical variable

I want to know if my use of the $\chi^2$ test of independence is valid. I have three binary categorical variables, $X,Y,Z$, and I want to test the following hypothesis. If you are in the group $X = ...
0
votes
0answers
12 views

What n to use for significance of correlations in three different scenarios

I feel these questions might already be answered around here somewhere, but I was not able to find it, so here goes. 1) General case of time-series When determining the significance of a correlation ...
3
votes
1answer
32 views

Determining statistical significance of quintile means

I have a set of physician data which I have split into 5 somewhat equal quintiles (n's range from 44-53) based on the number of "HIV_patients_diagnosed_annually". I've then created a table showing ...
0
votes
1answer
14 views

Ranking submissions based on multiple judges

I have a situation in which we have 20 proposals and five judges. Each proposal is reviewed by three of the five judges, assigned to the proposal at random. Each judge scores the proposal out of ...
0
votes
1answer
13 views

what method to test percentage against population percentage?

I have population of 6 regions, and also customers from these regions. What is the best way to test if the percentages of customers from these regions are about the same as the population ...
2
votes
1answer
36 views

Quantile and inverse CDF? [closed]

Since the cdf $F$ is a monotonically increasing function, it has an inverse; let us denote this by $F^{−1}$. If $F$ is the cdf of $X$, then $F^{−1}(\alpha)$ is the value of $x_\alpha$ such that ...
0
votes
2answers
38 views

Testing for Normality

As part of an assignment I have to do a leakage study for a chemical product. We have been provided with data from 8 different batches, with 12 observations from each batch. The observed variable ...
0
votes
1answer
16 views

How to test that sample data is random? [duplicate]

Lets say there's a function that produces a random number between 1-10000. We need to verify that the generated numbers are truly random and that the distribution is uniform. How do we test the ...
0
votes
0answers
9 views

Hi anyone can help letting me know the difference between “Odd ratio” value and “reciprocal of Odd ratio”?

Hi anyone can help letting me know the difference between "Odd ratio" value and "reciprocal of Odd ratio"?what is the difference and which value should i mention if i am describing genotype ...
0
votes
0answers
22 views
+50

How to indicate whether the improvement of a ranking is statistically significant over another one?

I have two ranked lists of documents (List1, List2). After comparing each of them against the ground truth, I calculate precision at 5 (P@5) metric to measure how good are each of the ranked lists. ...
1
vote
0answers
13 views

Test of significance for glmer

I would like to test the effect of a treatment ("crop") on species richness. I would rather use a glm for richness as it is a kind of count data. Besides, I have a nested sampling design (5 values ...
3
votes
0answers
29 views

Statistical test to compare two groups: Does my proposed process make sense?

Here is the situation. I am facing a comparison problem where I am trying to compare an insulated pipe with a non insulated pipe. I need to test if the use of insulation creates a significant ...
0
votes
1answer
36 views

Analysing categorical variables in R with chisq.test, with small/no expected values

I was wondering if anyone could help me with analysing data in R. I am working with transplant data, I am looking to compare outcomes between on/off bypass at surgery. I previously asked for help ...
1
vote
1answer
41 views

What statistical test allows comparison of the 3rd quartiles between groups?

I am using r and have ~400 observations divided into 3 groups. Group A contains 199 observations, while B contains 173 and C contains 24. I have generated a boxplot of their corresponding measures ...
0
votes
0answers
19 views

How are pvalues calculated in the corelation and how do I get pvalues for biserial.cor?

In Hmisc package in R or with cor.test, we can get the pvalues for pearson or any other correlation. I wanted to calculate ...
0
votes
0answers
20 views

How to find relationship between two different time series?

I'm not the best with stats but I've been struggling to understand what approach to use to find a relationship between my stocks(or portfolio) and economic indicators(for example, inflation). I'm not ...
0
votes
0answers
29 views

Significance test

I'm doing a test about whether the influence that certain variables have on CEO compensation (such as firm size, performance and some dummy variables) has significantly changed over a period of time ...
3
votes
3answers
82 views

Type I error and type II error trade off

Can someone illustrate the trade off with the help of a diagram and intuitive explanation? Thanks
1
vote
0answers
32 views

Hypothesis testing with one or two multiple regressions

Assume I have following hypotheses: X is negatively related to Z Y is positively related to Z W is a moderator for the relationship between X and Z And I have some control variables: age health ...
1
vote
1answer
31 views

Why run a post hoc wilcoxon signed rank test after Friedman test, why not just skip to Wilcoxon sign test instead?

I understand that one is required to run post hoc tests after the Friedman test. For example, while the Friedman test may find a statistically significant change amongst 3 treatments, one may follow ...
1
vote
0answers
41 views

Differences in GARCH estimation when using R and Matlab?

For my thesis I'm fitting GARCH(1,1) models (standard GARCH, TGARCH and GJRGARCH) to some log returns of financial series using R. Judging from the p-values obtained using robust standard errors, it ...
0
votes
0answers
26 views

How to evaluate the combined effect of 2 variables?

I'm trying to analyse the effect of smoking on health. The health variable is binary(healthy or not) but there are 2 different exposures to smoking(active=variable A and passive=variable B). Variable ...
0
votes
0answers
17 views

How to compare two test according to power?

I know the expectation calculates the power of the test, but how can i find a test that is as good as the given one based on the power?
0
votes
1answer
12 views

Mixed-effect models for repeated measures - problems with the “Significance level”

I am trying to fit a linear mixed-effect model to my dataset to see the relationship between a self-reported questionnaire and some physiological data. I've created a first model including all the ...
3
votes
2answers
20 views

Test for difference of quantized distributions

I have a bunch of ratings, which are in the set {1, 2, 2.5, 3, 4}. I want to test the hypothesis that the ratings are different between two different populations. We can model these ratings as being ...
0
votes
1answer
51 views

Statistics: How to argue two numbers are significantly different from each other?

I have two groups and each group has four members. I assign each member equal score 5 in group A. I assign each member score 10 in group B. If I want to argue that the members in these two groups are ...
-1
votes
0answers
12 views

Similarity between two large vector

I have a two large/long vectors which I try to calculate the similarity between them. First vector: Length of the vector nearly: ~990 < ["RAB31", 25], ["SNAP25", 34], ["PCK2", 34], ["HMGCR", ...