Statistical significance refers to the probability that, if, in the population from which this sample were drawn the true effect were 0 (or some hypothesized value) a test statistic as extreme or more extreme than the one gotten in the sample could have occurred.

learn more… | top users | synonyms (2)

0
votes
0answers
7 views

Statistical test to show if there's significant statistical difference in a set of outcomes

I am trying to find out if there's statistical difference between a set of outcomes. The event involves potting snooker balls; here are six students, each of them is required to pot 10 snooker balls, ...
0
votes
0answers
6 views

Association analysis of different angiogenic markers with different time points

I would like to know the statistical tests which can be used to measure the association of the angiogenic measurements, measured at five different time points, with a biomarker. Please provide your ...
0
votes
0answers
11 views

Significance test for difference between subset mean and population mean

I have customer usage data - number of products purchased by each customer during a specified time period & customer attributes (gender, location etc.) I want to make statements like male ...
0
votes
0answers
8 views

Significance test for subset variation from population

I have customer churn data: independent features like customer gender, location, age etc. outcome feature representing whether he/she has churned or not My population churn rate is around 30% ...
0
votes
0answers
5 views

Testing significance for continuous DV at each level of two IVs

most likely the answer to my question is so simple but I just can't think of any tests that would do this. I have a continuous DV and two categorical IVs. I would like to test the significant ...
0
votes
0answers
10 views

Testing if two variables have significantly different effects on the data

I'm looking for a way to test if two variables have significantly different effects on my data. I'm also interested in a way to test if they have the same effect. Currently, I'm jointly calculating ...
1
vote
0answers
78 views

What statistical analysis should I use for this (attached) dataset?

I have a dataset of 815 positive examples and 9492 negative examples for a certain class. Each example is represented by 12 features and a target label (i.e. TRUE/FALSE). The dataset is in a CSV file ...
0
votes
0answers
13 views

Significance Testing on total vs subgroup [on hold]

Looking for some clarification. I'm fairly new to Statistics and am using IBM Survey Reporter. Am I right in saying that the system does not run significance including total sample column, and only ...
0
votes
0answers
15 views

how to use the likelihood ratio test for model selection in the study with several subjects

In my study, I have 30 subjects, for each subject, I use likelihood ratio test to compare two models (nested logistic regression), and I get a chi-squared value and a p value like the result shown ...
0
votes
1answer
18 views

Seeming Unrelated Regression (SUR) for logistic regression

I would like to perform linear hypothesis testing on whether $\beta_{11}=\beta_{21}$ in the logistic regressions \begin{align*} \text{logit}[P(Y_1=1|X)]=(\beta_{10}+\beta_{11}X)\\ ...
0
votes
0answers
16 views

Basic statistical significance

I need to check the statistical significance of some survey results. It relates to response surveys for innovation projects. The total number of participants is around 22,000. I'm using results of a ...
2
votes
2answers
11 views

Quantifying the irregularly of a data set

I have two 1D finite domains consisting of $N$ points each. In one domain the points are all regularly spaced, but in the other they are irregularly spaced. I would like to somehow quantify just how ...
1
vote
2answers
51 views

Why applying the same test to several hypotheses reduces its rejection power?

Reading "Kernel Methods for Pattern Analysis", by John Shawe-Taylor, I've got stuck into this sentence: [...] if we applied the same test for $n$ hypotheses $P_1, \dots, P_n$, and found that for ...
0
votes
1answer
19 views

Two-step Engle and Granger's procedure

If I want to check if there is cointegration between $X_t$ and $Y_t$ in the following model, is it enough to check p-value of Breusch-Godfrey test? The maintained hypothesis in this test is no ...
1
vote
0answers
38 views

What exactly is the critique in this regression?

Warning: I might be forgetting basic statistics here. Please edit title if it can be improved. This paper, seemingly summarized in the fancy ZUI slideshow here, points out a possible "critique" in ...
1
vote
0answers
29 views

Is this analysis sufficient, have I overlooked important statistical tools/terms [on hold]

I'm doing a master thesis project, looking for patterns between two datasets. I have not had any statistical courses or similar. So I'm in doubt if I'm on the right track. Any comments or tips/tricks ...
0
votes
2answers
61 views
0
votes
0answers
15 views

what statistical test should I use for my quasi experimental study?

I am conducting a pre and post test questionnaire for my quasi experimental study. I am using two groups one group will receive training the other will not. I will only have about 24 participants. I ...
0
votes
1answer
12 views

How to analyse extremely low sample pre/post test data?

So the study involves assessments, then an intervention, and then the same assessments. There are two groups, 2 in one group, 1 in the other. Data is not binary but consists of scores on the ...
0
votes
0answers
11 views

Testing for Significant Differences of Part Worth Utilities in Conjoint Analysis

I want to check if there is a significant difference between the part worth Utilities for each product attribute. The following list shows an example of the part worth Utilities of survey respondents: ...
0
votes
1answer
35 views

P-Values decrease when additional significant variables added (multicollinearity?)

I am doing a study for my masters correlating two separate development indicators to election results for the incumbent government. Unfortunately, I was only only able to get 11 years worth of data ...
0
votes
0answers
12 views

What is the correct test to use for a categorial dependent variable and an ordinal independent variable?

I am trying to figure out if there exists a relation between the region someone lives in and their ranking of a website. The region variable is categorical, dependent, and spans 11 levels such as the ...
0
votes
1answer
20 views

Comparing two samples, same mean but diferrent size and variance

I have two samples drawn from different distribution that I can assume the normality and the same mean for both, however, the variance and the size of samples are different. How can I compare the ...
0
votes
0answers
25 views

How to compare percentages?

I have percentages for a variable that has two levels X and Y. The percentages are calculated using the Actual number of observations divided by the Expected number of observations (which are ...
0
votes
0answers
10 views

Is a test set sampled after training examples have been removed by an active learning algorithm valid?

In this case desire is to optionally label a final test set after training. The training is to be done using an active learning approach which can be biased towards different characteristics ...
0
votes
0answers
19 views

compare groups taking into account confounding factors

I have data from human participants in a study and I am using MATLAB to analyse it. The participants are divided in 4 groups according to their disease severity. The demographic characteristics of the ...
0
votes
0answers
10 views

On a problem with the implementation of the test of Dielbold and Mariano for equal predictive accuracy

To recall how the test of Dielbold and Mariano is set up I utilize the parsimonious words of Dielbold himself: Now, I have been trying to perform this test on the respective vector of errors of ...
3
votes
1answer
34 views

Testing the Validity of a Test Statistic (incorrectly)

In this post @Wolfgang shares a few lines of code to test in a simulation the ability of a particular test statistic to perform as expected, measured by the percentage of type I errors. He shows by ...
0
votes
0answers
19 views

If variables X and Y do not statistically differ and are highly correlated [duplicate]

I'm in a bit of a pickle. I have two variables X and Y that do not statistically differ and are highly correlated, and a third variable, Z. X is significantly correlated with Z, but Y is not. How can ...
0
votes
0answers
4 views

How to test for difference in starting dates for 2 groups across multiple classes?

I am trying to statistically test if individuals in two groups are different in terms of their starting dates for a program. Indicative data are shown below. I have multiple observations for two ...
0
votes
0answers
7 views

Ranking of significant (and insignificant) coefficients of regional dummies

I have multiple regression of dependent variable on some regional dummies. I see in a paper (Oswald 2010) that the author rank estimated coefficients of the state dummies. My sample size is about ...
0
votes
0answers
5 views

Compare accumulated data points from the weekend with data points from the week

my question is about an event in a clinical study. The event occurs at the weekend but also in the week. I want to check if there is a statistical significance between those two periods. The questions ...
1
vote
1answer
35 views

Which test should I use for hypothesis testing with a small sample size?

I've run a test with one control and one experiment group, and am questioning myself on whether or not I've used the right test (or if significance can even be calculated on the following sample ...
1
vote
0answers
20 views

Relationship between Matthews correlation coefficient (MCC) and the Pearson's Chi-square

I would like to find a reference showing that the MCC follows a Chi-square distribution. This is suggested in this wiki: https://en.wikipedia.org/wiki/Matthews_correlation_coefficient, as they claim ...
3
votes
0answers
53 views

Test for difference in proportions with small probabilities

I want to perform a test for differences between 2 binomial populations. The probabilities are small (usually less than 10 %). I can define the successes as "rare events". I think that the z-test ...
2
votes
1answer
21 views

Making sense of Yes/ No Type survey

I have a survey with 1 single question: Do you wish to join our club? Yes/ No Apart from the usual % and count of yes/ no respondents, is there any other measure I can derive from this? For example, ...
0
votes
1answer
32 views

What kind of statistics can be determined from this data?

I have data pertaining to an e-sport, such as player names, their kill count, their death count, their rounds won, their matches won, etc Currently I'm only able to say playerX wins the map N% of the ...
0
votes
1answer
20 views

Is it necessary to report standard errors with marginal effects?

I've run a probit regression in R with a random effect and can find no way to get the marginal effects with s.e. and p values. I have therefore tried to calculate the marginal effects 'by hand' by ...
2
votes
0answers
21 views

How to determine proper significance level in forming hypothesis?

I am conducting a Two-Way ANOVA test on a set of data, with replication; there are two variables, each with 3 different categories (thus, 9 different groups). Each group has 4 data points, bringing ...
2
votes
2answers
289 views

Fisher's test with large data

I want to compare the proportions in two samples, that can be organized as P NP SAMPLE_A 3,129,548 427,953 SAMPLE_B 2,930,639 407,353 If I ...
3
votes
0answers
28 views

Leaving insignificant variables in a regression - Sources?

I'm aware that this question has been answered many times on this forum, however, I've not seen it accompanied by any sources. I'm looking for sources which support the inclusion of control variables ...
-2
votes
0answers
58 views

What is the math behind ANOVA? [closed]

I have applied Matlab anova1 function for calculating the p-value for a one-way ANOVA. Let's say I have a vector x where each element belongs to one of four groups. Could somebody show me how the ...
1
vote
0answers
11 views

Using percentage values in ANOVA test?

I have a number of values expressed as an index (the proportion of heart muscle cells in s-phase compared to the total population of heart muscle cells, calculated as (number of S-phase cells / total ...
2
votes
1answer
49 views

Paired Comparison Preference Test

From a real-life situation, but distorted enough to be untraceable... A cohort of patients (n= 300) were each one subjected to two procedures (...
0
votes
0answers
8 views

Testing groups with categorical observable for significant difference

I am looking for a suitable statistical procedure to find groups of variables that are not statistically significantly between them when I have several dependent variables. I have a table containing N ...
1
vote
0answers
30 views

How to calculate the required sample size for x% accuracy?

I've made an algorithm for parsing some strings, and the question I have is how many random strings should I collect and test to get an estimate of how good the algorithm is? Testing on all is not ...
0
votes
0answers
24 views

Confidence interval for maximum value in velocity time series

I have a time series of velocity values, which is structured into two periods. The first period describes the baseline velocity ("pre"). At the beginning of the second period ("post"), a stimulus is ...
0
votes
0answers
32 views

Why using the Wilcoxon Rank Sum Test instead of any other pairwise statistical test?

I am quite rookie in statistics and I have a simple question to ask. I have to compare pairwise 32 variables, each one with 10 f-measure outputs. I used the Tukey-HSD test and results were quite ...
0
votes
0answers
18 views

combining different but linked studies in meta-analysis

I am trying to join two datasets and was wondering if there is a formal method to do a meta-analysis or even if this can be categorized as a meta-analysis in the first place. Dataset 'a' has detailed ...
0
votes
0answers
34 views

How to interpret economic significance if variable is zero most of the time

in my paper I constructed a continious variable which measures the strength of a certain event. If there is no event the variable is zero. So my panel looks like this: ...