Statistical significance refers to the probability that, if, in the population from which this sample were drawn the true effect were 0 (or some hypothesized value) a test statistic as extreme or more extreme than the one gotten in the sample could have occurred.

learn more… | top users | synonyms (2)

0
votes
1answer
11 views

How to calculate confidence interval on pivot table?

I'd like to create a series of tables on the cheapest and most expensive streets around where I live, and wonder if someone could help with a query about confidence. I've got a set of house ...
2
votes
1answer
21 views

Are results significant?

I am fairly new to statistics so I am unsure which statistical test I should use to test which of the datasets shows a better result. The data looks something like this Variant A: { 3, 7, 10} ...
0
votes
0answers
10 views

Evaluating Treatments in Online Experiments

I'm exposing certain percentages of my userbase to different treatments, and evaluating the actions they take on the site according to those treatments. For example, I might have my original site ...
0
votes
1answer
14 views

Optimising simulation parameters - is it possible to produce regression style diagnostics such as p values?

Let's say I have a black box simulation of some sort. It takes a couple of input parameters, and then outputs data. The output can be checked for fit against real world data. Suppose I optimize the ...
4
votes
8answers
3k views

What's the name for this statistical fallacy?

I was told an anecdote by someone today who was trying to prove a point regarding safety. They said "50 people have been living in [area a] for the past two years one year (apparently I remembered the ...
2
votes
1answer
41 views

Regression - What to do with insignificant variables?

Please pardon me if you find this question very silly but this doubt has been troubling me for some time now whenever I want to run a regression. I am working on SAS. I have a dataset which has ...
0
votes
0answers
7 views

Determining if coordinates in a distribution are significant/goodness of fit

I have a non-normal set of data that has x and y coordinates (a non normal distribution). I'm trying to determine if I can include a few particular data points in my analysis or if I should exclude ...
0
votes
0answers
27 views

How to interpretate difference between bootstrapped and not bootstrapped logistic regression

I'm using nonparametric bootstrap to estimate confidence intervals (CI) for a multivariable logistic regression. It happens sometimes that a parameter is significant (CI not crossing zero) in the ...
0
votes
2answers
37 views

P-value versus Exp(B) value in Cox regression analysis

I performed Cox regression analysis for two Biomarkers. Both were significant (p<0.05). Biomarker 1 showed higher significance but lower Exp(B)=hazard ratio value than Biomarker 2 (see below). ...
2
votes
2answers
52 views

How to interpret a VIF of 4?

I am doing a multiple regression, trying to test the extent to which personal income changes and Presidential popularity can predict election results. I have a small sample size, unfortunately, as ...
1
vote
1answer
24 views

Dealing with variable certainty in categorical data

I have a question regarding statistical analyses for categorical variables. Without complicating it, I would like to know how you can deal with uncertain categorical data. That is, categorical data ...
0
votes
1answer
30 views

Difference between modelling and testing association

I have data set with binary outcome, with 5 continuous covariates and 4 discrete covariates. I am little confused as to how I test for association, for the discrete covariates, I used a chi sq test, ...
0
votes
1answer
26 views

Three Different Regression Results… Why is one so weak compared to the other two?

I have a data set I'm working with, it's roughly 450K rows of data. I'm breaking the data out from a certain column, and that column has three results. After that, I ran a regression analysis for each ...
0
votes
0answers
13 views

Statistical test to show if there's significant statistical difference in a set of outcomes

I am trying to find out if there's statistical difference between a set of outcomes. The event involves potting snooker balls; here are six students, each of them is required to pot 10 snooker balls, ...
0
votes
0answers
24 views

Association analysis of different angiogenic markers with different time points [on hold]

I would like to know the statistical tests which can be used to measure the association of the angiogenic measurements, measured at five different time points, with a biomarker.
0
votes
0answers
12 views

Significance test for difference between subset mean and population mean

I have customer usage data - number of products purchased by each customer during a specified time period & customer attributes (gender, location etc.) I want to make statements like male ...
0
votes
0answers
12 views

Significance test for subset variation from population

I have customer churn data: independent features like customer gender, location, age etc. outcome feature representing whether he/she has churned or not My population churn rate is around 30% ...
0
votes
0answers
5 views

Testing significance for continuous DV at each level of two IVs

most likely the answer to my question is so simple but I just can't think of any tests that would do this. I have a continuous DV and two categorical IVs. I would like to test the significant ...
1
vote
0answers
11 views

Testing if two variables have significantly different effects on the data

I'm looking for a way to test if two variables have significantly different effects on my data. I'm also interested in a way to test if they have the same effect. Currently, I'm jointly calculating ...
1
vote
0answers
97 views

What statistical analysis should I use for this (attached) dataset?

I have a dataset of 815 positive examples and 9492 negative examples for a certain class. Each example is represented by 12 features and a target label (i.e. TRUE/FALSE). The dataset is in a CSV file ...
0
votes
0answers
13 views

Significance Testing on total vs subgroup [closed]

Looking for some clarification. I'm fairly new to Statistics and am using IBM Survey Reporter. Am I right in saying that the system does not run significance including total sample column, and only ...
0
votes
0answers
17 views

how to use the likelihood ratio test for model selection in the study with several subjects

In my study, I have 30 subjects, for each subject, I use likelihood ratio test to compare two models (nested logistic regression), and I get a chi-squared value and a p value like the result shown ...
0
votes
1answer
19 views

Seeming Unrelated Regression (SUR) for logistic regression

I would like to perform linear hypothesis testing on whether $\beta_{11}=\beta_{21}$ in the logistic regressions \begin{align*} \text{logit}[P(Y_1=1|X)]=(\beta_{10}+\beta_{11}X)\\ ...
0
votes
0answers
18 views

Basic statistical significance

I need to check the statistical significance of some survey results. It relates to response surveys for innovation projects. The total number of participants is around 22,000. I'm using results of a ...
2
votes
2answers
12 views

Quantifying the irregularly of a data set

I have two 1D finite domains consisting of $N$ points each. In one domain the points are all regularly spaced, but in the other they are irregularly spaced. I would like to somehow quantify just how ...
1
vote
2answers
54 views

Why applying the same test to several hypotheses reduces its rejection power?

Reading "Kernel Methods for Pattern Analysis", by John Shawe-Taylor, I've got stuck into this sentence: [...] if we applied the same test for $n$ hypotheses $P_1, \dots, P_n$, and found that for ...
0
votes
1answer
21 views

Two-step Engle and Granger's procedure

If I want to check if there is cointegration between $X_t$ and $Y_t$ in the following model, is it enough to check p-value of Breusch-Godfrey test? The maintained hypothesis in this test is no ...
1
vote
1answer
108 views

What exactly is the critique in this regression?

Warning: I might be forgetting basic statistics here. Please edit title if it can be improved. This paper, seemingly summarized in the fancy ZUI slideshow here, points out a possible "critique" in ...
1
vote
0answers
29 views

Is this analysis sufficient, have I overlooked important statistical tools/terms [closed]

I'm doing a master thesis project, looking for patterns between two datasets. I have not had any statistical courses or similar. So I'm in doubt if I'm on the right track. Any comments or tips/tricks ...
0
votes
2answers
61 views
0
votes
0answers
15 views

what statistical test should I use for my quasi experimental study?

I am conducting a pre and post test questionnaire for my quasi experimental study. I am using two groups one group will receive training the other will not. I will only have about 24 participants. I ...
0
votes
1answer
12 views

How to analyse extremely low sample pre/post test data?

So the study involves assessments, then an intervention, and then the same assessments. There are two groups, 2 in one group, 1 in the other. Data is not binary but consists of scores on the ...
0
votes
0answers
14 views

Testing for Significant Differences of Part Worth Utilities in Conjoint Analysis

I want to check if there is a significant difference between the part worth Utilities for each product attribute. The following list shows an example of the part worth Utilities of survey respondents: ...
1
vote
1answer
41 views

P-Values decrease when additional significant variables added (multicollinearity?)

I am doing a study for my masters correlating two separate development indicators to election results for the incumbent government. Unfortunately, I was only only able to get 11 years worth of data ...
0
votes
0answers
12 views

What is the correct test to use for a categorial dependent variable and an ordinal independent variable?

I am trying to figure out if there exists a relation between the region someone lives in and their ranking of a website. The region variable is categorical, dependent, and spans 11 levels such as the ...
0
votes
1answer
20 views

Comparing two samples, same mean but diferrent size and variance

I have two samples drawn from different distribution that I can assume the normality and the same mean for both, however, the variance and the size of samples are different. How can I compare the ...
0
votes
0answers
26 views

How to compare percentages?

I have percentages for a variable that has two levels X and Y. The percentages are calculated using the Actual number of observations divided by the Expected number of observations (which are ...
0
votes
0answers
10 views

Is a test set sampled after training examples have been removed by an active learning algorithm valid?

In this case desire is to optionally label a final test set after training. The training is to be done using an active learning approach which can be biased towards different characteristics ...
0
votes
0answers
19 views

compare groups taking into account confounding factors

I have data from human participants in a study and I am using MATLAB to analyse it. The participants are divided in 4 groups according to their disease severity. The demographic characteristics of the ...
0
votes
0answers
11 views

On a problem with the implementation of the test of Dielbold and Mariano for equal predictive accuracy

To recall how the test of Dielbold and Mariano is set up I utilize the parsimonious words of Dielbold himself: Now, I have been trying to perform this test on the respective vector of errors of ...
3
votes
1answer
36 views

Testing the Validity of a Test Statistic (incorrectly)

In this post @Wolfgang shares a few lines of code to test in a simulation the ability of a particular test statistic to perform as expected, measured by the percentage of type I errors. He shows by ...
0
votes
0answers
19 views

If variables X and Y do not statistically differ and are highly correlated [duplicate]

I'm in a bit of a pickle. I have two variables X and Y that do not statistically differ and are highly correlated, and a third variable, Z. X is significantly correlated with Z, but Y is not. How can ...
0
votes
0answers
4 views

How to test for difference in starting dates for 2 groups across multiple classes?

I am trying to statistically test if individuals in two groups are different in terms of their starting dates for a program. Indicative data are shown below. I have multiple observations for two ...
0
votes
0answers
7 views

Ranking of significant (and insignificant) coefficients of regional dummies

I have multiple regression of dependent variable on some regional dummies. I see in a paper (Oswald 2010) that the author rank estimated coefficients of the state dummies. My sample size is about ...
0
votes
0answers
7 views

Compare accumulated data points from the weekend with data points from the week

my question is about an event in a clinical study. The event occurs at the weekend but also in the week. I want to check if there is a statistical significance between those two periods. The questions ...
1
vote
1answer
35 views

Which test should I use for hypothesis testing with a small sample size?

I've run a test with one control and one experiment group, and am questioning myself on whether or not I've used the right test (or if significance can even be calculated on the following sample ...
1
vote
0answers
24 views

Relationship between Matthews correlation coefficient (MCC) and the Pearson's Chi-square

I would like to find a reference showing that the MCC follows a Chi-square distribution. This is suggested in this wiki: https://en.wikipedia.org/wiki/Matthews_correlation_coefficient, as they claim ...
3
votes
0answers
56 views

Test for difference in proportions with small probabilities

I want to perform a test for differences between 2 binomial populations. The probabilities are small (usually less than 10 %). I can define the successes as "rare events". I think that the z-test ...
2
votes
1answer
24 views

Making sense of Yes/ No Type survey

I have a survey with 1 single question: Do you wish to join our club? Yes/ No Apart from the usual % and count of yes/ no respondents, is there any other measure I can derive from this? For example, ...
0
votes
1answer
32 views

What kind of statistics can be determined from this data?

I have data pertaining to an e-sport, such as player names, their kill count, their death count, their rounds won, their matches won, etc Currently I'm only able to say playerX wins the map N% of the ...