Questions tagged [statistical-significance]

Statistical significance refers to the probability that, if, in the population from which this sample were drawn the true effect were 0 (or some hypothesized value) a test statistic as extreme or more extreme than the one gotten in the sample could have occurred.

Filter by
Sorted by
Tagged with
0
votes
0answers
5 views

Finding the right significance test and reporting the results

I am trying to compare the number of responses given to a psych test with an automatic method (no subjects involved) against the number of responses provided in a dataset that aggregates responses ...
0
votes
0answers
8 views

Testing the sum of coefficients in regression analysis in R [duplicate]

Hi StackExchange community, I would like to ask how to perform a statistic test on the sum of coefficients in regression analysis in R, possibly using a Wald test. As per my data, I have the ...
1
vote
1answer
21 views

How does the Bonferroni correction benefit from independent tests?

In section 2 of this PDF, it is stated that the Bonferroni correction "benefits" from the tests being independent, and that if tests are not independent, the Bonferroni correction could be ...
1
vote
0answers
19 views
0
votes
0answers
27 views

How to do a statistical test for numeric data that is discretised and broken down by groups

Background I have a situation where I have data on bank balances available with various respondents, and a flag for whether they completed a desired action (i.e., whether they purchased a loan or not)....
0
votes
1answer
27 views

Comparison of values by group with covariance

I have 3 groups of different sample sizes with covariance I need to include. I wish to evaluate the value dependence of the groups compared to group 1 (group 2, group 3 values compared to group 1). I ...
1
vote
1answer
16 views

How do you determine the significance of individual deviations in categories?

I have observations from human observers that were intended to place subjects into one of four categories (A-D). In fact, there are 100 subjects in each category. So in an ideal world there should be &...
0
votes
1answer
19 views

Total effect of main variable and it's interaction with dummy

I am going to estimate the following model: y=constant+b1(X)+b2(X)(Dummy) We have daily data from 1990 to 2000. Dummy variable is equal to one for the daily data of year 2000, else zero. b1 is the ...
1
vote
0answers
13 views

What to choose for null hypothesis and alternate hypothesis? [duplicate]

In this article which explains types of t-tests for “Independent Two-Sample t-test” example: We can confirm that the t-statistic is again less than the t-critical value so we fail to reject the null ...
1
vote
0answers
33 views

Techniques for finding UMVUEs

I'm learning about the different techniques available to find the UMVUE such as Rao-Blackwell and Lehmann-Scheffé theorems. My question is how to know when is better to use one method from the other ...
4
votes
1answer
178 views

Mann-Whitney test for a large sample

I'm not a statistician, so pardon me for being naive on this subject. I'm trying to understand if there's any statistically significant difference in the medians of 2 groups. Here are some of the ...
1
vote
1answer
16 views

Finding the p value for binary data

I have made an experiment with binary outcomes, and I struggle with calculating a p value to decide if it is significantly different than the control group. There were two sets of identical cells: one ...
0
votes
1answer
15 views

How to find the statistical power of a negative binomial model? [closed]

How to find the statistical power of a negative binomial model?
1
vote
1answer
44 views

Probability of a sample mean higher than population mean

I have solved this question but I am not sure if what I did is correct: It is found that the population mean and standard deviation for the paper are 45.292 and 18.761 respectively. Find the ...
0
votes
0answers
17 views

How should I interpret a non-significant model effect but significant parameter estimate?

I am running a negative binomial analysis with 2 main effects and 1 interaction. For the variable called "NR", the model effects table shows a non-significant value, but then in the ...
1
vote
1answer
19 views

Is it correct to evaluate differences of a binary variable between different places with a GLMM?

I am analyzing differences of a binary variable (presence / absence) between 3 wetlands with different pollution using a Generalized Linear Mixed-Effects Models with package lme of software R. My ...
0
votes
0answers
15 views

Grouping factors by statistical significance in R

I am trying to figure out the best way to group my data into factors to use for creating an MDS plot. I have annual discharge data that I would like to break into "high", "medium" ...
0
votes
0answers
19 views

Use sum of p-values from significance tests to determine best permutation of table columns

I have a table in which there are columns which are entirely filled with numbers. Given another table, I want to figure out which permutation of the other table's columns produces an arrangement most ...
-1
votes
1answer
24 views

Statistical test for difference in multiple proportions between 2 groups [closed]

I have two groups of respondents A and B. I would like to know if the overall difference in participation proportion across multiple events (event 1 to 50) between the two groups A and B is ...
0
votes
1answer
34 views

Significance Test for the Delta of Deltas

I'm running an analysis on a dataset that captures the test-scores of students before and after they took a class (control group). I also have the same data on an experimental group, test-scores of ...
0
votes
0answers
3 views

What test to use when checking significance between two accuracy and perplexity values for language models trained on the same dataset?

I created different language models on the same dataset and I want to check if one model performs significantly better than the other, by comparing accuracy and perplexity. I have the following: Model ...
1
vote
0answers
26 views

General method to find the “best” binomial test confidence interval

I'm trying to implement a function while programming that finds an exact binomial test confidence given a probability of success, p, number of trials, k, and value of alpha. So for example given p=0....
0
votes
1answer
31 views

Statistical test to determine if a variable is significantly positive or significantly negative?

Is there is a single statistical test I could do that would allow me to determine if a variable is significantly positive or significantly negative? By significantly positive or negative, I mean that ...
0
votes
1answer
44 views

How to compare two time-series datasets?

I am trying to compare the financial performance of green bonds and conventional bonds by looking at their historical bond yields, bond prices etc. individually over a certain period of one year. I ...
-1
votes
1answer
24 views

How to determine economic significance of an interaction term of two continuous variables in an OLS regression? [closed]

Y= Intercept+ Beta1X1+ Beta2X2+ Beta3(X1X2)** I want to determine the economic significance of Beta3 when Y, X1, and X2 are continuous variables, preferably in terms of standard deviation units. Is ...
1
vote
1answer
20 views

statistical test for one quantitative and one categorical variable

I am new to statistics and am trying on random data sets, one analysis what I am doing is trying to find if there is a relationship between two variables, duration and success where duration is ...
2
votes
3answers
59 views

Is there a name for, or interpretation of, very high p values?

If I flip a coin 1000 times and get only one head, I may suspect that the coin is biased. One justification for this suspicion is that I am unlikely to get so few heads under the null hypothesis of ...
0
votes
0answers
12 views

Detecting Difference in Monthly Data for a Single Month

Hi all I am interested in statistically detecting if one month in a 14 month data set is different than the others. The Problem For example let's say I have January 2018-April 2019 sales data and I ...
4
votes
1answer
76 views

Help with proving an inequality

I need help proving the following inequality that relates spearman and kendall correlations to be true. $$\frac{1+\rho}{2}\le\left(\frac{1+\tau}{2}\right)^2$$ where: $\rho$ is the spearman correlation ...
0
votes
2answers
34 views

Kolmogorov-Smirov two sample test, ties — will adding random noise fix the problem?

There are a lot of questions on this site about warning for "ties" in the Kolmogorov-Smirnov test. Here are a few of those questions. Is there an alternative to the Kolmogorov-Smirnov test ...
0
votes
0answers
14 views

Statistical test or simple A/B testing

Let's say I have two samples from some population. One sample is the control group, the other is the treatment group. Apart from the treatment, the samples should be, on average, equal. I also have ...
3
votes
1answer
78 views

Model averaging: predictor significance vs importance

What is the correct way to report the results of model averaging? I’m using MuMin in R, results include a p-value. It’s also possible to get the importance of each predictor. Example results below. ...
0
votes
1answer
5 views

Significance of relationship of B occuring when A is true

Is there a statistical-significance measure of B occurring when only cases of A being true? I understand that to get a correlation you need two variables, but we are only looking at patients with A ...
0
votes
0answers
10 views

Assessing the change in a single variable, in two distinct groups each made up of multiple population samples. What significance test should I use?

I have 2 high schools, School A and School B. For the first school, I have 5 classes of students; for the second, I have 3 classes (so 8 classes in total). Within each class, I have different ...
6
votes
2answers
321 views

Statistical uncertainties in Deep Learning

Recently I got very interested in NLP applications of deep learning. Diving into literature (on arXiv for instance) I noticed that is very unpopular to quote and estimate uncertainties on scores of ML ...
0
votes
0answers
8 views

Testing for significant difference between groups of fold-change

Using time-series data, I'm calculating fold-changes between pairs of timepoints (e.g. 2h/0h) (N=15). I can broadly organize the resulting fold changes into two groups: those that increase (e.g. >1....
0
votes
1answer
51 views

How do you show a sequence of numbers is not random?

Let's say I take the following sequence of numbers: Obviously it's not random - each value is close to either .5, 1 or 2. What test would you use to show that it's not random? Thanks!
0
votes
0answers
12 views

report the results for the planner comparison between the bright group and the average of mixed and dull groups?

Looking at Levene's test of homogeneity of variance that was statistically significant (related to the question but i have not added it as an image). Hence, i would need to look at the "does not ...
1
vote
1answer
50 views

test if sample is meaningfully positive or negative

For a sample, say -11, 19, -6, 4, -7, 26, 2, what is the appropriate statistical test to see if this sequence is meaningfully positive or negative? So far, I come up with the idea of comparing its ...
0
votes
0answers
12 views

Need some statistical technique to analyze two list of increasing integers

I have below a table of 2 increasing integers. On column A and in column B. The content here is only an example. I want to be able to reason with on this two sets of data in terms of their gap ...
0
votes
0answers
9 views

Omnibus test non-significant but Model effects significant?

I am running some Negative binomial model and I am facing a situation where the model I use shows a non-significance in the Omnibus test (thus the model is not better than the intercept-only), however,...
0
votes
1answer
16 views

How can I calculate sample size for case control study?" [closed]

Please, I want to understand how to calculate the sample size the formula for the project entiled, "Evaluation of renal function in type2 diabetes mellitus patients attending federal medical Like&...
0
votes
0answers
6 views

Can a variable become significant when adding new variables to a regression? [duplicate]

I understand that variable can become non-significant when adding new variables to a regression even if they were significant before. But can the opposite happen? Thanks
0
votes
0answers
9 views

Determine if a distribution of ranks is significantly skewed towards low values

I have N vectors of varying length. The values are samples of ranks that have been normalized to be between zero and one. I would like to determine the M vectors (M < N), for which the distribution ...
0
votes
0answers
11 views

How to use Synth for comparative case studies?

I am trying to use synth for a comparative case study. I went through the documentation of the same, read the original research paper but I am still lost on how to actually implement it? which feature ...
0
votes
0answers
14 views

what metrics can i use to compare my two classifiers?

all, i have two classifiers (xgboost and light gradient boosting) to predict if yes cancer or not. when i use roc_auc as my scoring method i get xgboost as 0.75 and light gradient boosting as 0.76. ...
2
votes
1answer
21 views

What statistical tests or machine learning techniques would be best for discrete variables with many levels?

I have a dataframe with 20 categorical variables, each with 30+ levels. As a result I don't have a target variable on hand per-say but I would like to use statistical techniques or machine learning to ...
0
votes
0answers
20 views

Dealing with economic significance and statistical significance

For my thesis I'm regressing idiosyncratic volatility on institutional ownership and several control variables. I run a panel regression with firm fixed effects and get the following result: ...
0
votes
0answers
5 views

Significance level of a continuous distribution

Can the significance level of a continuous distribution be exactly equal to its value? For example for Exponential Distribution can the significance level of a test be exactly 0.02?
0
votes
0answers
29 views

How to determine if the difference between two of the “same” datasets is significant?

I have two distinct datasets that represent the price of the same product being advertised via two different channels. What I'm trying to determine is if the difference of the sold price on each ...

1
2 3 4 5
97