# Questions tagged [statistical-significance]

Statistical significance is a characteristic of a statistic viewed in light of a null hypothesis and a given significance level. It reflects whether the statistic belongs to the rejection region (is statistically significant) or the acceptance region (is not statistically significant).

5,460 questions
Filter by
Sorted by
Tagged with
11 views

### Find two dimensional sufficient statistics?

Suppose that x is equal to X1,... Xn is an I.i.d sample with density Find two-dimensional sufficient statistics for theta and phi Hence or otherwise show that the sufficient statistics in part (a) is ...
13 views

### Downward slope but Spearman correlation coefficient is positive and vice versa

Why the slope and the Rho value not the same? For examples, graph H-DSI shows downward slope but the Rho value is positive (P value=0.9603; r=0.009867), while graph IVGR-DSI shows upward slope but ...
15 views

### Regression stats question

I am currently focusing on developing a way to predict the onset of sexual maturity in lake sturgeon by using the elemental composition in the fin ray. Lake sturgeon spawn later in life (females ...
14 views

### Poisson test - multiple replicates against null (in R)

I feel like this should be a pretty basic question, but I can't find a clear answer. I have multiple independent replicates of the same thing. Lets say I went and counted cars along a road between 8am ...
25 views

### How to find if a feature is important for a problem

I want to know whether a feature f is required for a classification problem C with a model m. I have two setups: 1. f is in training + test data, m has a performance p. 2. f is not in training or test ...
52 views

### What is the appropriate test for significance when comparing a subset of the population to the whole?

I am looking for discrepancies in performance evaluation data. For example, let's say I have a population that has 240,000 men and 86,000 women. So 326,000 individuals and 73.6% male/26.4% female. ...
29 views

### Right statistical test for frequency distribution

Say that after getting data from 5 different years on causes of teenage pregnancy you want to confirm that sexual assault is a common factor contributing to teenage pregnancy. Dividing the data into ...
13 views

### Appropriate to rescale kernel densities to radians and use watson's two sample test of homogeneity?

I'm looking at activity budgets of animals derived from camera traps and gps collars. I'm pooling multiple cameras or gps collars within each group before comparing the activity of two groups against ...
26 views

### Test a single score against a sampled distribution of scores

I am currently working on a tool which calculates a score for each sample (i.e. patient biopsy) it is run on. Input samples can belong to one of two categories: case and control. Usually, a user would ...
7 views

### Quantifying the significance of impulse response functions

I use Stock and Watson's classic reference on vector autoregressions for this question. They carry out a VAR on inflation, unemployment and the interest rate and thereby produce the following matrix ...
44 views

### Understanding how to find the $1$ in $100$ chance on the $t$-table

Background In my university class, we've been discussing the following experiment: Consider an experiment on artificially raised salmon, with two treat-ments (one a control) and $20$ fish per ...
25 views

### Hypothesis Testing for categorical Data?

I was reading a post where the author was conducting hypothesis testing on the incidence of COVID-19 by conducting a poll on their Instagram. She found that while the world prevalence for COVID-19 was ...
38 views

### Way to test a hypothesis that mean of A is N times greater than mean of B?

I designed an experiment where there are two treatments: A and B. Each subject does both A and B with a randomized order, so it's a within-subject design. For example, the data would look as follows: ...
13 views

### Combining P values of two independent experiments

I am working with two cell lines studying the impact of a certain chemical on these cells. I have identified some key differences between the chemical expressing and non-expressing cells. However, ...
17 views

### The proper test statistic for variables which are functions of multinomials

This may be very basic but I'm drawing a blank and google isn't helping ... In an A/B setting I'm comparing two random variables $X_a$ and $X_b$. $$X_a = \frac{\sum X_{ai} * C_i}{\sum X_{ai}}$$ and \$...
13 views

### Should I use an ANCOVA test?

For this data set: I want to see if the DNA levels differ if there is food or no food and if this changes due to the number of days. Does it make sense to use ANCOVA as the Age could be considered a ...
29 views

### Statistical significance of distance between difference of vectors (LDA)

I have an output from Latent Dirichlet Allocation (LDA) which sums up the corpus of about 2,000 documents into 50 topics. The 2,000 documents belong to a category each (in total there are 4 categories,...
29 views

### Can my two Independent variables overlap? [closed]

brand A brand B utilitarian goods Product 1 Product 2 Hedonic goods Product 3 Product 4 Can I use (product 1 NO. per transaction +...
9 views

### How to factor out a confounding variable from a two way ANOVA when not all values are repeated measures

We have data that is organized so that each subject we sample from has one or more Groups which partially overlap between subjects. We collect ~10 samples from each Group. ...
20 views

### Significant main effects but no significant interaction (linear mixed model)

I fitted a linear mixed model with two fixed factors: "Group" (with 11 levels) and "Time" (with 6 levels) and one random factor "ID" (for repeated measures). I used the ...
20 views

### practical question re: sample size and significance

I just started running a digital ad campaign for my business and I'm trying to determine if I should continue spending money on ads or if I should pause - my research keeps leading me to come up with ...
13 views

### How to calculate the overlap significance between two gene list in R

This was my question suggested me to ask here. I have two gene sets from coming from expression and accessible region. So I have to compare the degree of overlap between these two sets. ...
8 views

### How can I better interpret growth curve models?

I am doing growth curve model analysis in R, using lme4. I have doubts (well, many, but these are the most important). (1) When I get the intercept result, it is ...
239 views

### T-tests provide info about the margin of mean difference?

I have 2 unpaired datasets where the difference of the sample means is quite substantial (with the naked eye). The t-test shows that the difference is significant (p-value=0.007) and I would like to ...
16 views

### Quantitative difference of two datasets

I have two biological datasets with different samples (rows) and same features (columns). I mean that I have D1 (M1 x N) size and D2 (M2 x N) size. M1, M2 is order of 2000, N is order of 500. All ...
103 views

### Regression not significant on univariate but significant when adding controls

I have a data on job type (i.e. dummy variable 1 if bad job and 0 if good job) and amount of debt individuals hold before finding a job. I ran a regression of job type on debt level, and I did not get ...
64 views

### How to better use and interpret granger test in R?

I have the following code and I want to show the connection of two different factors with a specific one. I want to use grangertest in R and I have the following ...
10 views

### Lift Charts and Significant Predictors

Suppose I have two models, Model A and Model B. Suppose each of them have the same set of predictors, the only difference is ...
27 views

### Two sample similarity analysis for non-independent daily time series data

What two sample or other relevant statistical tests can be performed in R between two samples which are independent of each other, but the observations within each ...
23 views

### Statistical differences between proportion percentages of multiple groups

I have data about 3 categories of people and the frequency distribution percentages of how many times some people belonging to these categories have visited one of three restaurants over a certain ...
24 views

### Does two way ANOVA excludes depending of one of the factors?

I am not statistician so I am sorry if my question formulation sounds confusing. The ultimate goal is to comapre two methods (A and B). Each method creates 24 numbers (so, 24 pairs). Apart from the ...
31 views

### If I run correlation analysis between two variables and get a non-significant result, is there any point to run regression and include covariates?

I ran correlation analysis between two variables and found a very non-significant result. I know that in a case in which you find a significant result, you might want to think about putting the two ...
18 views

### p-value for treatment/control ratio change in population

I have an experiment that has a slightly changing population as we drop individuals. Over the past 48 weeks, the treatment:control ratio has changed from 4:1 to 4.01:1. I want to assign a p-value to ...
23 views

### Appropriate Mean Comparison Test for Grouped Data

I apologize if this is an elementary question. Let's say I have a dataset that has at least two dimensions. To fix idea, let's call it gender and country. Let's say there are two genders and four ...
17 views

### Two one-tailed tests vs one two-tailed test when we expect a difference in one direction, but direction is unknown beforehand

Suppose we have a situation (example given below) where there should be an effect in a certain direction (either greater or less than), but we are unsure of which direction applies to our sample. ...
13 views

### Statistical significance for panel linear model for difference in differences analysis

I carried out a difference in differences analysis with fixed effects for units and times: $$y_{it} = \eta_i + \lambda_t + \delta D_{it} + u_{it},$$ I have a panel with several Italian villages (my ...
50 views

### Likelihood ratio test for random intercept (MATLAB)

I need to program a likelihood ratio test for testing the significance of a random effect in a linear mixed model in MATLAB. But I am having some trouble finding out how to correctly specify the null ...
4 views

### How to define data when using ggsignif with grouped bar graphs and facet_wrap in R [migrated]

I'd like to ask a question about the ggsignif package in the R software. I want to display significant stars in top of paired bar graphs using facet_wrap and I'm following this thread https://...
36 views

### Check if real data follows the memoryless property

Are there any methods to test if some real world data follows the memoryless property? For example, are there any statistical hypothesis tests that can be used to check if the data is truly "...
13 views

### Statistical Test for Independence Increments

https://www.youtube.com/watch?v=aCSocDPw8cM @7:45 - They mention in this video that for a Counting Process to be considered as a Poisson Process, it must at least have "Independent Increments&...
13 views

### how to prepare the data for two way Anova

I have this data I have to prepare this data to fit two way Anova test, so that the fall has to be the dependent variable, and the age group and gender are the dependent variable. my table is I do ...
62 views

### Why main effect becomes non-significant after reversing moderator?

I am currently fitting a linear regression with two IVs and their interaction effect: Y = β1X1 + β2X2 + β3X1*X2 The data was collected in an experimental study. X1 is a dummy variable, taking the ...
23 views

### What does t-stat values in stock return analysis represent? (from financial engineering thesis paper)

First, to introduce, this thesis title is Price Momentum and Trading Volume by Lee and Swaminathan(2000). I have posted a picture of a return analysis that was in the thesis. As you can see, it has ...
9 views

### Ranked Non-Parametric Test for Multiple Groups

I may not have searched well enough, but I haven't been able to find a solution online. I have a dataset with two variables (one a continuous measure and the second a categorical label for each ...
66 views

### measure the fit of two distributions

The population of a county is 150,000, ages and sexes are known. Somebody selected a sample of 2,000 people, the selection rules are not quite clear but the age and sex distributions are given. My ...
59 views

### Significant variables with insignificant levels and vice versa in logistic regression

I hope all of us get well during the pandemic. I have conducted an analysis using binary logistic regression to investigate the interaction between gender (male, female) and official language ...
32 views

### How to test the significance of plm estimation used for diff-in-diff application

Good morning, I used panel linear model estimation taking into account a generalized diff-in-diff approach. Using R and the function plm I set a two way fixed effects regression with time and unit ...
11 views

### Testing statistical significance of differences of means of two pairs of datasets (1 pair - 2 datasets for test; 1 pair- 2 datasets for control)

I am looking at cross-border M&A data coming out of China, before and after 31/12/2016 (2 datasets), and comparing the 2 mean values. I want to use the cross-border M&A data for the rest of ...