Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange
Make your voice heard. Take the 2019 Developer Survey now

Questions tagged [statistical-significance]

Statistical significance refers to the probability that, if, in the population from which this sample were drawn the true effect were 0 (or some hypothesized value) a test statistic as extreme or more extreme than the one gotten in the sample could have occurred.

1
vote
0answers
18 views

Comparing Test and Control Lift in Proportion

I have two groups - a test/treated and control group - for which I am trying to assess whether the lift or percent change in proportion from a pre to post period between the two groups are unequal. I'...
2
votes
1answer
10 views

Can I use one-way ANOVA instead of repeated measures ANOVA even when data has been collected for all subjects under all the conditions?

I have data collected for 20 subjects under two conditions for each of the subject. When I want to compare the means of the two conditions, is it absolutely necessary that I use the paired T-test? My ...
0
votes
2answers
32 views

Insignificant Dummy Variable in Regression

How can you refer to insignificant binary dummy variables in the results chapter of papers? E.g. when it has been found that gender is not significant. Can you state that there are no significant ...
0
votes
0answers
17 views

Is the critical t-statistic value always 1.96 for the standard normal distribution? [duplicate]

I am running a regression model and assume that all my variables are following a standard normal distribution. From this model I am getting the value of the coefficients of the predictors and their ...
0
votes
0answers
16 views

Comparing statical significance on a line chart

I have a line chart similar to the one below that shows the change in mean values over time for 5 datasets (A, B, C, and D). As you can see the plot includes error bars representing 1 +/- standard ...
14
votes
5answers
1k views

How do I compute whether my linear regression has a statistically significant difference from a known theoretical line?

I have some data which is fit along a roughly linear line: When I do a linear regression of these values, I get a linear equation: $$y = 0.997x-0.0136$$ In an ideal world, the equation should be $y ...
0
votes
1answer
22 views

What does it mean as the sample mean is further from the population mean?

I'm currently studying the topics about the statistical significance. For which I got confuse about the alpha level and random sampling error. But I got more confuse about this line that I read: The ...
1
vote
0answers
12 views

Does the size of original dataset influence measurment error in bootstrap? [on hold]

As above. So for example would the measurment error of model's r-squared be higher if the bootstrap sample (1000) was drawn from original sample of 20 observation than if the bootstrap sample (1000) ...
1
vote
1answer
10 views

If through a procedure I am able to decrease the type 1 error in a statistical test, what implications does it have for statistical power?

In a testing procedure, say I am able to reduce my type 1 error, and that is the only thing it reduces. Am I able to make any conclusions about my statistical power, which is defined as 1 minus the ...
0
votes
0answers
12 views

How to compare two sets of time dependent proportions?

I am doing a sentiment analysis task about the people's attitudes towards transportation services in Hong Kong. I collected Tweets near the railway stations and see if there is any difference between ...
0
votes
0answers
4 views

Statistical test to validate score of perceptual speech quality

We would like to evaluate an algorithmic score of the perceived quality of speech after compression. The experiment will be to get a set of speech samples with different compression setings or ...
0
votes
0answers
26 views

Multiple comparisons correction in between-subject classification analysis

I am working with a dataset of 46 subjects (23 controls and 23 patients) fmri brain t-maps each with 4 experimental conditions. The main purpose of my analysis is to find the highest classification ...
0
votes
0answers
22 views

Significantly different in categorical variables [closed]

I am working with a categorical variable with 4 mutually exclusive classifications (CC, CD, DC and DD). I had counted how many times each classification is repeated. (for example, 33 CC, 40 CD, 50 DC ...
0
votes
0answers
29 views

Comparing linear sets of data

I'm trying to validate the use of different sample tubes in a pharma environment. We have an established method with a linear calibration curve and QCs at three concentrations within the curve range. ...
0
votes
0answers
9 views

Co-occurence in a population

Let's say I have a population of size N that has traits a-z. Some people/samples might have just a,n,x, etc... P(a), ..., P(z) is known. # of people with i & j in the population is known for all ...
0
votes
0answers
28 views

Principle of all statistical tests [longread][discussion] [closed]

I know that this is not the right type of question to be asked on stackexchange. If this question gets to much downvotes I will take it down. If somebody knows the appropriate place to discuss these ...
3
votes
1answer
40 views

Transitivity of statistical significance

Say I have three sets of observations, $A$, $B$, and $C$ (say, the heights of Australians, Americans and Brits). I assume that they are all normally distributed, independent etc. I perform two-sided ...
1
vote
0answers
16 views

How to look at individual test result after we adjust p value for multiple comparison

For example, we have 100 biomarkers. We are making 100 t test for biomaker measures over two treatments. After p-value adjustments, we find 10 of them are significant. Now we want to look into these ...
0
votes
0answers
9 views

I need to use quantile function (student) on spark [closed]

I would like to know if there is a function on Spark(java) to compute the quantile function of student's distribution. The equivalent function on R is qt() Thank you for you help
0
votes
0answers
8 views

Sound unit testing of convergence of an implementation of a stochastic algorithm

(My statistics knowledge comes mainly from computer science, so I might be overthinking the following...) I have implementations of several stochastic optimization algorithms (evolutionary algorithms,...
1
vote
0answers
27 views

What calculation to show what is really “statistical significant” result that justify the choice of one system over another? [closed]

Sorry for the a bit vague question. Here is the situation why I want to know the answer. I have developed a system and it is compared to an existing system. The samples are sentences from documents. ...
2
votes
2answers
45 views

Inference based on a single observation

Imagine we use machine A to perform a task, we repeat it 1000 times and it always takes more then 30 min to finish the task. We buy a new machine (machine B) and in the first run it takes 29 min to ...
0
votes
0answers
13 views

Using only positive or neg determine if two groups are statistically different [closed]

Is there a test I can use to determine if two groups are significantly different if they look something like this: ...
0
votes
0answers
17 views

Information gain or regression for measuring to what extent a continuous quantity detemines a discrete one?

I have a small population S and two quantities P and Q associated to its members. P is integer valued (say, age taking integer values between 1 and 20) and Q real valued (say, height in meters). I can ...
0
votes
0answers
15 views

How to compare multiple levels of data

I am trying to figure out which statistical test I need to use in order to compare my data. Basically, I had to asses cell viability in medias restricted in one amino acid. So, I had 19 different ...
0
votes
0answers
22 views

Statistical test to compare the mean of two samples

There's a competition with 20 categories, and each category has 3 winners. I have an array of the winner's performance of the next year (60 values), and other array with the average of the competitors ...
0
votes
0answers
16 views

Creating a contingency table for Chi-Square test

So I have this data I was wondering how to create a contingency table for it to be able to perform the Chi-square test. Please note that the two groups are not equal and every single cell contains a ...
0
votes
0answers
32 views

Statistical test on likert and ranking data

I have data in which survey participants hand to rank (Rank 1 to 3) three specific products. They also answered some 5 point Likert scale questions (from 1: “Strongly Agree” to 5:“Strongly disagree”) ...
1
vote
1answer
39 views

Bootstrap Hypothesis Test: Comparing the Performance of two Models

I have two models $A$ and $B$ as well as a training set $X$. I want to test whether there is a significant difference in performance between model $A$ and $B$. I'm attempting to do this via ...
1
vote
0answers
17 views

Test for average of independent, non-Identical binomial distributions

I have a box with $m$ coins, each with a probability $p_i$ for $1\leq i \leq m$ of flipping heads. As an experiment, I flip each coin $n_i$ times, recording the results. What is a statistical test I ...
0
votes
0answers
32 views

Test for lognormal distribution [closed]

Do you know how to test, whether a lognormal fit is okay or not - I would like to test in R via statistical tests.. ...
0
votes
3answers
48 views

How to interpret this Confidence Interval?

I'm currently writing a critique on an RCT and my essay should include a report on the findings of the study. I have very minimal knowledge on interpreting statistics and papers. I'm confused on how ...
2
votes
1answer
38 views

Independent and Identically distributed assumption in Maximum likelihood estimation

I was reading about Maximum likelihood estimation from various sources on the internet and I noticed that MLE makes an assumption about the data known as IID but I didn't completely understand why is ...
0
votes
0answers
27 views

1 experimental group - 6 control groups: ANOVA or t-tests or something else?

Objective: I want to find out, if a certain machine learning algorithm can select the right 100 stocks out of my stock universe of 2.000 stocks, such that they achieve better combined yearly returns ...
0
votes
1answer
49 views

'p-value' for clustering

I was just wondering if there is a way to check if the clustering found by a specific method (e.g., KMeans, DBSCAN, Mixture Models, ...) is significant. Something in line with, there is 5% chance that ...
0
votes
1answer
13 views

Detecting significant changes in groups of values over certain ranges of time-series

Below is an example of data output. It represents indicies [y-axis] calculated for 52 weeks in a range of 64 years. Group of 64 years is classified and several years are represented with blue, some ...
0
votes
1answer
24 views

Chi-square test with replicate nested

I have a question about how to analyse count data with replicates nested in each treatment. For example, imagine temperature can influence the sex ratio of mosquito larva emerged from eggs. I have two ...
1
vote
0answers
11 views

How can we analyse the effect of different social media meta tags on the number of visits to the page that each share generates? [closed]

My colleagues and I want to test whether different versions of social media meta tags (which set the image and text people will see if the page is shared on Facebook, for example) lead to a ...
0
votes
0answers
52 views

Assess statistical significance with before & after binomial data from few participants

For the quantitative analysis of a pedagogical approach, I applied a series of (equivalent) tests prior and after lessons. I want to evaluate the reading (proper identification of sounds from written ...
0
votes
1answer
11 views

Significance of the sum of the main effect and interaction term

Consider a simple linear regression with an interaction term: $Y=b_0 + b_1X +b_2Z+b_3XZ$ where $X$ is continuous and $Z$ is a dummy. I want to find out whether $X$ has a significant impact on $Y$ ...
0
votes
0answers
19 views

Significant difference help

I have a quick question regarding which statistical test to use to test for a significant difference. My set of data shows the monthly output of a product for the years between 2013-2017. A new ...
3
votes
0answers
29 views

How to combine multiple p-values into one? [closed]

I have the data of 841 genes along with the p-values which represents the association of that gene in a particular tissue (Aorta in this case) with some diseased phenotype. I want to combine the p-...
1
vote
0answers
93 views

Use of 50% confidence interval to detect marginally-significant fixed effects in linear mixed models?

I read this research paper today: Fates of trees damaged by logging in Amazonian Bolivia. In my understanding, the authors used the following approach to determine if fixed predictors in an LMM are ...
0
votes
0answers
12 views

Comparing Residual sum of squares

I have 30 sets of experimental data which I am then modelling with coupled differential equations. Not every data set has the same range (some lists are longer than others). For each data set I have ...
0
votes
0answers
11 views

Comparing gas pipe failure rates by soil type

I'm trying to establish whether certain soil types are associated with (statistically significant) higher rates of gas pipe failure. I have a set of polygons representing different soil ...
0
votes
0answers
13 views

Sampling theory of correlation; sign of population correlation coefficient & hypothesis design

I'm currently studying 'Estimation of population correlation coefficient from sample correlation coefficient. Source: https://newonlinecourses.science.psu.edu/stat501/node/259/ Test statistic is like ...
0
votes
0answers
9 views

Performing pairwise tests of proportions for multiple independent stratum

G A B 1 0.24 0.19 2 0.15 0.13 3 0.06 0.075 4 0.02 0.04 Say I have data like those shown above. Each row in the set represents a unique stratum (e.g. ...
0
votes
1answer
27 views

How to handle and test categorical dummy variables when interested only in certain levels?

I want to build a multiple linear regression model. I want to test the effect of a nominal variable with 10+ levels, but I am interested in testing only the effect of 2 of them. 1st Question: How ...
0
votes
1answer
19 views

testing whether two correlation coefficients are different from a non zero value

Hello I have 2 bivariate normal populations with correlation coefficients p1 and p2 respectively. I could easily obtain samples from both. I am interested in testing whether the difference in these ...
1
vote
0answers
19 views

What is the statistical test to use for a trend analysis for continuous variables (non-paired)?

Please excuse my very elementary question... Please see attached graph. This is an example of the kind of data I'm trying to analyze. The data points are non-paired. There is definitely a time-...