Statistical significance refers to the probability that, if, in the population from which this sample were drawn the true effect were 0 (or some hypothesized value) a test statistic as extreme or more extreme than the one gotten in the sample could have occurred.

learn more… | top users | synonyms (2)

0
votes
0answers
12 views

What Statistical tool should I use when my statement of the problem are the following? [on hold]

What is the most prevalent love style among the students as a whole and when grouped according to sex? What is the most prevalent level of social support among the students as a whole and when ...
1
vote
0answers
25 views

How can I measure difference between non-parametric data with many zeros?

I'm comparing two groups of students by their course activity and I'm struggling a little to determine the best way to test for significant difference. The data is non-normal, and very prevalent with ...
0
votes
0answers
9 views

Missing Data: Profile or Pattern?

In missing data analysis: is the term "missing profile" the same as "missing pattern". I think they are the same; but when I Google for "missing profile" together with missing data I don't get too ...
0
votes
0answers
8 views

Significance of a correlation considering missing data

So I'm dealing with two timeseries, of which one contains quite some missing data (between 10-60%). I'm excluding some datasets which contain exceptional much missing data, but still I would like to ...
3
votes
1answer
40 views

Measures to compute the similarity between two time series whose amplitude is periodic ignoring any phase differences

Question: Given two time series whose amplitudes are periodic, what measures could i use to quantify the similarity between them ignoring any phase difference? Specifically, i am looking for measures ...
0
votes
0answers
9 views

Inter-rater aggrement measuring among multiple participants in classed data

I have 100 items where for each item, multiple facts are given. I want to find the related facts for each item from the given multiple facts using human subjects. So basically I want to categorize ...
-1
votes
1answer
44 views

How to find the distribution of a function? [on hold]

How would one go about solving the following question: Assuming that $X \sim \mathcal{N} (μ,σ^2)$, find the distribution of $\sqrt{n}(\hat{\mu} - \mu)/σ$
1
vote
1answer
46 views

Quantitative importance for interacting variables in Artificial Neural Networks?

Is there any common/sound method to quantify (similar to T-test or F-test in regression models) the measures of influence and significance of terms in Artificial Neural Networks? By terms I mean both ...
2
votes
1answer
40 views

Big data database + software for advanced statistical analysis?

I need to run some statistical hypothesis testing, Anova, student's, least square fit, median, data mining, clustering... on a very large quantity of distributed data. (>100TB, Maybe columnar or ...
2
votes
1answer
49 views

Interpretation of this heatmap

Consider a synthetically generated dataset. Assume we have two groups of people, one is given diet pills, the other a placebo. Their weights are measured at 4 different days, namely, ...
0
votes
1answer
23 views

What do you mean by pollster bias in an election?

I came across harvards election poll data science question. I which they ask: Is there a pollster bias in presidential election polls? What exactly is a pollster bias? can some one explain it to me in ...
0
votes
0answers
11 views

Calculating a significant difference

I have a series of results for groups of students achieving a certain level and I need to highlight where the results for different groups are significantly high or low. For example: ...
1
vote
1answer
41 views

Testing the statistical significance of regression coefficients in a logistic regression

Are only the p-values relevant when testing the regression coefficients of a logistic regression? Does the z-value of a coefficient give any further information about the significance of the ...
1
vote
0answers
13 views

Hypothesis Test: Difference in Rates with Null Values

I am trying to test whether a difference in rates is significant, where either the numerator and the denominator can be 0. What is the most appropriate test to use? For a specific (imaginary) ...
1
vote
1answer
54 views

Maximum Likelihood estimator for family of binomial distributions

For the below example, I am considering Heads as a success and Tails as a failure, when I toss a coin. (Ex: The first row in the the below tables says, when I tossed the coin 10 times I got 3 ...
0
votes
0answers
9 views

Statistics question regarding sample size and test statistic [on hold]

Does Increasing the sample size makes the standard error smaller which in turn makes the test statistic larger (more extreme)?
3
votes
1answer
25 views

Is the significance of difference in slopes equivalent to the significance of the slope of the difference of two series?

Say you have an independent variable, $x$, and two dependent variables $y_1$ and $y_2$. I want to calculate whether these two variables have a significantly different slope. I can do it by calculating ...
0
votes
0answers
13 views

pair-wise comparison for two sets of data where each point contains multiple values

I have two sets of data of the same subjects with 8 time points in each set.The second set is a repeated measure of the same 5 subjects. There are 5 subjects polled per time point. Is it correct to do ...
0
votes
0answers
21 views

One-way ANOVA: Concluding one true differences without any post-hoc tests?

Let's say that I run a one-way ANOVA with 3+ levels and that it comes out significant. Can I then, from this result alone, conclude that at least the two sample means that differs the most in my data ...
1
vote
1answer
24 views

Diebold-Mariano test for predictive accuracy

I am using the Diebold-Mariano test in the forecast package of R to test the predictive accuracy. In particular, I want to ...
0
votes
0answers
3 views

Proof of equivalence between results obtained from alternative event study approaches

Consider two common approaches to an event study in the case of an asset return time series: 1. The event window model We define an estimation window and a distinct event window. We fit a model of ...
0
votes
0answers
18 views

Change point analysis along an environmental gradient

I am looking at environmental data - habitat scores and stream conductivity (water quality measure) and looking to do some change point analysis in a set of 178 observations. As opposed to a more ...
2
votes
1answer
22 views

Adjusted R-squared: number of terms or independent variables?

When applying a multiple linear regression, does the adjusted R-squared value depend on the number of independent variables in the model or the number of terms? Specifically, I'm concerned that adding ...
0
votes
0answers
12 views

Significance test for percentages

I have a test in which a person can choose to be in one of three chambers, and I want to compare two different population of people according to the time they've spent in each location. What is the ...
0
votes
0answers
12 views

What does the output of the sigtest function (from influence.me) mean?

Okay, I've read the documentation here but am still unsure about how to interpret the results of the sigtest function - ...
1
vote
0answers
27 views

Testing hypothesis when each data instance is a vector

The experiment involved studying population body velocity changes during a marathon . Velocity of each person in control group and experiment group were measured at multiple instances during marathon. ...
0
votes
0answers
17 views

To be significant or to be stabile, what's more scientfically important?

Recently I discovered the techniques related to cross validation. Basically you can split up your data in n groups and then run your model on one part of the data and assess prediction reliability on ...
0
votes
0answers
20 views

how to calculate Kolmogorov-Smirnov test for one sample in R [migrated]

I have a matrix in which I would like to calculate Kolmogorov-Smirnov test on each column separately. Let's say my matrix is like below ...
4
votes
2answers
114 views

What does an error in ANOVA indicate?

When I came across ANOVA, the instructor talked about df(Error), ss(Error), etc. What do these error terms indicate? Do error terms differ for two-way ANOVA with dependent and independent variables? ...
0
votes
0answers
37 views

Statistical comparison between two curves

I have two time course experiments of the same study, and I want to determine if the time course curve is statistically significant or not. Let's say I treated a group of people with drug A, measure ...
0
votes
1answer
39 views

Very stupid stats question about significance values

I have a very basic stats about significance values and p-value. Say I perform a test using 0.05 as the significnace level. Using this p < 0.05, I obtain say 20 000 significant points. Is it valid ...
1
vote
1answer
20 views

Statistical Significance of a Subset

I have looked around and haven't been able to find an answer to this question. Seems like an easy question, so maybe it's just a matter of looking in the wrong place. I have a data set representing ...
1
vote
0answers
21 views

Test for significant difference in smoking rate across age groups

I need to compute if there are significant differences in smoking rate across 4 age groups. I can assume a simple random sample from ages 15-55yrs, (made-up details below). I am wondering what type ...
0
votes
0answers
5 views

Treatment outcome and risk factor for failure?

I have to assess outome of a specific surgical treatment and the possible risk factors for failure of the treatment on a retrospective cohort. Size is 50 with long and varied follow up. May I ask the ...
1
vote
0answers
14 views

Understanding Results of ANOVA

I ran a two-factor ANOVA, where I'm looking at the time it takes to type a word. The data was split up by what type of task it took place in (6 tasks) and where the word was (outside/middle). For each ...
0
votes
0answers
5 views

Accuracy results on subsamples

Given a binary classification task, let us suppose that a classifier achieves an accuracy result of $x\%$ on a sample of size $N$. What would be a way to calculate the conditional probability that ...
11
votes
3answers
350 views

Are smaller p-values more convincing?

I've been reading up on $p$-values, type 1 error rates, significance levels, power calculations, effect sizes and the Fisher vs Neyman-Pearson debate. This has left me feeling a bit overwhelmed. I ...
0
votes
0answers
14 views

Method or Algorithm to produce near-accurate probability selection

Are there any known algorithms or methods to accurately identify, using random occurrences, the most probable next occurrence(s) as a pre-determined length of number set, by providing an already ...
0
votes
1answer
11 views

Finding the significance of certain questions in a survey

My company performs a Go/No-Go questionnaire to determine whether or not to go after a particular opportunity. In this questionnaire is a series of 14 yes/no questions. We have accumulated a ...
0
votes
0answers
16 views

Evaluating significance for difference of $R^2$

I have a dataset with five variables. The first three are the independent variables, the fourth is the dependent variable and the fifth is a factor variable related to the row (the fifth variable ...
0
votes
0answers
19 views

Comparing 2 insignificant p-values

I've run two t-tests, and the p-value of each is a=0.3 and b=...
2
votes
2answers
50 views

Meaning of significance level and critical values for kolmogorov smirnov goodness of fit test

I'm new to using goodness of fit tests and am encountering what I guess is a beginners misunderstanding of how the tables for critical values and different significance levels have to be read. I have ...
0
votes
0answers
12 views

interaction term not in expected direction

I am conducting a hierarchical regression analysis to test interaction effects. The main variable and the moderator are related to the dependent variable significantly and in expected direction. ...
0
votes
0answers
22 views

predict sales using naive bayes and handle sparse data problem

Problem I am trying to use naive bayes for ranking products in a search application. I would like to predict the sales of a given product given the search keyword and the category. the current formula ...
1
vote
0answers
45 views

Significance in beta regression and glm binomial

While performing betaregression using betareg R package I noticed that the terms in my model are often significant, even with very small sample sizes. I tried the same model using glm with binomial ...
1
vote
0answers
37 views

Understanding forecast horizon for Diebold-Mariano tests

I have a problem understanding the parameter horizon of the function dm.test {forecast} in my particular setting. Background: My goal is to forecast energy consumption for individual households. The ...
2
votes
1answer
28 views

How can permutation test be used for assessing the prediction capability of a model?

I have a set of real labels $(y_1, y_2, ...,y_n)$ and predictions $(\hat{y}_1, \hat{y}_2, ...,\hat{y}_n)$ produced by my model. My supervisor has told me to assess the significance of the predictions ...
0
votes
1answer
29 views

statistical significance help

How would I calculate statistical significance for these test results please? Really appreciate any help! Survey ...
0
votes
0answers
12 views

Significant change through different levels

I am not good with stats so this might seem obvious. I have seven levels in an archaeological site and I would like to test whether there is a significant difference in artefact length between levels. ...
3
votes
2answers
81 views

Compare two binomials with unequal groups of trials

I'm attempting to determine if store B is 'better' than store A. Let's say that the two stores are identical in every way except for the sales assistants. I'd like to determine if one store makes more ...