Statistical significance refers to the probability that, if, in the population from which this sample were drawn the true effect were 0 (or some hypothesized value) a test statistic as extreme or more extreme than the one gotten in the sample could have occurred.

learn more… | top users | synonyms (2)

7
votes
1answer
19 views

How should the individual researcher think about the False Discovery Rate?

I've been trying to wrap my head around how the False Discovery Rate (FDR) should inform the conclusions of the individual researcher. For example, if your study is underpowered, should you discount ...
0
votes
1answer
18 views

Which statistical analysis test can I use when the instances in the sample is not independent?

I am wondering if the data I have here is eligible to do statistical analysis. The problem is: I collected data from 20 person with age less than 20 (Group A), from 21 person with age large than 30 ...
3
votes
0answers
21 views

Testing if the difference between two count variables is different from zero

I have two count variables for several hundred thousand comparisons, one expected and one observed, and I would like to test if the counts are significantly different. One possible approach I have ...
0
votes
0answers
13 views

Interpreting conflicting hypothesis results from anova test

I've created a test where a participant plays a game and must maneuver as many 3 pointed stars to the right side of the screen and 4 pointed stars on the left as they can within a time limit. The test ...
-1
votes
0answers
4 views

How to asses significant differences in between participant pretest posttest design?

So, the groups would be control group and experiment group. The scale used is ratio. Both will be given pretest and posttest. So, how should I assess the differences between control group and ...
1
vote
0answers
24 views

Non-significant interaction effect

I currently have a regression where adding an interaction effect between two significant variables (a float and a boolean) makes them non-significant. Given that this interaction effect is not ...
0
votes
0answers
3 views

recurrence quantification analysis

I am relatively new to the use of recurrence quantification analysis (RQA) is a method of nonlinear data analysis which quantifies the number and duration of recurrences of a dynamical system ...
0
votes
0answers
14 views

How to check for confounding factors

I have been doing an analysis using a difference in difference setup. In my raw sample I OLS and first difference (two time-periods) I get the effect that I would expect. Namely that shocks in the ...
0
votes
0answers
8 views

Why is path b mediation model insignificant? What does this mean?

Path b (mediator --> outcome variable) is not significant in my mediation model when I ran a regression even though the relationship between the mediator and outcome variable were significant in basic ...
1
vote
0answers
89 views

One-sided significance test for correlation

Let's say you have data from two random variables $X$ and $Y$, and the two random variables are highly correlated (ex: $r=.97$). The p-value, which is testing the null hypothesis that there is no ...
1
vote
0answers
16 views

Determining statistical significance of data changing over time

I have collected motion data from three people over two days. Each of the subjects collected motion data from themselves for around 5 hours a day, for the two days, so I have about 10 hours of data in ...
2
votes
0answers
22 views

Testing significant difference of correlation matrices

I'm interested in exploring whether responses to a series of attitudinal questions differ across various countries. I could check significant difference in mean scores but am more interested in the ...
0
votes
2answers
25 views

Compare lists of genes

I have two lists of differentially expressed genes: the list 1 was derived from the universe A of total genes while the list 2 was derived from the universe B of total genes. A number of genes is in ...
1
vote
1answer
21 views

Does rejection of null hypothesis ($p < \alpha$) for one representative sample imply rejection in a different sample?

I am new to hypothesis testing so forgive me if this has already been asked. Suppose that I've already decided on a null hypothesis with a significance level $\alpha = 0.05$, then obtained my ...
1
vote
1answer
19 views

Ryan-Joiner test for normality in MATLAB [on hold]

I have been reading a comparison of Anderson-Darling, Ryan-Joiner and Kolmogorov-Smirnov tests at this link: ...
0
votes
0answers
24 views

Reporting a binary logistic regression

The binary logistic regression model was found to be non-significant for my results. What should I include in my results section?for example, would I still report the Nagelkerke Rsquared?
0
votes
0answers
5 views

Algorithm performance data, what kind of statistical tests can I use

I have data on the time taken and CPU ticks taken for different cryptography algorithms to run. I used multiple size files, different key sizes and obviously different algorithms over multiple ...
0
votes
0answers
13 views

Obtaining significance for variables in a linear discriminant function analysis

I have run a linear discriminant function analysis using the lda() function in the MASS library to determine which of 6 ...
1
vote
1answer
10 views

Pooled T-Test for Binary Observations?

I'm trying to compare two populations with binary variables, and I'm not sure how to do a t-test to compare them in R. I think I'm supposed to do a pooled t-test, but all of the methods I'm finding ...
0
votes
0answers
9 views

Compute confidence cutoff for scatterplot

I have data collected from two different individuals for different treatments, like this: ...
1
vote
1answer
29 views

Is difference in proportions due to sample size?

I am currently working for a project team that is trying to reduce the number of defective parts produced in a factory. Without going into too much detail, the plant has a safety procedure where they ...
1
vote
2answers
225 views

Statistically significant?

I am new to statistics and so any help would be greatly appreciated! I have done a study looking at the number of samples being sent to the lab for patients with UTIs in a GP practice. I then ...
0
votes
0answers
9 views

Need help setting up a model and running a test for significance

new poster here. I've taken very basic stats classes so I would like some help setting up a model testing the significance of an Act that was passed by the US gov't recently utilizing real data. ...
2
votes
0answers
19 views

Assessing the effect of a given predictor in multiple regression

I'm working with data from an observational study. Observations were recorded on several measures (comprising a response and $k$ predictors) and subsequently used to design a regression model with a ...
0
votes
0answers
18 views

Test statistics in IR (t-test vs Wilcoxon vs signed test)

I have just read this paper about different test statistics one could use in Information Retrieval (IR), discussing whether Wilcoxon, Sign-test or Student t-test would be more reliable for comparing ...
0
votes
0answers
6 views

What are pro-cons of Wilcoxon signed ranks when compared to sign-test on information retrieval

I have to judge whether a search engine A retrieves better results than B. I have the average precision of each for 10 different queries. I run both sign-test and Wilcoxon signed-tanks test. Now, the ...
1
vote
0answers
33 views

Wilcoxon signed rank test - Normalize data or not?

I am comparing my algorithm's performance with other algorithms, for a minimization problem. There are ten different benchmark problems, for which I have computed the average solution quality for all ...
0
votes
1answer
14 views

Hypothesis significance better than Mean Average Precision?

Consider I have two search engines, one (B) with Mean Average Precision higher than the other (B). Now, can this metric be enough to say that the first search engine A is better than the second one B? ...
1
vote
0answers
12 views

how t values are calculated in Geographically weighted regression?

I can't find the explanation of how local t-values are computed in Geographically weighted regression. Does anybody know what's the equation used how it works? Thank you
1
vote
0answers
21 views

Appropriate Test for Statistical Significant Change in Values Over Time [duplicate]

I have four number of values for number of policies within a given field put forward in a given year. I want to find if there is a statistically significant increase or decline in the number of ...
1
vote
0answers
18 views

Compare between many items [closed]

I'm doing a spatial analysis comparing testing meteorological conditions. In my tests I'm checking if a certain phenomena is at the same place in different dates. The end Output I have is a big list ...
2
votes
1answer
16 views

Hypothesis Test on Contest, a problems?

We have a contest 1 weeks ago. One question is a bit strange for us as follows: $X\sim B(4,p). $ for test $H_0:p=0.2$ versus $H_1:p>0.2$. if $X=4$, $H_0$ assumption is rejected. calculate ...
1
vote
0answers
6 views

Multiple Library Customer Service Survey

My office has purchased a customer satisfaction survey for 106 public libraries. There are 189355 active library members in the province but only 677 individual chose to complete the survey. Would ...
0
votes
2answers
25 views

Statistical test to compare paired scores

I would like to measure (to quantify with a statistical test) how much different are paired scores. For example: for gene "x" I performed an experiment with technology A that gives a score, then for ...
1
vote
0answers
10 views

Assessing stability of a method to less data (subsets of it)

I'm working on a (computational biology) method which provides a result given a set of data regarding a cell. For example, it takes a picture of an object (or a part of it) and assesses the object's ...
0
votes
0answers
6 views

Interpreting moderation in a hierarchichal regression

I am researching whether gender moderates the relationship between exposure to trauma and PTSD. The results are confusing me. I found that gender does predict PTSD above and beyond exposure. However, ...
1
vote
1answer
42 views

Cox model on bank customers

I am setting up a Cox model, to model the probability that new customers leave the bank . I had a nice set up, with plenty of significant explanatory variables, until the result of one categorical ...
2
votes
1answer
23 views

What is the best method to analyze this standard example data

The MASS package in R has 'anorexia' data set that compares the results of 3 treatments on weights of patients. Which statistical method is ideal to analyze this data set? There is one control (Cont) ...
1
vote
1answer
70 views

Logistic regression: my main effects lose significance when I add my interaction effects. Why?

I have a dichotomous dependent variable for a 2x3 experiment. There are about 30 observations in each cell, for a total sample size of about 180. Each person was only in one cell. The dependent ...
1
vote
0answers
36 views

Test fixed effects for joint significance in R

Just as in this post I'm looking to test for the joint significance of the fixed effects in a model. Unlike the post I referred to, I'm looking to test each fixed effect individually. I have used a ...
0
votes
0answers
7 views

F statistics is given as dots after using clustered standard errors option

My question is the following: I am using Demographic and Health Survey of Turkey to estimate the equation below. Standard errors are clustered for 26 regions, in which individuals lived when they ...
0
votes
1answer
62 views

Masked variables in logistic regression

I have a logistic regression model with variables $V_1$ through $V_n$. When I build a full model with all of the variables, I find that $V_1$ and $V_2$ are significant. However, when I build a new ...
0
votes
0answers
9 views

experimental design - variables and tests

I would like to design an experiment and see if there is any useful information to be gained by tracking several variables. The problem is that I am unsure of how to specify the variables (their type) ...
1
vote
1answer
49 views

Statistical test for the difference in center positions of two receptive fields

I am a neuroscientist, and have neuronal response measurements for a large range of stimuli delivered to my subjects. I use this data to construct receptive fields (RFs), which show the mean response ...
0
votes
0answers
18 views

mean of clients during a specified time interval

I would like to calculate the mean number of guests in a restaurant for example, during one week. I have two cases: 1- we take measures of number of guests each 5 minutes, 2- we take measures each ...
2
votes
1answer
13 views

How to find out is the difference between two social network based on their assortativity significant?

I've got two networks and I want to prove somehow that one of them is more homophilic not by chance.
0
votes
0answers
18 views

Difficulty choosing the right type of analysis

I have to write a proposed methodology for a study investigating the cognitive effects of beetroot. I will be using 2 separate groups of participants. I will first take their resting blood pressure ...
0
votes
0answers
14 views

psychic testing control group

You have seen it on television, two men sit across a table from each other, a deck of cards between them. The man in a lab coat draws a card and looks at the card. The other man places his hand to his ...
0
votes
0answers
12 views

How do I compare a new method of statistical sampling with an established one?

Lets say that: There exist 10 countries. I travel to each country and take a random subset of the population of that country and count how many of my subset are woman. I make a table of country to ...
1
vote
0answers
30 views

Insignificant squared term but significant linear term

I am estimating the following model: $\ln(y) = \alpha + \beta_1x + \beta_2x^2 $ $\hat\beta_2$ is insignificant while $\hat\beta_1$ is significantly different from zero. However they are jointly ...