Hypothesis testing assesses whether data support a given hypothesis rather than being an effect of random fluctuations or some other process described by an alternative hypothesis.

learn more… | top users | synonyms (4)

0
votes
0answers
3 views

Is two years enough for panel data analysis?

I have around 800 companies for only two years period. However, around 200 of them have only one year observation. Is it still possible to conduct panel data analysis with such data Thank you
0
votes
0answers
27 views

Cluster Matching/comparison

Description I have several datasets(from different subjects) with the same type of data. For each dataset I cluster the data using affinity propagation. Clustering is based on similarity distance ...
0
votes
0answers
43 views

A doubt on the definition of p-value

The p-value is the probability, under the assumption of the null hypothesis $H_0$, of obtaining a result equal to or more extreme than what was observed at given data. This means, if I were to ...
3
votes
1answer
32 views

How to interpret underrepresented low p-values in Multiple Testing?

This is, I hope, quite a simple question. Being new to the concepts and methods of Multiple Testing, I've been histogramming some of the p-values I've been computing in my genomics research. What I ...
0
votes
0answers
13 views

Is it correct to apply Friedman+Nemenyi tests to several runs at the same dataset?

We have 7 classification models generated from 30 subsets sampled from the same data-set (via cross-validation). We would like to know if there are significant differences among the accuracy of the 7 ...
1
vote
1answer
23 views

False alarm in Neyman-Pearson Test. A doubt in text?

Neyman-Pearson Lemma says that the most powerful test, $\phi(x)$, of size $\alpha$ (probability of false alarm), for testing $H_0:\theta=\theta_0$ versus $H_1:\theta=\theta_1$ is the likelihood ratio ...
3
votes
2answers
21 views

Directional research hypotheses vs. directional hypothesis testing

When I took a methods course, I was told to avoid making a directional hypothesis. I understand the reason. Now however, I often see hypotheses like these: "We hypothesized that reaction time will ...
1
vote
1answer
68 views

In Bayesian hypothesis testing, do the prior model probabilities have to be equal?

The posterior odds is the product of the Bayes factor and prior odds: $\frac{p(M_1|data)}{p(M_2|data)}=\frac{p(data|M_1)}{p(data|M_2)}\times\frac{p(M_1)}{p(M_2)}$. I was under the impression that ...
-3
votes
0answers
18 views

confident interval for porpulation proportion [on hold]

9 dogs and 10 cats were tested to determine if there is a difference in the average nunber of days that the animal can survive without food. The dogs averaged 11days with a standard deviation of 2days ...
1
vote
1answer
32 views

Relative increase between two pairs of samples

Consider the following samples from four distributions: $a = \{20, 2, 200\} \qquad\qquad c = \{1, 10, 100\}$ $b = \{22, 2.2, 220\} \qquad\quad\:\,d = \{1.2, 12, 120\}$ I would like to say that the ...
1
vote
0answers
22 views

Degrees of freedom of J-Test distribution

My book states that the J-test(for over-identifying restrictions) is of the following form $G_n'J_n^{-1}G_n \approx \chi^2(m-p) $, where $G_n=G_n(\theta)=1/n \cdot \sum^n_{i=1}g_i(\theta)$ which are ...
4
votes
1answer
58 views

How to statistically compare groups for multiple density plots?

Is there a statistical method to compare these density plots other than ANOVA (MANOVA)? I would like to compare the densities among year within each plot and report which of those distributions are ...
2
votes
0answers
20 views

Is there a test for comparing principal components decompositions between samples?

Is there any test for comparing the directions, magnitudes, etc of PCA results for different samples? I'm leaving the nature of the test deliberately vague because I'd like to hear all the various ...
0
votes
0answers
15 views

Flexmix to test bimodality [on hold]

How to use flexmix in r to check the modality of dataset, for example I have a vector of some 100 numbers how should I apply flexmix to test whether this data has bimodality or trimodality? Thanks.
2
votes
0answers
54 views

Surprisingly similar hypothesis tests

I would like to ask you for pairs or even triples of statistical tests which are, surprisingly, similar. By similar I mean they test essentially the same hypotheses and lead to approximately the ...
0
votes
0answers
14 views

Factorial design for interactions with ordinal DV

I want to make a 4 question, multiple choice survey in which each question asks about an analogous range of actions for slightly different scenarios. Each participant would only be administered the ...
2
votes
1answer
42 views

If my normality test is non-significant, am I safe to use the t-test?

I took a 30 unit sample from a population. The sample distribution resulted to be normal. Can I state that the population distribution is normal too? If so, with what level of confidence?
0
votes
0answers
21 views

Comparing the distribution (or properties of distributions) of large datasets for practically significant differences

I have several populations with a large n (100,000 - 1M+ samples), which i wish to compare. I know that virtually any statistical test i apply will reject the null hypothesis due to the extreme power ...
4
votes
1answer
35 views

What is the intuition for dependence assumption in Benjamini and Hochberg (1995)?

For dealing with multiple testing, Benjamini and Hochberg (1995) assume that the tests are independent. Benjamini and Yekutieli (2001) show that (1) the 1995 result also holds under (I think) weaker ...
1
vote
0answers
11 views

Multiple comparisons on nested subsets of data for a non-parametric test

My problem: I'm using data sets where some are nested in a non-parametric test that expects independent data sets. How can I correct for that in a way that is reasonable? Or even better: What would ...
2
votes
0answers
21 views

Testing if points on a line are over/under dispersed

I have a series of about 1000 points on a chromosome and I want to know if they are clumped, over-dispersed, or neither. The chromosome can be viewed as a 1-dimensional. I've looked over some ...
3
votes
1answer
42 views

Point hypothesis and equivalence hypothesis at once

Sometimes researchers (especially in collaborations) have two opposite but sound theories: There is a difference between two groups or there is only negligible difference. Now they ask their ...
0
votes
1answer
16 views

What can I do to if I have a nominal dependent variable and scale independent variables?

Our dependent variable is a nominal variable that asks respondents "would you share this video?" with the responses being either yes or no. The hypotheses we are testing are all relational directional ...
0
votes
0answers
11 views

How To Determine Association Plot in R and p-value

I have created a contingency table and an association plot in R and I am not quite sure how to interpret it. Here is my contingency table: ...
0
votes
0answers
14 views

Statistical test Comparison of

I have some ordinal data (no. of exits from opiate treatment, by type (planned unplanned exits etc.). I want to know if last years figures have a statistical probability of being different from ...
1
vote
1answer
26 views

Compare two small groups (population vs sample) over time

I am studying banks behaviour according to 6 financial rations throughout a 3-years period. I have 32 observations separated into two groups: large (6) and medium-sized banks (26). However, since in ...
1
vote
2answers
24 views

How to compare 4 independent means when there is no dependent variable?

There is one other question similar to mine (Compare independent numeric vectors (means) in R), but has not been answered (1 year has passed), so I'm repeating the question here. I have obtained exam ...
2
votes
1answer
34 views

AB testing vs testing the null hypothesis

I'm trying to understand the difference between testing the null hypothesis (i.e. testing that the probability of a "goal" is the same across 2 different populations, similar to prop.test in R) an ...
3
votes
2answers
116 views

Why am I getting inconsistent results from Wilcoxon signed rank test and Kruskal-Wallis test?

I am doing a study on 3 drugs, comparing response pre-post treatment. My objective is to know if these drugs are effective and which one is better. I used non parametric tests since the results ...
1
vote
2answers
76 views

Can Mann-Whitney test be used for post-hoc comparisons after Kruskal-Wallis?

I have a simulation where an animal is placed in a hostile environment and timed to see how long it can survive using some approach to survival. There are three approaches it can use to survive. I ran ...
2
votes
0answers
15 views

Difference test for beta–binomial variables

Let $X \sim \textrm{Beta–Binomial}(\alpha_1, \beta_1, n)$ and $Y \sim \textrm{Beta–Binomial}(\alpha_2, \beta_2, n)$ and write $\mu_1 = \frac{\alpha_1}{\alpha_1 + \beta_1}$, $\phi_1 = \alpha_1 ...
1
vote
1answer
32 views

How to Test if the Difference between Two Means from Different Samples are Significant?

here are distributions of four samples: and the following is the table of data: I would like to test: (1) if the difference between means of "Give" and "Work-Give" samples is significant; and (2) ...
0
votes
1answer
36 views

Hypothesis Testing using dichotomous and 7-point Likert scale

I am working on testing the following hypothesis: H1: People who are worried about their health will consume yogurt H0: People who are worried about their health will not consume yogurt I have ...
0
votes
1answer
55 views

How can I test if there is a correlation between a score and a likert scale?

I'm having difficulty finding out what I can do with my data set. It comes from a french reading test that have 30 multiple choice questions. For each of these questions: I have the facility value ...
1
vote
0answers
66 views

MHT: Pre-Selecting statistical tests without Bias

Summary: The last formula boxed in red (which is a modified log likelihood from logistic regression) is a special non-differentiable loss function that is adapted to contain a Bonferroni correction in ...
0
votes
1answer
29 views

Multiple hypothesis testing with FDR in R - FDRtool and p.adjust

i am very new to this field, so please bear with me. I have 600 parameters, on which i perform simple pairwise x,y correlations.For adjustment of the p-values ive been stuck between two R-packages. ...
3
votes
3answers
133 views

Should I use t-test on highly skewed and discrete data?

I have samples from a highly skewed dataset about users' participation (e.g.: number of posts), that have different sizes (but not less than 200) and I want to compare their mean. For that, I'm using ...
0
votes
1answer
21 views

Statistical tests

Can someone please explain the difference between difference test and correlation test? I am confused because e.g. if a mean of one group (males) is significantly different from the other (females), ...
1
vote
0answers
13 views

Comparing transaction counts between samples

I have a treatment group and two control groups for customers and the count of their transactions: ...
2
votes
1answer
43 views

Wald test and Type III test don't agree?

I am having trouble understanding the output here. In the green table, it seems like SAS is saying "Gender F" and "Gender M" are not significant. However, in the blue table, seems like it's saying ...
3
votes
4answers
264 views

How exactly does null hypothesis testing work

I'm trying to gain a better understanding of how null hypothesis testing works. I have 3 questions related to the code below: Am I right in saying the probability of each t value in ...
2
votes
0answers
28 views

Multiple Sample Equality-of-Distributions Test For Panel Data

Suppose I have repeated time observations for 800 meter sprint for a group of athletes over the course of a season. I would like to test the hypothesis that all the times are drawn from the same ...
0
votes
1answer
48 views

Difference of means when population mean is known?

I’ve approached a unique problem, and I want to make sure that I am going about the test that I am running in the correct way. Here’s a brief background: The goal of this project is to automate an ...
0
votes
0answers
16 views

how to test if a proportion of alleles is different between conditions?

I am in doubt about which type of test I could performed on my data. I have a data frame of the following type: contig, pos, A1, A2, Ctrl_A1, Ctrl_A2, Treat_A1, Treat_A2 comp1293557_c0_seq1, 284, ...
0
votes
1answer
27 views

Rank of a matrix in regression hypothesis test?

In going over some example problems from class notes, I came across the following problem: "Suppose we have a regression model $y=\beta_0+\beta_1x_1+\beta_2x_2+\beta_3x_4+\beta_4x_4+\epsilon$. We ...
0
votes
0answers
20 views

Interpreting the Johansen cointegration test output

I am running the Johansen cointegration test using 2 non-stationary time-series, as suggested by the literature. The output I got is the following: ...
0
votes
0answers
15 views

What is the procedure to compare two different period time series

I am currently working on the task that I would like to compare two different period time series like Sales in 2012 vs Sales in 2013. Kindly suggest me any statistical procedure.
6
votes
1answer
662 views

Should I use t-test on highly skewed data ? Scientific proof, please?

I have samples from a highly skewed (looking like an exponential distribution) dataset about users' participation (e.g.: number of posts), that have different sizes (but not less than 200) and I want ...
0
votes
2answers
39 views

Likelihood ratio test to determine if average number of accidents has dropped?

I can't find any worked (non-trivial) practical example for a likelihood ratio test, believe me I have spent hours looking. Here is a question I've been trying to complete but I can't get any further. ...
0
votes
1answer
73 views

Too many p-value less than 0.0001 is alarming?

Can anyone explain why having too many p-value less than 0.001 is alarming? Like what happens to my model right now: All independent variables are categorical except for Calendar_Year. There are ...