# Questions tagged [hypothesis-testing]

Hypothesis testing assesses whether data are inconsistent with a given hypothesis rather than being an effect of random fluctuations.

8,532 questions
Filter by
Sorted by
Tagged with
4answers
1k views

### What's the appropriate spss test?

Context I have 25 men and 25 women as participants, and they did exactly the same thing: Each of them heard an attractive dialogue and they had to choose between a photo of a woman in red and a woman ...
0answers
114 views

### Comparing fatality rates

I have case fatality rates (deaths per 100 cases) for 2 different states receiving different treatments for 17 years. What is the best statistical method to compare them? Relative risk, odds ratio, ...
1answer
168 views

### Unit testing sampling methods

I'm writing a bit of code that makes pretty heavy use of sampling (eg, MCMC, Particle Filters, etc), and I would really like to test it to make sure that it's doing what I think it is before claiming ...
1answer
885 views

### Is there a test of monotony, convexity or concavity?

I have a problem that I don't think I've met before. I have N observations of the variables v1 and v2 and I assume that there is a function f such as v2 = f(v1). I want to know if f has a particular '...
1answer
227 views

### Multiple simulations of a system under different conditions - paired data?

I am currently generating data by simulating a model of chemical system under different conditions (temperature) over time. In each simulation, the starting structure being modeled is exactly the same ...
2answers
723 views

### What test do I use / how do I show in the analysis that I measured everyone twice?

I have already asked a question on this forum about this, but as I changed my experiment a bit and I am still confused. I conducted an experiment in which 25 men and 25 women listened to an ...
1answer
226 views

### Appropriate test for testing a pair of random binomial variables

I have pairs of values from two runs (replicate) for each sample along with total count for each run. I assumed each value as random binomial. I used log-likelihood ratio test to compare each pair, ...
2answers
861 views

### Difference between Hausdorff and earth mover (EMD) distance

I have two dataset that i want to compare. each dataset contain the weight of 10 different person measured for 3 different day. I am interested in measuring the probabily that the two sample ...
1answer
1k views

### Comparing backtesting returns with real trading returns

I have 10 years of backtested simulated performance of some trading strategy (using historical prices), and N months of actual trading performance. What statistical test can I do find out if I'm on ...
1answer
172 views

### Sample size for actual vs backtested performance

I have 10 years of backtested simulated performance of some trading strategy (using historical prices), and N months of actual trading performance. I want to compare the two. How big does N have to be ...
1answer
2k views

### R code for two sample t-test in case of equal variances

In R, how can I perform a two sample t-test in the case of equal variances? My actual problem is to compare different algorithms for length measurements in machine vision. I have studied Applied ...
4answers
22k views

### How to specify the null hypothesis in hypothesis testing

What is a good rule of thumb for how to choose the question for the null hypothesis. For instance, if I want to check if the hypothesis B is true, should I use B as the null, B as the alternative ...
0answers
117 views

### How to know whether the six spatial features values (in 3-time period) significantly differ from each other? [closed]

I am currently bothered on how to statistically analyze my simple data as shown below. ...
4answers
11k views

### Testing significance of peaks in spectral density

We sometimes use spectral density plot to analyze periodicity in time series. Normally we analyze the plot by visual inspection and then try to draw a conclusion about the periodicity. But have the ...
1answer
6k views

### What is a null conjunction analysis in an fMRI study?

I'm reading an article, The commonality of neural networks for verbal and visual short-term memory (Majerus et al., J Cogn Neurosci 2010 22(11): 2570), about brain imaging in which the results are ...
2answers
5k views

### Testing the significance of differences between ratios with small samples

This is for a friend of mine. As an econometrician used to rely on large samples for inference, I find myself unsure whether the answer I have in mind is the best. Suppose we have four continuous ...
1answer
205 views

### How to test whether the majority of vertices belong to one giant component?

I have a sample of 200 independent networks and I want to test the hypothesis that majority of vertices belong to one giant component. I wonder what is the appropriate approach to do that. More ...
2answers
2k views

### Analyzing multiple choice survey questions

Consider the following survey question: Q: Choose one or more of the following 5 items: A B C D E How can one test which items are more frequently chosen for a sample with 100 individuals? Is it ...
3answers
2k views

### Help with data analysis of small datasets

I have the following dataset (triplicate values of 5 independent measurements and duplicate values of a control): ...
3answers
17k views

### Sanity check: how low can a p-value go?

I am using a ranksum test to compare the median of two samples ($n=120000$) and have found that they are significantly different with: p = 1.12E-207. Should I be ...
1answer
319 views

### Testing the importance of an item among a finite set of items

Consider the following survey question: Q: How would you classify the importance for you of the following 5 items: A B C D E Assign to each item a number in the ...
1answer
5k views

### Comparing means across two groups and over four time points when group sample sizes are very small

I have two groups (experimental, N=6, and control group, N=20). For each participant I measured a score (let say mean reaction time) 4 times. I would like to check: whether these groups differed in ...
3answers
324 views

2answers
43k views

### Can a small sample size cause type 1 error?

I've learnt that small sample size may lead to insufficient power and type 2 error. However, I have the feeling that small samples just may be generally unreliable and may lead to any kind of result ...
1answer
2k views

### Geometric mean and standard deviation

standard deviation (std) can be used when arithmetic mean is the right statistic. What is the equivalent of std when geometric mean is the right statistic?
5answers
28k views

### Can chi square be used to compare proportions?

I've read that the chi square test is useful to see if a sample is significantly different from a set of expected values. For example, here is a table of results of a survey regarding people's ...