# Questions tagged [hypothesis-testing]

Hypothesis testing assesses whether data are inconsistent with a given hypothesis rather than being an effect of random fluctuations.

8,532 questions
Filter by
Sorted by
Tagged with
1k views

### What's the appropriate spss test?

Context I have 25 men and 25 women as participants, and they did exactly the same thing: Each of them heard an attractive dialogue and they had to choose between a photo of a woman in red and a woman ...
114 views

### Comparing fatality rates

I have case fatality rates (deaths per 100 cases) for 2 different states receiving different treatments for 17 years. What is the best statistical method to compare them? Relative risk, odds ratio, ...
168 views

### Unit testing sampling methods

I'm writing a bit of code that makes pretty heavy use of sampling (eg, MCMC, Particle Filters, etc), and I would really like to test it to make sure that it's doing what I think it is before claiming ...
885 views

### Is there a test of monotony, convexity or concavity?

I have a problem that I don't think I've met before. I have N observations of the variables v1 and v2 and I assume that there is a function f such as v2 = f(v1). I want to know if f has a particular '...
227 views

### Multiple simulations of a system under different conditions - paired data?

I am currently generating data by simulating a model of chemical system under different conditions (temperature) over time. In each simulation, the starting structure being modeled is exactly the same ...
723 views

### What test do I use / how do I show in the analysis that I measured everyone twice?

I have already asked a question on this forum about this, but as I changed my experiment a bit and I am still confused. I conducted an experiment in which 25 men and 25 women listened to an ...
226 views

### Appropriate test for testing a pair of random binomial variables

I have pairs of values from two runs (replicate) for each sample along with total count for each run. I assumed each value as random binomial. I used log-likelihood ratio test to compare each pair, ...
861 views

### Difference between Hausdorff and earth mover (EMD) distance

I have two dataset that i want to compare. each dataset contain the weight of 10 different person measured for 3 different day. I am interested in measuring the probabily that the two sample ...
1k views

### Comparing backtesting returns with real trading returns

I have 10 years of backtested simulated performance of some trading strategy (using historical prices), and N months of actual trading performance. What statistical test can I do find out if I'm on ...
172 views

### Sample size for actual vs backtested performance

I have 10 years of backtested simulated performance of some trading strategy (using historical prices), and N months of actual trading performance. I want to compare the two. How big does N have to be ...
2k views

### R code for two sample t-test in case of equal variances

In R, how can I perform a two sample t-test in the case of equal variances? My actual problem is to compare different algorithms for length measurements in machine vision. I have studied Applied ...
22k views

### How to specify the null hypothesis in hypothesis testing

What is a good rule of thumb for how to choose the question for the null hypothesis. For instance, if I want to check if the hypothesis B is true, should I use B as the null, B as the alternative ...
117 views

### How to know whether the six spatial features values (in 3-time period) significantly differ from each other? [closed]

I am currently bothered on how to statistically analyze my simple data as shown below. ...
11k views

### Testing significance of peaks in spectral density

We sometimes use spectral density plot to analyze periodicity in time series. Normally we analyze the plot by visual inspection and then try to draw a conclusion about the periodicity. But have the ...
6k views

### What is a null conjunction analysis in an fMRI study?

I'm reading an article, The commonality of neural networks for verbal and visual short-term memory (Majerus et al., J Cogn Neurosci 2010 22(11): 2570), about brain imaging in which the results are ...
5k views

### Testing the significance of differences between ratios with small samples

This is for a friend of mine. As an econometrician used to rely on large samples for inference, I find myself unsure whether the answer I have in mind is the best. Suppose we have four continuous ...
205 views

### How to test whether the majority of vertices belong to one giant component?

I have a sample of 200 independent networks and I want to test the hypothesis that majority of vertices belong to one giant component. I wonder what is the appropriate approach to do that. More ...
2k views

### Analyzing multiple choice survey questions

Consider the following survey question: Q: Choose one or more of the following 5 items: A B C D E How can one test which items are more frequently chosen for a sample with 100 individuals? Is it ...
2k views

### Help with data analysis of small datasets

I have the following dataset (triplicate values of 5 independent measurements and duplicate values of a control): ...
17k views

### Sanity check: how low can a p-value go?

I am using a ranksum test to compare the median of two samples ($n=120000$) and have found that they are significantly different with: p = 1.12E-207. Should I be ...
319 views

### Testing the importance of an item among a finite set of items

Consider the following survey question: Q: How would you classify the importance for you of the following 5 items: A B C D E Assign to each item a number in the ...
5k views

### Comparing means across two groups and over four time points when group sample sizes are very small

I have two groups (experimental, N=6, and control group, N=20). For each participant I measured a score (let say mean reaction time) 4 times. I would like to check: whether these groups differed in ...
324 views

43k views

### Can a small sample size cause type 1 error?

I've learnt that small sample size may lead to insufficient power and type 2 error. However, I have the feeling that small samples just may be generally unreliable and may lead to any kind of result ...