Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options not deleted user 24515

Hypothesis testing assesses whether data are inconsistent with a given hypothesis (usually a null hypothesis of no effect).

3 votes

Communicating confidence in an R forecast's correctness with non-mathematicians

An easy and intuitive approach is cross-validation. Tell the managers you built the model on a longer time frame, say, the sales data from time 2010 to 2015. Then show them the real sales of 2016 (e.g …
tomka's user avatar
  • 6,714
2 votes
0 answers
163 views

Testing equality of proportions in multinomial variable (example from current US national po...

A recent CNN/ORC national telephone poll of US citizens for presidential elections has resulted in the following propotion estimates $\hat{p}$ of votes by likely voters for Clinton (C), Trump (T), and …
tomka's user avatar
  • 6,714
2 votes
1 answer
114 views

Multiple testing problem - can these test results be caused by chance?

I conduct 30 independent significance tests on $p<.05$. I observe that in $X=3$ cases the test is rejected. Can this event be caused by chance due to a multiple testing problem? I understand that $X$ …
tomka's user avatar
  • 6,714
1 vote
Accepted

How to test whether E[X]>E[Y] controlling for Z?

In your case the "confounding" does not matter. Your within-subject / repeated measures data collection design comes in as a fortune. In your problem we define $W=X-Y$, so you are interested in testin …
tomka's user avatar
  • 6,714
0 votes
0 answers
29 views

Why does this inequality about the false discovery proportion hold? [duplicate]

I am reading an article from Statistics in Medicine ("Tutorial in biostatistics: multiple hypothesis testing in genomics"). For my question it is only relevant to know that $V$ denote the number of fa …
tomka's user avatar
  • 6,714
2 votes
Accepted

Testing a 2x2 contingency table: male/female, employed/unemployed

Some immediate responses: 1) Your lecturer means that the data show autocorrelation. This leads to inefficient estimates of regression coefficients in simple linear regression. Depending on whether i …
tomka's user avatar
  • 6,714
5 votes
Accepted

What type of data analysis should I make in case of (quasi-) experimental data?

The central question is whether you assigned students completely at random to the experimental groups. If yes you can use a standard test for independent samples to assess the significance of the gr …
tomka's user avatar
  • 6,714
1 vote
0 answers
58 views

Bayesian testing that one parameter is larger than another

In a Bayesian setting and given data $D$ I want to test the hypothesis that $$H_0: \theta_2 \le \theta_1$$ against alternative $H_1: \theta_2 > \theta_1$. Assume I can only sample from the posterior …
tomka's user avatar
  • 6,714
1 vote
0 answers
110 views

How can I evaluate multiple hypotheses simultanousely using the bootstrap?

Suppose you have two null hypothesis for two parameters, $\theta_1$ and $\theta_2$ based on the same variable $X$. So for example, $\theta_1$ is mean of $X$ in group 1, whereas $\theta_2$ is mean of $ …
tomka's user avatar
  • 6,714
2 votes

Statistical test for testing equal proportions

I think you really want to test $H_0: p=.5$, where $p$ is the proportion of people answering. An easy way to get your hands on that problem is to get the confidence interval for the proportion estimat …
tomka's user avatar
  • 6,714
4 votes
1 answer
520 views

What is the Bayesian counterpart to the McNemar test (of marginal homogeneity)?

In analogy to a similar post on continuous data, I ask the following. In paired discrete data, we test the frequentist hypothesis of equivalent marginal distributions of two discrete variables $X$ and …
tomka's user avatar
  • 6,714
2 votes
0 answers
131 views

Testing equality of two or more contingency tables

Which options are there to test, whether two contingency tables of the same variables, say $X$ and $Y$, are equal across the levels of a third discrete variable, say $Z$? I can think of a log-linear …
tomka's user avatar
  • 6,714
13 votes
2 answers
4k views

The $z$-test vs the $\chi^2$-test for comparing the odds of catching a cold in 2 groups

I just read in a rather well-respected (popular) science magazine (the German PM, 02/2013, p.36) about an interesting experiment (without a source, unfortunately). It caught my attention because intui …
tomka's user avatar
  • 6,714
6 votes
Accepted

Why is it wrong to stop an A/B test before optimal sample size is reached?

A/B tests that simply test repeatedly on the same data with a fixed type-1 error ($\alpha$) level are fundamentally flawed. There are at least two reasons why this is so. First, the repeated tests are …
tomka's user avatar
  • 6,714