The z-test is a statistical test for hypothesis testing that uses the standard normal distribution as the sampling distribution of the test statistic. A common example is the test for the difference of two proportions.

learn more… | top users | synonyms

1
vote
2answers
63 views

Contradiction between confidence intervals and Z-test

I've got the problem with Z-test and confidence intervals. Z-test rejects null hypothesis (proportions are equal), but confidence intervals are intersect. Let us consider 2 companies. The proportion ...
0
votes
0answers
34 views

Can I do a z-test if population standard deviation is unknown?

Edited: Suppose I'm trying to compare a sample of 45 articles drawn from a population of 5,000 to see if there's a significant difference between the sample and population means. The population ...
0
votes
0answers
15 views

Chi square test vs z test

I have got results for a survey and was wondering which test I should use to show there is a significant difference in my results. It is a survey on apple charger breakages and other phone charger ...
5
votes
3answers
236 views

Difference in hypothesis testing using p-value and confidence interval

I have a simple problem The sample population is 384 people and $12$% of it have a disease. The hypothesis is that $5$% of the real population have a disease. So, $H_0: \mu = 0.05$ and $H_a: \mu ...
4
votes
2answers
131 views

What happens if I use Z-test instead of T test?

I know that when sample size goes large, they basically give the same result. My question is that what happens if I use z-test instead of t-test when sample size is not large. I guess the type I ...
0
votes
0answers
12 views

Z-test or t-test: Which is more appropriate for this situation? [duplicate]

We are monitoring the performance of a network using several KPI's. We want to detect if there are any anomalies for a KPI X within last hour for which we obtained (usually) 30 values from the last ...
2
votes
1answer
42 views

Finding if the coefficients are significantly different from each other

I have a dataset which is segmented into two independent groups. I used multinomial logistic regression to estimate the coefficients corresponding to explanatory variables in both the groups. The ...
2
votes
1answer
31 views

How to test if proportions are the same across categories?

I am working with collision data and want to run a few tests. I thought a chi-square was what I wanted, but it doesn't let me say what I want to. Then I thought a z-test of two proportions was what I ...
2
votes
2answers
57 views

How to test a sample proportion against a known population value?

Say someone makes the argument "people who wear blue shoes steal more bananas." Then as proof they say, "the total population of blue shoe wearers is 30% of the population. Out of a random sample of ...
0
votes
0answers
9 views

A/B testing on Revenue: what test to use

For testing on ecommerce websites: If you do an A/B test and not only look at conversions, but also want to track if there is a significant increase in average order value and/or total revenue: what ...
10
votes
1answer
181 views

At What Level is a $\chi^2$ test Mathematically Identical to a $z$-test of Proportions?

BACKGROUND: Skip safely - it's here for reference, and to legitimize the question. The opening of this paper reads: "Karl Pearson’s famous chi-square contingency test is derived from another ...
0
votes
2answers
23 views

What do the remaining columns (after column 2) in a Z table mean

In the Z table , I can understand the first 2 columns. The first column is the Z value, the second column is Prob(X<=Z). But what do the remaining columns mean?
0
votes
1answer
90 views

Calculating p-value from beta and se_beta

I have a set of beta and se_beta values that I would like to calculate p-values for. I know this should be possible via a z-test, but I don't understand how it works and how to implement it. Any help ...
0
votes
0answers
22 views

Proportion z test for predictive model

I have deployed two models, the baseline one which only includes historical data of a stock market index and the twitter model which includes both historical data of the index as well as significant ...
3
votes
1answer
44 views

Testing the Validity of a Test Statistic (incorrectly)

In this post @Wolfgang shares a few lines of code to test in a simulation the ability of a particular test statistic to perform as expected, measured by the percentage of type I errors. He shows by ...
0
votes
0answers
66 views

Z-test and confidence intervals for mutual information

Given two discrete random variables $X,Y$, I would like to obtain confidence intervals for the Mutual Information $I(X;Y)$ and a p-value for the null-hypothesis that $X,Y$ are independent. I would ...
0
votes
0answers
36 views

2-Proportion Z-Test

I want to compare, with 2-proportion Z-Test, the number of student visits to school nurse office in Q1 of 2015 to Q2 of 2015. What do I use for sample size for Q1 and Q2 when it’s different each ...
3
votes
1answer
36 views

Why does changing the null hypothesis change the confidence interval?

Using my stat calculator, I don't see why if I do two different tests with everything the same but the null hypothesis, the confidence interval is different. For example: Has a different CI from ...
4
votes
3answers
335 views

What follows if we fail to reject the null hypothesis?

What conclusions can we draw if $p>\alpha$? Does not rejecting the $H_0$ mean anything?
1
vote
2answers
49 views

Z-test and sampling distribution

The basic trick behind the z-test is the "sampling distribution". The "sampling distribution" is the distribution of all means of all samples. So what we are interested is: if the population means ...
0
votes
0answers
8 views

One variable multiple treatments

I'm drawing a blank on how to analyze this data. I've got one drug/treatment type (variable) with multiple answer options (4 to be exact) and I'd like to compare the answer options for significance. ...
3
votes
1answer
187 views

Statistical comparison between binomial distributions, two groups and many trials

I have a data set with two groups. I have multiple trials with different Ns in each trial, and different numbers of trials for each group. In each trial, for each ...
2
votes
1answer
79 views

Test of proportions or chi-squared? [duplicate]

These data are from an A/B test of free trials to conversion. Someone can sign up for a 30 day free trial of the product. If they like it they stay on and become paying customers. By default (A), ...
2
votes
0answers
80 views

How would I determine statistical significance for ad impressions?

I'm programatically adding keywords to bid on. Some keywords will trigger ads and impressions, and some impressions will trigger clicks. Clicks / impressions = CTR (click-through-rate). Clicks cost. ...
0
votes
1answer
29 views

Test of single proportion - how do i know population proprotion?

I have a study where I did a sample size calculation using N=2800, CI=95%, margin or error = 3.5% to yield n=613. In the study (auditing of charts), I wanted to look at the error rate in my sample. I ...
3
votes
1answer
125 views

Wald Test and Z Test

The "z" hypothesis test is derived from the fact the mean estimator $\hat\Theta$ is distributed normally. If we don't know the variance, we just estimate it ($\widehat{se}$). The Wald test, derived ...
1
vote
1answer
19 views

Proportion test with null hypothesis p1=x*p2

I'd like to compare the proportion of two sets of binomial data where the null hypothesis is not p1=p2, or p1-p2=x, but \begin{equation} H0: p1=x*p2 \end{equation} I've been computing a z test as ...
0
votes
1answer
64 views

Comparing Means: Multiple Dependent Variables

I am using school-level data to compare mean scores for two groups (Group A schools and Group B schools), as measured by a series of indicators: 1) grade-level exam percentile, 2) percent of male ...
1
vote
1answer
77 views

Sample size estimation for test for proportions

I'm interested in finding out if a particular activity increases the chance of a particular segment of prospects converting to a client. I would like to be able to detect a 5% difference in overall ...
2
votes
0answers
29 views

How to compare two PROPORTIONS if you don't have 'n'?

Have data in this format: | A | A' | B | B' | |-----|-----|-----|-----| | 0.4 | 0.2 | 0.4 | 0.3 | | 0.3 | 0.3 | 0.3 | 0.5 | | 0.1 | 0.2 | 0.6 | 0.2 | Note ...
2
votes
1answer
98 views

Exploring a two-way interaction in multi-level regression, why do I get significant contrasts when the confidence intervals overlap on the graph?

I'm exploring a significant two-way interaction in a multi-level random-effects regression. The graph (below) appears to show the interaction is driven by differences at low X, and that at high X the ...
0
votes
0answers
52 views

Comparing differences of ratios in 2 independent populations

I have a setting that I think is quite similar to the one described in What type of statistic should I use to compare ratios in my experiment?. I have two independent populations, which were screened ...
0
votes
1answer
37 views

Z-test with a lot of null values

I have a question concerning the validity of my email tests. I'm testing different email variations (between 2 and 4 variations usually) with different groups of members (hundreds of thousands ...
1
vote
1answer
49 views

Strange two sample z test result in experiment

I performed an experiment on a virtual population wanting to see whether Vitamin C can positively affect performance on an IQ test. I gathered 80 people and grouped them into two groups of 40. ...
1
vote
0answers
284 views

Deriving the power formula of the one-sample proportion test

I have to derive the power of the z-test in testing $$ H_0: \pi=\pi_0 \text{ versus } H_1: \pi>\pi_0 $$ Denoting by $p$ the sample proportion, the power equals $$ ...
2
votes
0answers
27 views

Is there a t-test equivalent to Stouffer's z-test?

I have $k$ pairs of samples from different distributions. For each pair of samples I want to check if the samples are taken from a normal distribution with the same mean and variance. I assume the ...
1
vote
3answers
139 views

“The test statistic is reported as a z…”

I was reading a neuroimaging paper in which the authors compare the effect of a chemical compound on a measure of brain connectivity. They measure the value of connectivity for each brain voxel under ...
0
votes
0answers
67 views

1 sample z test of proportions

We are trying to work out whether what we currently do is accurate. We want to work out if a proportion (% scoring 5 on a 5 point scale) are significantly below a target score. Normally a 1-sample ...
1
vote
1answer
81 views

Significance of continuous variables

I have a table with several numerical continuous measurements and an indicator column catastrophy ...
3
votes
1answer
46 views

Statistics on tastings

Some people at my workplace have had some fun lunch discussion as of late, concerning some people's alleged ability to taste the difference between things one thought one shouldn't be able to taste a ...
3
votes
1answer
302 views

Why is independence required for two- sample proportions z test?

I read in several books as well as in different posts (e.g. here) that independence is required for two-sample proportions z tests. But so far I could not find an explanation why this is the case and ...
1
vote
0answers
109 views

Two-proportion z test: is it best for my problem, and can I pool data from multiple “replicate” populations?

I am examining populations (cultures) of yeast cells and scoring them for a particular trait. The data is categorical; within a population, a yeast cell either has the trait or it does not. I wish ...
2
votes
1answer
227 views

Hypothesis testing for 2 proportions - for A/B testing

I was trying to understand the statistical tests to use during A/B testing and stumbled upon this documentation of the Amazon A/B testing SDK: ...
0
votes
1answer
177 views

Why is P value interpreted under null hypothesis? [duplicate]

P value is explained very nicely in the link . But still i have not understood Why is P value interpreted under null hypothesis?
2
votes
1answer
92 views

Which statistical test should I use to compare two samples?

I have two groups and must conduct hypothesis testing by using an appropriate stats test. Seeing as I have 26 participants in each group, do not have the standard deviation (or any other information ...
0
votes
1answer
37 views

What type of test should be used?

What kind of test would I use to find the answer to this? Is there evidence that cereals promoted in an in-store circular have a higher average number of units sold per store than cereals not ...
2
votes
3answers
54 views

Hypothesis testing - speeds before and after

I have the following data: ...
2
votes
2answers
2k views

two samples z test in Python [closed]

Does Scipy have a z test to compare the mean of two samples? I searched this page but couldn't find one.
0
votes
0answers
156 views

two samples, hypothesis test of proportions t or z test

I have two samples of documents where one sample contains documents of a certain category and another sample contains documents of another category. I am analysing the occurrence of a certain word in ...
0
votes
0answers
64 views

Hypothesis testing with multiple variables

I'm trying to understand the process behind testing both A/B site changes for statistically significant increases in conversion rate, and also how then to expand this to testing multiple variables. ...