All Questions
Tagged with statistical-significance chi-squared-test
300 questions
0
votes
2
answers
53
views
Suitable statistical test
I have 2 groups - people that were ever active on my website and people who were never active. Activity is a metric based on some actions - both groups of people visited the website.
Each group used a ...
1
vote
1
answer
60
views
Correlation between two large binary arrays
Imagine I have two large arrays of 0's and 1's representing locations along a one-dimensional spatial domain, where:
$$
X = \text{Locations where the error is high},\\
Y = \text{Locations where data ...
- 150
0
votes
2
answers
27
views
Chi Squared Test of Association, Feature Engineering and Selection book, Chapter 2
In feat.engineering/stroke-tour by Kuhn & Johnson, there's a contingency table as below:
But I tried computing the chi-squared myself by hand and with a calculator and get 0.9818 with p-value ~0....
- 103
1
vote
2
answers
88
views
What hypothesis test should be used for two categorical variables in Likert scale?
I'll give an example.
Let's say I conducted a health survey in a hospital. I asked two questions. The first question is: 'I take medication to sleep well' and the second is: 'I feel unwell in the ...
- 11
0
votes
0
answers
18
views
Confusion about the chi-squared test to compare 3 proportions
I have run an within-subjects experiment in which each participants answers to 3 binary questions (A,B and C). This means that all participants answered every questions.
I want to compare the ...
- 113
0
votes
1
answer
50
views
Statistical test for frequency counts?
I have data of customer purchases over time. Certain clusters of purchases tend to occur together within a short timeframe for each customer. One customer can have multiple clusters of purchases. I ...
- 1
0
votes
1
answer
42
views
Gaps (misinterpreting perhaps) between chi square sig and Cramer’s v
I did chi square test for independence and Cramer’s V test.
I’m having problems with interpret the results.
I checked if there is a connection between gender and dropping out of school (in SPSS).
My ...
- 3
0
votes
1
answer
164
views
Relationship between p-value and Cramer's V
Is there a relationship between p-value and Cramer's V value after conducting Chi-square test for independence... is for Cramer's V value of about 0.13 the associated p-value is of about 0.001 or it ...
2
votes
0
answers
128
views
Post hoc after a 2xN chi-squared test
I have two groups of people, and I want to determine if there's a significant difference based on their language. My data consist of word frequencies (how many times a person sayed a given word in a ...
1
vote
0
answers
60
views
How to produce a p-value for each category in a chi-square test [closed]
Cross tables are used to produce differences between two groups in the chi-square test. For example, if we look at the differences in age groups between the two groups (such as the group A and the ...
- 11
4
votes
1
answer
107
views
Check if a coin flips randomly, but it can have a different number of sides each toss
I would like to check if a coin flips randomly, based on observational data. The catch is, the coin can have two sides, but also three, four, up to nine. The number of sides differs in each ...
- 453
0
votes
0
answers
65
views
Is Fisher's exact test good for this use?
I have a table that looks something like this:
group 1
group 2
group 3
group 4
region1
50
217
340
53
region2
32
23
36
42
:-------
:-------:
:-------:
:-------:
-------:
male
40
200
36
42
female
...
- 21
1
vote
0
answers
43
views
How to statistically validate samplers? Is Chi-Square test relevant for synthetic data?
I am developing sampling procedures for different kinds of discrete objects (rankings, sets, etc.). In most cases I know the theoretical distribution of the objects I'm sampling. My idea is thus to ...
- 11
1
vote
1
answer
77
views
Chi-Square test for independence for field failure data
I'm analyzing the product field failure data where each product can have one or more failures (Failure A, Failure B, Failure C, Failure D etc.) My goal is to understand the correlation between failure ...
- 687
0
votes
1
answer
65
views
Hypothesis test on binary preference [duplicate]
I have two product designs and I want to see if there is a significant difference between which people like which design the best. I did a survey where I showed a photo of each design and asked ...
- 101
0
votes
0
answers
21
views
Is there any statistical significance test similar to chi-square that penalizes small groups, making them less significant?
Let's imagine an NxM contingency table, where rows represent groups and the columns represent attributes, so the table describes the number of entities with given attributes belonging into given ...
- 185
2
votes
1
answer
36
views
Should I use a $\chi$-squared test or a z-test?
I have a dataset with four groups $G_i$ with $i = 1, 2 , 3 , 4$, and in each group $G_i$, a certain number $n_i$ of observations are favorable. I want to check if there are any differences between the ...
- 21
2
votes
2
answers
498
views
Is p-value correction necessary/required for this problem?
Suppose I have multiple regions of a tissue that consists of multiple subtypes of a tumor. I want to compare the significance of differences between these various tumor subtypes (i.e How they differ w....
- 101
2
votes
1
answer
131
views
Statistical test for rates that are very low with low count
I want to know if dataset suitable for test of significance, and if 'no' (which I am suspect) why exactly not as I must report it why not.
I have three apples species (Gala, Pink Lady and 'new') and ...
- 53
1
vote
0
answers
52
views
Correct statistical test to model user preferences among multiple models
My problem involves comparing the performance of machine learning models to how good each model's recommendation is.
The way I'll design the experiment is as follows:
I'll send out a form to multiple ...
1
vote
1
answer
896
views
Post Hoc for Significant Chi Square Test
I have applied Chi square test between Gender and Practice of specific norm (4 levels; Daily, Weekly, Monthly, Quarterly) to check the association.
...
- 21
0
votes
1
answer
293
views
Chi-square for proportion/percentage of M/F in two different groups
I'm attempting to figure out how to do a chi-square based on gender in two different groups.
Overall, my data has two different groups that I'm dealing with, with a column for what drug the person is ...
- 1
1
vote
0
answers
51
views
How do I determine which events occurred significantly more during a certain operating mode?
I have data of $N$ different event $E_n$ occurring at times $t_{n,i}$. So any event $E_n$ could have occurred any number of times.
Normally the system operates in operating mode A. Sometimes the ...
- 111
10
votes
4
answers
1k
views
References on how to interpret significant but dubious results (i.e. small numbers, plus borderline p-value)
I'm comparing two groups of people on a binary variable. The number of successes is really small for the two groups (which wasn't expected, due to a lack of previous quantitative research on the ...
- 103
3
votes
0
answers
50
views
Question about using the chi-square test on an astronaut dataset to determine if over 1000 hours in space and early mortality are related
I am analyzing an astronaut dataset to try and determine if a high number of hours flown in space (>1000) by an astronaut is related to premature death (which I defined as dying before the age of ...
- 171
2
votes
1
answer
248
views
Conflicting Chi Squared and Cramers V result
I'm trying to test whether ski skill level has an impact on an athlete's motivation to visit a resort. I have three skill-level categories and three motivation categories.
I have calculated my chi-...
- 23
2
votes
1
answer
1k
views
Why is the confidence interval for difference in two proportions inconsistent with the p-value for this difference in R prop.test()?
I calculated the difference in 2 proportions using the prop.test() using some exemplary data I found in internet.
...
- 91
1
vote
1
answer
97
views
How can I calculate statistical significance in a table with percentages?
I have a table with information about students in three different classes. In each class there are two groups of people - those, who had prior training and those, who did not. Now, when some time ...
- 13
0
votes
1
answer
128
views
Chi square goodness of fit test or individual test for proportion or both
I have dataset which looks like below -
Categories
Sample 1
Sample 2 ....
Sample 9
Reference Proportion
A
89
91
85
0.89
B
0
1
3
0.01
C
2
1
1
0.02
...
6
8
7
0.06
I
1
2
1
0.005
I want to test ...
- 41
0
votes
0
answers
44
views
Selecting an appropriate statistical test
I have two sets of data (>10k observations), each having a binary feature describing the activity of every customer within the groups (1=active, 0=inactive).
I've seen parametric tests being used ...
- 121
1
vote
1
answer
74
views
Testing significance for two groups with dichotomous variables
Is a 2x2 table/Chi-square test an appropriate method if I have a set of data with two dichotomous variables like so:
Location
Heavy User
Very Heavy User
Urban
10
5
Rural
20
30
or similarly
...
- 25
0
votes
0
answers
21
views
Measuring if sampling technique has statistically significant effect
Suppose I have a population where some subjects have a property $P$ and some do not. Further, I have a sampling technique which I use to extract a sample of 10,000 subjects. Of those 10,000, 20 ...
- 11
1
vote
1
answer
47
views
Hypothesis testing: formulation and rejection
Suppose I want to compare a book A with a book B to see if a particular word occurs significantly more or less often in either book. If I use the chi-square test (α = 0.05, one degree of freedom, ...
- 61
0
votes
0
answers
102
views
How to measure statistical significance in retention cohorts
The number of registered users 1 group= 5873, the number of returned in 1 day=1887. The number of registered users 1 group= 6520, the number of returned in 1 day=1794.
Is it possible to say with ...
- 1
0
votes
0
answers
23
views
A question about the right statistical test
let's say that I have a table as follows
SSE1 SSE2 SSE3 SSE4 SSE5
frequncy 125 200 259 300 200
and I want to see if there is a ...
- 367
0
votes
0
answers
150
views
Should a contingency table be "symmetric"?
Im am running a fishers exact test on some data but im unsure of how the input contingency table should be formatted.
Option 1
...
- 1
1
vote
0
answers
18
views
The right test to check whether the two tables are independent from each other [closed]
Table A
Group
Year 1
Year 2
1
0.4
0.45
2
0.3
0.33
3
0.2
0.6
4
0.1
0.12
5
0.07
0.11
6
0.03
0.06
7
0.01
0.02
Table B
Group
Year 1
Year 2
1
0.43
0.42
2
0.313
0.39
3
0.223
0.65
4
0.112
0.18
...
- 11
0
votes
1
answer
1k
views
How are the confidence interval of Cramer's V and the Chi square statistic related?
I wondered about the relationship between a confidence interval for Cramer's V (I used the rcompanion package and the command cramerV(table, ci = TRUE)) and the ...
1
vote
0
answers
189
views
Calculating Critical Value for Mixture of Two Chi-Square Distributions
Let's say I have a statistic X which is distributed as a mixture of two chi-square distributions; $$X \sim 0.5\chi^2_1 + 0.5\chi^2_2.$$
I'm wondering how I can calculate the critical value(and p-value)...
- 331
0
votes
1
answer
95
views
Chi square test negative difference
I am currently running a chi square test and my values from the hypothesised model are
65.387 on 24 df and I want to compare the results to another nested model which values are 28.535 on 8 df (28.535-...
- 31
0
votes
1
answer
260
views
Chi squared test on group counts from different sizes
I want to check screening count has changed over a time period within RACE.
I have the results for two time periods. 1st is for 2010-2013 data and another for 2014-2019 data
where scrn_count=screening ...
- 101
0
votes
0
answers
69
views
Statistical test when comparing oversampling to no oversampling on ANN
I use 70% of the dataset for training and 30% for testing. I use oversampling on the training dataset with an ANN. I use the test dataset on my ANN and look at the performance of oversampling against ...
- 11
0
votes
1
answer
483
views
References: t-test and Chi-squared test can be conducted with unequal sample sizes
I have two independent groups: sample size of group 1 is 24000, and sample size of group 2 is 246. With the drastically different sample sizes in the two group, I need to use the Student’s t-test or ...
- 31
2
votes
1
answer
816
views
Row wise significance testing? Chi squared on individual rows?
I have a table of counts with 4 columns and 25 rows. What statistical test should be used to asses significance for values within each row? In other words I want to perform significance testing on ...
0
votes
0
answers
69
views
What kind of significance tests can I apply on before/after data that involves proportions?
I am trying to determine whether there is statistical significance from two groups of data. I have the data in terms of counts and proportions or percentages.
There are two columns which show the ...
- 121
2
votes
2
answers
452
views
Can I apply a Cochran-Armitage test (chi-squared linear trend test) to compare two categories of data?
I have a problem where I am trying to determine whether there is statistical significance from two groups of data.
I have two columns which show the frequency of visits to their personal trainer based ...
- 121
0
votes
1
answer
232
views
Significance test of improvement of clustering methods compared to reference - correct idea?
Performing cluster analysis, I have a reference for the results and the results of two methods A and B. I am able to calculate fitness metrics (like adjusted mutual information) between the reference ...
- 564
1
vote
0
answers
41
views
How to perform significance test between two contingency tables? [duplicate]
Performing cluster analysis, I have a reference for the results and the results of two methods A and B. I am able to calculate fitness metrics (like adjusted mutual information) between the reference ...
- 564
3
votes
1
answer
388
views
How to evaluate AB test for determining price elasticity?
Given a standard AB test setup on an e-commerce platform with users randomly seeing same product priced either with control price or a variant, how does one correctly assess the results?
Say, after a ...
- 31
1
vote
0
answers
99
views
Test to determine if difference in revenue percentage is significant between days of week
I work with data for a mobile app and the analytics system records the dollar sum of user purchases made on each day. My task is to determine whether there is any statistically significant difference ...
- 11