methods for comparison when the measurements to be compared are used each on the same subjects, so for each subject we get a pair of measurements.

learn more… | top users | synonyms

0
votes
1answer
17 views

nested paired tests

I have a design with patients treated with a certain drug.We have patient data before and after taking drug.Within in these patients there is are two types of people , responders and non responders in ...
1
vote
0answers
24 views

Overlapping or sliding interval matching

So I want to conduct a matched case-control study. One of the variables I want to match on is continuous variable, lets say age. I have converted this to categorical variable [17-19],[20-36],[37+]. ...
2
votes
1answer
43 views

How to properly plot paired data when you have more than two groups

I have a question which seems to be very elemental but I have found lot of disagreement about it. I have a situation where we took several measurements of the same individuals. I was suggested to ...
2
votes
1answer
26 views

Dependent or Independent samples? I cant decide! Help

I'm confused i have assignment where i have to determine if the samples are dependent or independent. The sample is of 100 people, where their reaction times from their dominate and non-dominate hands ...
4
votes
1answer
68 views

Difference or proportional

A report was claiming that older individuals were not appreciated at technology firms. They studied a dozen factory locations of a tech firm where employees could (anonymously) suggest process ...
0
votes
1answer
23 views

Poisson distribution with glmer - pairwise comparisons

I am analyzing counting data from a field experiment using the glmer procedure according to a Poisson distribution. The model works and I can visualize the results ...
3
votes
1answer
155 views

Difference in Means vs. Mean Difference

When studying two independent samples means, we are told we are looking at the "difference of two means". This means we take the mean from population 1 ($\bar y_1$) and subtract from it the mean from ...
0
votes
0answers
38 views

convert 20 category problem into a set of pairwise classifcations

i am struggling to convert a 20 category problem into a set of pairwise classifications. I have separated the categories into 4 classes and calculated the size of the set to be 60. Total = (k-1) x n ...
1
vote
2answers
33 views

How to show that the condition of one hand predicts the condition of the other hand

I have this kind of data: subject hand condition s01 left 1 s01 right 0 s02 left 2 s02 right 2 .. .. .. ...
1
vote
0answers
33 views

Find meaningful next comparison for total ranking on the fly

I want to obtain a total ranking from pairwise binary comparisons. For this, I can use algorithms like Balanced Rank Estimation or Bradley-Terry Model. However, I wonder if you need fewer comparisons, ...
0
votes
1answer
8 views

How to get common language effect size (CLES) with paired groups

Common language effect size (CLES : https://en.wikipedia.org/wiki/Effect_size#Common_language_effect_size) is calculated as proportion of all possible pairs of 2 group values which are more for one ...
0
votes
0answers
22 views

Confounding factor in cross-validation

I have been exploring a dataset using support vector machines. I am solving a binary classification problem and using stratified K-fold cross-validation for performance estimation (the SVM ...
2
votes
1answer
24 views

Missing data paired samples t-test

I have a list of insurance policies that filed claims in pre/post periods. I am trying to test whether the average cost of insurance claims per policy varied. Some of my policies don't have any claims ...
0
votes
0answers
32 views

EMMEANS Pairwise Comparison OR Post Hoc Multiple Comparison?

I was running a 2-way Univariate ANOVA, and there are two tables in the results that compair the 3 levels of one of my IVs (Transformation_Model). Under Estimated Marginal Means, the table is titled ...
0
votes
0answers
12 views

How do I compare a new method of statistical sampling with an established one?

Lets say that: There exist 10 countries. I travel to each country and take a random subset of the population of that country and count how many of my subset are woman. I make a table of country to ...
1
vote
0answers
21 views

Repeated Measures ANOVA?

I am an undergraduate student studying psychology using SPSS to analyse my data. I have 2 conditions of the IV of treatment (treatment or no treatment) to test pain tolerance levels which is measured ...
2
votes
2answers
31 views

Is it acceptable to use a paired t-test to compare my drug dosage data?

I have a table of patient demographics like height, weight, and some lab values, as well as data on the doses of a drug that the patients received. Using the patient demographic data, I also used a ...
0
votes
0answers
34 views

Second Opinion(s) Requested: Doing 6 A/B Tests on a website with confidence levels around .8-92 is a bad idea, right?

A consultant recently used 6 A/B tests to compare the effects of various modifications to a website. The website is designed to prompt visitors to respond with an action. As a "control" for each test, ...
3
votes
1answer
28 views
0
votes
0answers
33 views

Comparing paired data in two different treatment groups

Suppose I have two groups of participants. The first groups gets treatment 1 and the second group gets treatment 2. The first treatment is a standard treatment and the second treatment is something ...
4
votes
1answer
85 views

Computing Paired Samples (pre/post) Effect Size with Limited Information

I'm conducting a meta-analysis using the Hedge's g effect size statistic. Many of the studies are only reporting: pre-treatment mean score pre-treatment standard deviation post-treatment mean score ...
0
votes
0answers
6 views

Analysing matched pre post surveys that have definite answers

I have pre - post matched survey data that contains True/False responses and Multiple Choice responses. These questions have definitive answers, it is not a Likert scale. How can I compare the ...
2
votes
1answer
80 views

How can a paired test less powerful than unpaired test?

I'm using wilcox.test to compare two timepoints as such: a <- c(1,2,3,4,5) b <- c(2,3,4,5,6) wilcox.test(a, b) The ...
1
vote
0answers
18 views

How does a discordance test work?

Could someone explain how the discordance test works (and what it actually is)? The explanations I found online are unclear: [...] the concordance test can be viewed as the evaluation of the ...
0
votes
0answers
31 views

Consistent weight.matrix from the GenMatch (Matching package) in R

So I want to use the GenMatch function to generate optimal weight coefficients, to later use in the Match() function. But when I run the command twice, I do not get the same Matrix values. For ...
2
votes
3answers
81 views

How to measure the “confidence” that one set of values is greater than another?

I have a relatively simple task. I have collected several hundred samples from several groups (group here is arbitrary and not relevant to my question). These samples are scored on a continuous ...
0
votes
1answer
16 views

How should I present paired sample test results? [closed]

I conducted a paired sample t-test on pre and post questionnaire results. What should I be reporting?
2
votes
1answer
31 views

Regression Model for Binary Matched or Paired Contingency Table Results

This is a follow-up question on a prior thread about the same setup as follows: We have two "Methods" ("A" and "B") to diagnose a medical condition. We are not trying to determine which one is better ...
0
votes
0answers
18 views

pair-wise comparison for two sets of data where each point contains multiple values

I have two sets of data of the same subjects with 8 time points in each set.The second set is a repeated measure of the same 5 subjects. There are 5 subjects polled per time point. Is it correct to do ...
2
votes
1answer
33 views

Paired permuted t-tests?

I have a small dataset which are not normally distributed. I would like to perform a pairwise analysis of the differences in values between two groups. It has been suggested that I use permuted ...
3
votes
2answers
116 views

Mann-Whitney U test and paired data

I've read that working with paired data requires other method than Mann-Whitney $U$ test. I am not sure about how formally accurate is this statement. Reasons: Suppose that there is a set of $n$ ...
3
votes
0answers
38 views

Does conditional logistic regression effectively “throw away” concordant pairs like McNemar's test?

We are interested in analyzing pre-post data from a randomized control trial. The outcome is binary and I am trying to explain the heuristics of the model formulation for conditional logistic ...
0
votes
0answers
38 views

How to determine correct statistical test for repeated measures, differing treatments in same subject experiment

Our hypothesis is that treatment 1 changes our outcome measure by some amount, and that treatment 1 combined with treatment 2 changes our outcome measure by a larger amount. For each subject, the ...
1
vote
0answers
35 views

Which significance test can be used in this instance? - paired, non-normal means

I have a data set of behaviours for a herd of captive elephants which I have attempted to quantify to compare for statistical significance, i.e., if a behaviour is performed once during an observation ...
0
votes
0answers
27 views

Calculating unreported confidence intervals of ratios of paired means without raw data

I am brand new to this site and need some help in analysing some data in a systematic review I'm working on. I want to calculate the 95% confidence interval for the ratio of two means estimated from ...
2
votes
1answer
89 views

Permutation test: when the null hypothesis is **non**-equivalence of two models/predictors [closed]

Suppose I have two models $M_1$ and $M_2$ and I want to compare their performances in terms of measure (accuracy on classification instances, i.e. number of correct predictions to size of all ...
0
votes
0answers
22 views

Perceptual Agreement Statistics - Test for similarity between pairs?

I'm struggling to identify if there is a suitable and established test for determining if pairs formed from two separate populations are statistically similar when multiple people attempt to match ...
0
votes
0answers
37 views

Comparison of Non-Stationary Time Series Trends

I am trying to compare two readings of the same occurrences from two different sources, forming two time series. I would like to assign a metric to their similarity/dissimilarity, but the method I am ...
1
vote
1answer
33 views

Compare cumulative distribution functions of several function point counters

Function point counters are used to measure the size of software. However, they are believed not to deliver exact results. Different measurements sometimes produce different results. The performance ...
1
vote
1answer
29 views

Measure linear relationships between various variables

Different evaluation techniques were used to assess student’s programming ability in an introductory course (e.g. tests, practical exercises, final exam). Which statistical methods could be used to ...
0
votes
0answers
18 views

Chi square test and comparisons within this

I'm running chi square on a set of data that consists of frequency, question type, and participant group. I have an overall significant statistic but want to get p values for each question type across ...
1
vote
1answer
79 views

paired t-tests and interpretation of results

My study is about comparing the scores a group of students (sample, N=14) in two different conditions. They play the same game in a tablet and using a computer. They were administered with a ...
0
votes
1answer
47 views

Obtain adjusted means - Weight? Standardize? Use LSmeans?

I'm attempting to compare means from one year to another (and between groups at the same time point) by calculating adjusted values. I'm not sure what method to use. I've thought about the following: ...
0
votes
2answers
130 views

TukeyHSD multiple comparison on binomial data using Multcomp package in R

My question is how to perform TukeyHSD multiple comparison on ratio(for example, conversion rate, graduate school admit rate) using multcomp package in R. Take UCLA admission data for example: ...
1
vote
0answers
13 views

Compare non-gaussian distributions and evaluate sampling process

I have a 150,000 datapoints (continuous values between 0 and 1) and I am running a process that averages groups of smaller samples based on some other data values and results in ~100,000 datapoints. ...
4
votes
4answers
230 views

Paired t-test when each data point was repeatedly measured different number of times?

I have an existing data set that comes from the same group of people before and after they received a treatment. The data set comes from when participants tested their blood sugar values over a 30 ...
0
votes
0answers
31 views

When to plot different slopes for different treatments in ANCOVA

I am running an ANCOVA with a treatment of 3 levels and a continuous co-variate. Using step() in r, the simplest model includes the treatment factor and the co-variate, but not their interaction. To ...
1
vote
1answer
45 views

Is this a right way to use paired t-test

Problem Description I want to enhance a photo and I have 3 software to do that, out of which 2 are my own. I show users 2 photos and ask them to choose a better one. Now, I compare software 1 vs. 2, ...
0
votes
0answers
48 views

Logistic regression for paired comparisons

I am not a statistician; I'm an engineer, so much of this is a foreign language to me, though it seems like it wouldn't be that hard to understand if explained in a different way. I am trying to ...
0
votes
1answer
36 views

FWER correction for paired t-test

I have a continuous variable, and a small sample of 8 observations at 4 different time points (before some intervention, and at 3 follow-up time points). My sample, being a preliminary experiment, ...