The tag has no wiki summary.

learn more… | top users | synonyms

1
vote
0answers
23 views

Which significance test can be used in this instance? - paired, non-normal means

I have a data set of behaviours for a herd of captive elephants which I have attempted to quantify to compare for statistical significance, i.e., if a behaviour is performed once during an observation ...
0
votes
0answers
5 views

Calculating unreported confidence intervals of ratios of paired means without raw data

I am brand new to this site and need some help in analysing some data in a systematic review I'm working on. I want to calculate the 95% confidence interval for the ratio of two means estimated from ...
2
votes
1answer
59 views

Permutation test: when the null hypothesis is **non**-equivalence of two models/predictors [on hold]

Suppose I have two models $M_1$ and $M_2$ and I want to compare their performances in terms of measure (accuracy on classification instances, i.e. number of correct predictions to size of all ...
0
votes
0answers
16 views

Perceptual Agreement Statistics - Test for similarity between pairs?

I'm struggling to identify if there is a suitable and established test for determining if pairs formed from two separate populations are statistically similar when multiple people attempt to match ...
0
votes
0answers
21 views

Comparison of Non-Stationary Time Series Trends

I am trying to compare two readings of the same occurrences from two different sources, forming two time series. I would like to assign a metric to their similarity/dissimilarity, but the method I am ...
1
vote
1answer
23 views

Compare cumulative distribution functions of several function point counters

Function point counters are used to measure the size of software. However, they are believed not to deliver exact results. Different measurements sometimes produce different results. The performance ...
1
vote
1answer
27 views

Measure linear relationships between various variables

Different evaluation techniques were used to assess student’s programming ability in an introductory course (e.g. tests, practical exercises, final exam). Which statistical methods could be used to ...
0
votes
0answers
12 views

Chi square test and comparisons within this

I'm running chi square on a set of data that consists of frequency, question type, and participant group. I have an overall significant statistic but want to get p values for each question type across ...
1
vote
1answer
37 views

paired t-tests and interpretation of results

My study is about comparing the scores a group of students (sample, N=14) in two different conditions. They play the same game in a tablet and using a computer. They were administered with a ...
0
votes
1answer
34 views

Obtain adjusted means - Weight? Standardize? Use LSmeans?

I'm attempting to compare means from one year to another (and between groups at the same time point) by calculating adjusted values. I'm not sure what method to use. I've thought about the following: ...
0
votes
2answers
45 views

TukeyHSD multiple comparison on binomial data using Multcomp package in R

My question is how to perform TukeyHSD multiple comparison on ratio(for example, conversion rate, graduate school admit rate) using multcomp package in R. Take UCLA admission data for example: ...
1
vote
0answers
8 views

Compare non-gaussian distributions and evaluate sampling process

I have a 150,000 datapoints (continuous values between 0 and 1) and I am running a process that averages groups of smaller samples based on some other data values and results in ~100,000 datapoints. ...
4
votes
4answers
126 views

Paired t-test when each data point was repeatedly measured different number of times?

I have an existing data set that comes from the same group of people before and after they received a treatment. The data set comes from when participants tested their blood sugar values over a 30 ...
0
votes
0answers
17 views

When to plot different slopes for different treatments in ANCOVA

I am running an ANCOVA with a treatment of 3 levels and a continuous co-variate. Using step() in r, the simplest model includes the treatment factor and the co-variate, but not their interaction. To ...
1
vote
1answer
35 views

Is this a right way to use paired t-test

Problem Description I want to enhance a photo and I have 3 software to do that, out of which 2 are my own. I show users 2 photos and ask them to choose a better one. Now, I compare software 1 vs. 2, ...
0
votes
0answers
33 views

Logistic regression for paired comparisons

I am not a statistician; I'm an engineer, so much of this is a foreign language to me, though it seems like it wouldn't be that hard to understand if explained in a different way. I am trying to ...
0
votes
1answer
25 views

FWER correction for paired t-test

I have a continuous variable, and a small sample of 8 observations at 4 different time points (before some intervention, and at 3 follow-up time points). My sample, being a preliminary experiment, ...
2
votes
0answers
39 views

Am I using Paired Statistical Test Correctly?

I am comparing a feature between correct & incorrect trials. There are N=1194 paired samples $\{x_i,y_i| i=1,2,...N\}$, where x is for correct trials and y is incorrect trials. I am using a ...
0
votes
0answers
11 views

Comparing Learning Rates using Unit Curve in R

I have data for an experiment where 2 groups (Role) were tested over 3 consecutive trials for a task and time to complete task was recorded in sec. I wanted to compare the learning curves of the two ...
0
votes
1answer
17 views

Correction of mutliple paired samples t-test

In one group of subjects I have four parameters (for e.g. A, B, C, D) measured in two conditions. I want to know whether these 4 parameters differ between the conditions by doing paired samples ...
1
vote
1answer
49 views

Permutation on multiple Pairwise Comparison with least square means in R 3.1.2

I'm working on a study where I employed an analysis of covariance (Ancova) with unbalanced factors. I used permutation tests to obtain p-values for my estimates since my observation does not come from ...
0
votes
0answers
17 views

t-test for control and test group pre and post where pre and post subjects differ

I have been asked to help in analysing an educational intervention that has been completed, with a control and test group, pre and post tests to evaluate the effect of an intervention. It seems the ...
3
votes
0answers
33 views

Paired test using GLM with Gamma distribution

I know, that a paired T-test can be formulated in the framework of a linear model for gaussian distributions. I have two vectors of paired mesurements (rates under certain conditions) that follow a ...
2
votes
1answer
28 views

Paired difference test for nonhomogenous variances

Concrete scenario: A random sample of adults in Idaho rate each of 'kombucha', 'apple juice' and 'grape juice' on a scale from 0 to 1. Does the population of Idaho assign significantly different mean ...
1
vote
0answers
27 views

Significant difference within line set and between two sets of lines

For my research a person has walked on a treadmill which contains two pressure plates: One below the left foot, one below the right. I would like to compare the force in the z (downwards) direction ...
0
votes
1answer
23 views

Pretest-Posttest comparison

I am having a hard time doing this on Stata. I have a group of 32 students. All perform a pretest and are scored. Next, half of them are randomized to receiving an intervention and the other half ...
4
votes
1answer
48 views

When does an unpaired test result in higher p-value than a paired test?

I determined some parameter in a group of subjects under two conditions, such that each subject was tested in both conditions. I want to know if the condition has an effect on the parameter. My design ...
0
votes
0answers
19 views

When compare a variable in different times, one has normal distribution, another doesn't, which test should I use?

The question is to compare means of sales volume in different periods. So I got sales period 1 and sales period 2. Sample size is 40. The skewness, kurtosis, test of normality and histogram all show ...
1
vote
2answers
38 views

paired-sample t-test

I have taken weight measurements before and after a treatment. When I run a paired sample t-test and if there is a significant change, would it be possible to make the claim "95% of the time ...
2
votes
0answers
8 views

Appropriate correction for tests for determining best of family

I have a sample of $N$ instances of a problem (assumed to be independent samples of an infinite population of instances). To each of these instances I apply $M$ methods, and record how quickly they ...
2
votes
1answer
40 views

Longitudinal data analysis with a single group

I need you assistance with finding the right model to analyze longitudinal data with a single group. My data comes from the ophthalmic field, i.e. eyes. I have n subjects. For each subject, one eye ...
1
vote
1answer
21 views

math explanation for using paired-t

Not a math/stats person, but I am interested in finding out why "paired t" would be a preferred test for samples that are not "independent". I googled a bit on this topic, but didn't really find ...
0
votes
0answers
64 views

logistic regression with GLMM (and p-values)

It seems that I'm a little bit confused with the different ways to achieve its goals in the statistics’ world (and the R’s universe), so I’m asking your help about issues with which I'm struggling. ...
3
votes
1answer
89 views

Bootstrapping Hmisc::rcorrp.cens for paired concordance?

As Frank Harrell says here and other places, it's better to compare two predictive models (Cox proportional hazards in this case) wrt discrimination (C-index) using the paired U-statistic ...
1
vote
1answer
30 views

How to calculate correlations of matching pairs

I have very basic knowledge of statistics and would appreciate some help identifying an appropriate method to calculate the proportion of outcomes that agree between pairs of data and whether it is ...
0
votes
0answers
21 views

How to test differences in multiple pairwise distances? With mixed model?

I want to compare two set of variables: X1 = All the pairwise distances between individuals from group A and group ref R X2 = ALL the pairwise distances between individuals from group B and group ...
0
votes
0answers
15 views

lsmeans: how to have mean and SD from pairwise comparison? [duplicate]

In my previous question, I asked about effect size, but this question is about mean and SD from pairwise comparison generated by lsmeans. I am doing LMM starting from model comparisons. Then after ...
2
votes
1answer
57 views

How to compare pre-post outcome when each subject react differently?

I have 11 subjects with pre and post outcome (two repeated measures). I'd like to test the difference between both conditions. The problem is that each subject react very differently. Here's an ...
0
votes
1answer
35 views

How to show whether the average coefficients of determination from one regression technique are better than another across many objects?

I have 50,000 objects on which I have performed two different types of regression. Using cross validation, I obtained the average $R^2$ score from each model on each of the objects. So now I have a ...
0
votes
1answer
42 views

Is Student's $t$-test the right choice?

I have 2 patient populations taken from the same time period that underwent 2 different surgical laparoscopic procedures. I want to compare the rate of conversion to an open surgical procedure. In my ...
0
votes
0answers
24 views

Can I combine two pairwise comparisons?

I am using LMM in lmer. To find the most optimal model, I compare models of three-level with two level using ANOVA function. If it turns out that no significant difference between these two, then I ...
3
votes
1answer
255 views

Non-parametric version of paired t-test (Mann–Whitney U test)

I have data from 100 individuals doing a 2AFC under a control and a manipulated setting. I want to compare the means. I initially used a paired t-test. My supervisor noticed the distributions were not ...
1
vote
1answer
38 views

Which design is most appropriate?

I have data from an experiment testing a new treatment. Each subject has 4 data points, 2 of the new treatment and 2 of the control. It is like a paired analysis, but instead having 1 observation of ...
1
vote
0answers
43 views

small n: some variables are normally distributed some are not

We performed a biomechanical study, comparing an intact state to 5 different deficiency states on the same knee cadaver specimen. This was conducted on a very small sample size (n=8). My problem is, ...
1
vote
1answer
163 views

Bias-variance tradeoff in the paired t-test

Suppose we have $K$ subjects and a treatment with two levels, "Before" and "After". A paired t-test is equivalent to fitting a fixed effects ANOVA: $Y = Subject + Treatment +\epsilon$ It is also ...
1
vote
0answers
36 views

Non parametric anova or two non parametric ttest?

I have a statistical question about a project I recently got. We performed a flow cytometry assay on 3 different groups: controls (n=5), patients before treatment (n=5) and paired patients after ...
1
vote
1answer
59 views

Which test to use for paired, nonparametric, categorical data?

We asked a group of subjects to tell us their preferences for a given procedure, of which there were 4 choices. We then provided them with educational material and asked them again of their ...
0
votes
0answers
29 views

Comparing similarity of two fingerprint or bitvector

I have a question that's two part. 1) The first part is that I have a bit vector or a fingerprint of a digital circuit where the each bit is high if a specific structure or component exists and zero ...
2
votes
1answer
216 views

Paired $t$-test when pairing is not known and some subjects responded only in one condition

In testing the difference between a 'pre' survey group and 'post' survey group, I have the same sample population surveyed, yet different sample sizes (fewer respondents within the 'post' group). Am I ...
0
votes
0answers
31 views

Seeking covariates that can negate the effect size of treatment groups in an ANCOVA model

I was going to build an ANCOVA model with two treatment groups (climbed/unclimbed) and a set of 10 potential environmental covariates which may collectively remove the significance of the climbing ...