Effect size is "a measure of the strength of a phenomenon or a sample-based estimate of that quantity" [Wikipedia].

learn more… | top users | synonyms

1
vote
0answers
13 views

Effect size for contrasts in hierarchical Bayesian “ANOVA”

Kruschke (2014) shows in his book how to compute posterior distributions of effect sizes (standardized mean difference) for the Bayesian analogues of frequentist independent-samples t-tests, and ...
0
votes
0answers
19 views

Combining effect sizes in binary data

I'm working on combining effect sizes for a meta-analysis when one study reports multiple effects for the same construct. To accomplish this, I'm using the equation provided in the Borenstein ...
1
vote
0answers
31 views

For Mann-Whitney, should I report effect size or Hodges-Lehmann pseudomedian?

When reporting a Mann-Whitney-U test result, is it better to report it's effect size or the Hodges-Lehmann pseudomedian (as R give us as "difference in location") ?
1
vote
0answers
11 views

Two years of data with pre/post, need to figure out size of impact

I have 2 data sets: 2013-14 and 2014-15. Each year has pre and post data, measuring literacy. Sample size is 101 in one year and 93 in the other. I would like to determine if 2014-15 results were ...
1
vote
0answers
28 views

How to compare explained variances of nested multivariate multiple regression models?

I have two groups of continuous* variables - let's call them MF (5 variables) and OR (2 variables), plus some demographics. It has been previously found that the MF are associated with one of the OR ...
1
vote
1answer
26 views

Why do I get completely different Effect Sizes using same data but different methods?

When I calculate Effect Sizes (Cohen's d) on the same study using different methods I get completely different effect sizes. For example: (t=4.81, P<0.001, d=0.41) I also calculated d=0.41 using ...
1
vote
0answers
24 views

Okay to use oneway ANOVA to compare these 3 group proportions from aggregated dataset?

My situation: I am assessing outcomes of a university course redesign. One of the goals of the redesign project was to increase successful course completion, as measured by a decrease in the course ...
1
vote
0answers
11 views

How to calculate effect size confidence interval with multiple replications at multiple sites?

Let’s say we have an experiment at one location evaluating the effect of some sort of treatment on a control condition (n=4). We calculate the effect size as (Treated – Control)/Control*100. So for ...
0
votes
1answer
40 views

How to calculate the effect size of differences in groups using dummies in multiple regression?

I am running a multiple regression analyses on a sample of 1800 respondents. The dependent variable is the mean of a 5-point likert scale and I have 6 predictors (antecedents) also using mean of ...
0
votes
0answers
25 views

Effect size for goodness of fit chi-square

I would like to assess the effect size of a goodness of fit chi-square test. I have a variable that can have 3 states and test against a custom expected value. I used a variation Cramér's V for a ...
1
vote
2answers
39 views

Categorical Predictors and categorical responses

I have a dataset consisting of 5 categorical predictors and a categorical response (class). I want to find out which predictor has an effect on the response. Additionally, I can't guarantee whether ...
1
vote
1answer
42 views

How do I calculate the effect size for a Spearman's correlation? Is it the same as for Pearson's correlation?

I'm having trouble understanding how can I calculate the effect size for a Spearman's correlation. I have the following results: rho= .352, df= 83, p<.01. Thanks!
3
votes
1answer
50 views

What is Pearson's r association strength?

I am trying to grasp the concept of magnitude-of-effect estimations, as opposed to standard null hypothesis testing procedures. According to a paper by (Snyder & Lawson, 1993) the ...
1
vote
0answers
19 views

Eta square and effect size in General Linear Model

I have an unbalanced data set that is categorized in 3 different topics. I wanted to see that how these different topics are effecting the data. So I used ...
1
vote
1answer
52 views

Is there any rule of thumb to classify $R^2$ as small, medium or large effect size?

I have seen authors saying $R^2 = .13$ is moderate, but they don't mention any source.
1
vote
2answers
106 views

Comparing the Fold Change (Effect size) after a treatment

I have been using this site for the past year to get tips on stats but I have run into a problem that I cannot overcome. It isn't too complicated, but I am not sure how to determine significance or if ...
1
vote
0answers
37 views

Calculating the covariance of effect sizes for multiple-treatment multiple-enpoint studies

I'm interested in finding the covariance of effect sizes for multiple-treatment multiple-outcome design given the scenario below. Gleser and Olkin (2009) provided the formula for the estimating the ...
0
votes
0answers
8 views

how to report effect sizes for average MAPE when comparing methods

My question is around how to report effect sizes ? I have 2 different methods and a naive method: I have method 1 applied to 1000 time series data and its average symmertric Mean Abs Percentage ...
2
votes
1answer
43 views

Compare two t-statistics

In a nutshell: I have performed two t-tests (A und B, each two-samples/paired). Both found significant differences. Can I tell, whether the difference observed in comparison A is significantly larger ...
2
votes
1answer
54 views

Modelling combined linear and quadratic age effects

I am running a GLM (Type III) with several predictors, including ${\rm age}$ and ${\rm age}^2$ as predictors. I am interested in knowing the combined effect size and p-value of ${\rm age}+{\rm ...
1
vote
0answers
34 views

Can I use a partial eta squared on t-test results?

I am currently trying to decide which effect size is the most appropriate for my results. I have conducted a repeated measures ANOVA, there are five variables in the ANOVA, all of which are within ...
0
votes
0answers
47 views

How do I calculate the effect-size of an unequal sample size independent t test?

Given the following parameters, how do I calculate the effect size of an independent unequal sample size t test? ...
1
vote
0answers
29 views

How do I calculate the variance of a mean difference effect size that has been converted to Fisher's z for meta-analysis?

To be able to compare different types of effect sizes, I am converting my effect sizes that are originally mean differences into correlation coefficients. I am using the following formula: d <- (t ...
0
votes
0answers
8 views

Calculating eta squared in 2 or 3 way ANOVAs

Does anyone know how you calculate eta squared (not partial eta squared) for 2 and 3 way repeated measures ANOVAs?
0
votes
0answers
16 views

Normality considerations for 'Effect Size'

What are the normality considerations while calculating Effect Size (http://en.wikipedia.org/wiki/Effect_size). Can different methods for calculating effect size be classified into parametric and ...
0
votes
1answer
40 views

Calculating effect sizes without SDs or sample sizes for meta-analysis

I'm coding articles for a meta-analysis looking at group differences on dichotomous and continuous outcomes. Groups are not the same size. Continuous outcome ES is standardized mean difference and ...
0
votes
0answers
21 views

Effect size for two-sample test with complications such as multiple data per subject

I have a simple hypothesis, that my dependent variable depends on a two-level factor Condition. Ideally I would like get a measure of Cohen's D, with confidence interval. The problem is my model is ...
1
vote
0answers
48 views

Will this invalidate my meta-analysis

I am pooling scores for my meta-analysis. The outcome measure is the proportion of children that pass a task. The data reported is given in three ways: 1) When children are tested with the task ...
0
votes
0answers
23 views

Calculating Cohen's d when df is Sattethwaite adjusted

Is it inappropriate to convert a t-statistic to Cohen's d if the independent groups have missing data estimated (MLE), and the df is much larger than it would be if you just entered the sample sizes? ...
0
votes
0answers
68 views

How do I calculate Omega-squared for the Multivariate effect in MANOVA?

I did a one-way MANOVA using SPSS and reported the partial eta-squared for the overall multivariate effect as well as for the follow-up ANOVAs (provided on the SPSS output). The editor wants me to use ...
0
votes
0answers
83 views

What is the difference between Average Partial Effects (APE) and Average Marginal Effects (AME)?

In this answer, the terms Average Partial Effects (APE) and Average Marginal Effects (AME) are used interchangeably. But in this paper, the terms are used to mean different things (page 75). But it's ...
2
votes
1answer
47 views

How do I statistically test whether two intervention types have significantly different effects in a meta-analysis?

I have the following problem: I am researching the difference in effects (as measured by standarized mean differences (SMD)) of two intervention types. (let's call them intervention 1 and intervention ...
2
votes
1answer
58 views

Describing trend magnitude or detecting trends

I have time series data. One observation per time period, about 10 observations or so. When describing the data (I am interested in descriptive statistics), I'd like to say that there is either a ...
1
vote
0answers
10 views

Disadvantages of common language effect size (CLES)

I recently read about common language effect size (CLES : https://en.wikipedia.org/wiki/Effect_size#Common_language_effect_size). It immediately appealed to me as an easily understandable number. I ...
0
votes
1answer
14 views

How to get common language effect size (CLES) with paired groups

Common language effect size (CLES : https://en.wikipedia.org/wiki/Effect_size#Common_language_effect_size) is calculated as proportion of all possible pairs of 2 group values which are more for one ...
2
votes
1answer
25 views

Common language effect size- place of equality

In Common language effect size (CLES) (http://en.wikipedia.org/wiki/Effect_size#Common_language_effect_size) how are cases with equality managed. Suppose there are 10 cases in each of control and ...
0
votes
0answers
32 views

Comparing effect sizes of two treatments from a large number of studies

I suppose this would be some kind of meta-analysis. I would like to compare the effect sizes of two treatments from a large number of published studies. I would like to show that the other treatment ...
1
vote
2answers
26 views

How do I calculate effect size for percentages of totals?

I apologize if this questions is poorly worded or has a very simple answer but I work in a field very different than statistics. I am looking at diction (word use) in books from two different artistic ...
0
votes
0answers
35 views

Where does this formula for calculating pooled standard deviation for calculating Cohen's d come from?

On this page, it is said that the pooled standard deviation for calculating Cohen's $d$ can be calculated as $\displaystyle SD_{pooled} = \sqrt{\frac{SD_{1}^{2}+SD_{2}^{2}}{2}}$. Where does this ...
0
votes
1answer
20 views

Significance of a cluster with respect to the whole dataset

I mainly am a machine learning guy and my knowledge of statistics is a bit limited. I have a (small) dataset of objects described by two categorical variables: $$ \begin{array}{|l|l|l|l|l|} \hline ...
4
votes
1answer
117 views

Computing Paired Samples (pre/post) Effect Size with Limited Information

I'm conducting a meta-analysis using the Hedge's g effect size statistic. Many of the studies are only reporting: pre-treatment mean score pre-treatment standard deviation post-treatment mean score ...
0
votes
0answers
41 views

Interpretation of effect sizes

I made a conclusion after a lot of research on the internet and i want to know if it is sound in any way. Because i think i might have been thinking on this way too long. Here's the deal: we did an ...
1
vote
1answer
61 views

Is it necessary to correct the d-statistic for measurement error while doing a meta-analysis? [closed]

Hunter, Schmift snd jackson advocate its correction for measurement error. Is it always necessary? can we do it without correcting such effect sizes?
0
votes
0answers
24 views

Calculating effect size for model with incidence rate ratios?

I've got IRR from a GEE negative binomial with log link. I have within subjects effects (pre to post) and between subjects (difference in change between groups), how do I calculate effect sizes?
1
vote
0answers
28 views

Relation between variance stabilizing transformations and effect sizes?

When researching effect size for proportions, in particular the paper Effect-Size Indices for Dichotomized Outcomes in Meta-Analysis, that at least two of the usual effect sizes are realy variance ...
1
vote
0answers
61 views

R: Effect size from simple slopes

I have calculated simple slopes for a multiple regression using simpleSlope from package pequod(). Is there a way to easily compute an effect size for a single simple slope analysis from the output? ...
0
votes
0answers
12 views

effect sizes and significance

I had to do a two-way anova with as dependent variable a pretest to determine any pre-existing differences in the groups. It yielded one significant effect in with a low effect size η2= 0.046 and two ...
2
votes
1answer
144 views

How to show the Contribution of Independent variables in terms of percentage in Multiple regression?

I would like to show the independent variables (IV) contribution in percentage. For example, Regression equation is ...
2
votes
1answer
126 views

Calculating effect size (lnR) variances for studies with different study designs for use in meta-analysis

My question concerns the calculation of effect size variance for studies that are going to be included in a meta-analysis. I want to calculate variance so that I can weight each study by the inverse ...
0
votes
0answers
129 views

How can i calculate an effect size (cohen's d) from a linear random effects model (beta)

I am trying to figure out how to calculate a Cohen's d statistic for a linear random effects model. I did not do the analysis myself, I have read it in a journal article so i'm left to figure it out ...