Experimental design, or design of experiments (DOE), is the design of any information-gathering exercises where variation is present. In statistics, controlled experiments are usually implied, which involve an "experimental group" and a "control group". In the design of experiments, the ...

learn more… | top users | synonyms (1)

1
vote
1answer
17 views

R lsmeans in a model with two residuals (split-plot)

Let's assume the model: lm(VAR ~ A * B + (A : R), data) which produces this ANOVA: ...
0
votes
0answers
23 views

Standard Error of estimate of variance

I am not understanding how is the standard error of estimates of two-factor factorial random effect model calculated ? For example , In the book Design and Analysis of Experiments , by Douglas C. ...
0
votes
0answers
9 views

One corner point duplicate and two level full factorial design main effects calculation

I conducted a series of experiments corresponding to a full factorial design with 3 factors and two levels per factor. I entered the data in a software (minitab, not sure if relevant) the calculation ...
1
vote
0answers
46 views

Robust parameter design - modern methods?

I would really appreciate help regarding a project I've been given. First off, I'm an undergrad engineering student with no experience or training in statistics. I've been given a task to improve the ...
1
vote
0answers
14 views

Feedback on Experiment: bosses and meetings

As my context is rather specific, I'll try to write an analogy that sounds more natural and preserves all characteristics of the original problem. It goes like this: A certain company has around 2k ...
0
votes
0answers
9 views

Calculate mean and std dev from experiment - no formal params

I am a little lost on how to calculate mean and std dev from an experiment (simulation). I have run the simulation (10000 times) and it output a set of numbers (10000). Plotting a histogram, it gives ...
0
votes
0answers
20 views

Experimental design for high dimensional model

I am running a computer model with a lot of inputs ( > thousands). I am not familiar with this area, so may I ask for any instructions/directions on how to make design on such high dimensional space? ...
0
votes
0answers
26 views

How to find this conditional probability in sampling without replacement in this experiment?

My problem is the following: I have an urn with 10 different names. Consider a particular name (ex. John). I want to estimate: 1) the probability to extract John 2) the probability to extract John ...
0
votes
0answers
14 views

Measuring training effectiveness

I am measuring training effectiveness using a control and experiment group design. However, as it is a live project in an organization having an 'interest based' approach for training subscriptions, I ...
0
votes
0answers
21 views

Advantage of a pooled Repeated Measures ANOVA?

Study Design: 2 (time) x 2 (condition) repeated measures design DV: Physical activity (i.e. walking/cycling/running; all measured in units of seconds, meters, and amount of steps) IV's: Time, ...
0
votes
1answer
16 views

Can we make mediation analysis with ANOVA?

I conducted mixed ANCOVA for my research. However, I need to make a mediation analysis as well. I have no idea of converting a mixed ANCOVA with many control variables into a regression. Can't I do ...
0
votes
1answer
19 views

Two-way ANOVA doesn't detect differences between conditions in a specific group?

OK, so let's say we have independent variables Condition (A or B) and Race (1 or 2 or 3). Then say we have a dependent variable X. We can run a two-way ANOVA to find out if there's an effect due to ...
0
votes
1answer
32 views

Why do we ignore the main effects when the interactions are not significant in a three-way ANOVA?

I'm following an SPSS guide online, and the procedure is to first test for a three-way interaction. In my case there was no sig. three-way interaction. Then the procedure asks me to consider two-way ...
3
votes
2answers
122 views

Adjustable sample size in clinical trial

Most clinical trials I see have a fixed sample size. In some cases they have prior data that allows estimating the effect size and the variance or distribution of values, and calculate the sample ...
0
votes
1answer
65 views

How to analyze data once broken down into gender, race, etc

I have two conditions, Treatment A, and Treatment B. Participants are randomly assigned to a treatment at the outset. Then I run unpaired t-tests on the data to find any differences. BUT I am also ...
1
vote
1answer
53 views

1 and 2 sample t-tests for plants and soils question!

I have a good friend who has an experiment where he grows different kind of plants on various soils and measures the protein content and weight each week for 5 weeks. His goal is to determine which ...
0
votes
0answers
31 views

Post-hoc multi-level design analysis

I am developing a model to predict a dichotomous satisfaction measure on festival event participants. Events can last 1 to n days; and participants are grouped in parties of 1 to k party members who ...
1
vote
0answers
34 views

Why am I finding greater power with a coarser level of randomization?

I am working on a Monte Carlo power analysis for an experiment about the hiring of teachers in schools. We can randomize the treatment at the school level or at the applicant-school level. I was ...
4
votes
1answer
29 views

Why does randomising the order of measurements remove time as a confounding variable?

Say we're interested in the difference in x between Group1 and Group2. We might measure 50 samples from Group1 then 50 samples from Group2. If the accuracy or precision of our measurements change over ...
0
votes
0answers
6 views

Searching for a term for systematic, universal non-reporting in survey data

I am searching for a technical term to describe a situation I have run into my survey research and analyzing survey datasets. In experimental survey research, systematic under-reporting and ...
0
votes
0answers
31 views

Choosing the correct experimental design

So lets just say I conducted a chi-squared contingency analysis test (I did btw) on 40 separate fish. Each individual fish only went through one treatment trial, where they were subjected to ...
1
vote
0answers
17 views

Paired studies: possible drawbacks

I have a question regarding paired studies. We are doing a medical study, we have a whole lot of data on a few hundred people and our aim is to study if a different level in one substance is linked to ...
0
votes
0answers
22 views

BIBD or IBD or PBIBD

I use block design for discrete choice experiment. While Balanced incomplete block design(BIBD) is considered as gold standard for blocking in choice experiments. However this is not always possible ...
0
votes
0answers
23 views

Do two-way ANOVA data need to be strictly balanced?

I conducted an experiment of 2x2 between-subjects design. So there is four conditions with the two factors. However, after deleting the data that failed to pass manipulation check, the four conditions ...
0
votes
0answers
11 views

Ask about measure pretest posttest in different groups

My team members are going to have a blood donation campaign and we would like to see whether the campaign has significant social impact. A group of people will be randomly asked to answer a ...
1
vote
0answers
19 views

Help with repeated measures analysis in a complex design

I'm looking at a study measuring blood flow in the brain, there are 8 subjects in this study, with 18 measurements each. The measurements are done 6 at a time in three different time points ...
1
vote
0answers
53 views

Combinatorial Block Designs in Statistics

I am interested in description and references for how combinatorial designs (such as BIBD, Steiner triple systems etc.) are used in statistics (especially in designs of experiments and hypothesis ...
-1
votes
1answer
23 views

ANOVA table for 4-factor split-plot

Hopefully I can explain this clearly. Reference diagram below if needed. I'm planning a large field experiment that I think will have to be a split plot design. There are six sites (outlined in ...
0
votes
0answers
20 views

How to Analyze Categorical Data in a Repeated Measures Design?

First post. I've read through similar posts and no one's quite answered it already, so I thought I'd throw my hat in the ring. Here goes: I have a repeated-measures design planned proposes to ask a ...
2
votes
4answers
229 views

When does correlation matter when there is no theoretical relationship?

Summary: Correlations does not imply causation has became mainstream. I am interested in understanding what is required for the implication to actually take place. Detailed question: When I have a ...
0
votes
0answers
12 views

Quasi-experiment with naturally assembled collectives (classrooms): Propensity score matching or not?

I am planning on running a quasi-experiment (pre-test post-test non-equivalent groups design) that involves two treatment groups that are subjected to different treatments (X+ & X-) and one ...
0
votes
0answers
15 views

Why does a blocking design require balancing across blocking levels

Why does a blocking design require balancing across blocking levels, say the following design is valid: ...
0
votes
0answers
11 views

Experimental Design Optimal allocation to treatment

I have trying to design an pre-post study on the effectiveness of a particular media platform in inducing behavior change. The 700 households are distributed in 6 geographical clusters. They have ...
1
vote
1answer
25 views

Experimental Design: Matching Control and Experimental Groups

I am running a health intervention among children. There are 6 clusters of neighborhoods that are included in our study,each with 48 households. The households are being measured on 7 key variables. 4 ...
2
votes
1answer
43 views

Dichotomizing continuous variables for an EXPERIMENT not a survey

I've aware of the many issues/pitfalls with splitting continuous variables in survey research. Nothing I have read addresses whether doing so to create groups which will then be assigned to tx ...
1
vote
0answers
32 views

Repeated measures ANOVA of an experiment

Here's something that has bugged me a little bit and is quite fundamental to running statistics in experimental settings. Say I run a psychological experiment with 1 categorical IV (load: 4 levels) ...
0
votes
0answers
22 views

PCA to look at relationships between pretest - posttest changes?

I ran a pretest posttest experiment with two groups. I am interested in looking at how the changes in the measured variables (for example: levels of depression, levels of empathy, levels of anxiety) ...
0
votes
1answer
59 views

Regression discontinuity design with multiple cutoffs

When we have an RD with multiple cutoffs, and we pool all observations and estimate the treatment effect across cutoffs, what does the pooled estimate identify? I have found one paper using a RDD ...
1
vote
2answers
49 views

Can we use weights in lme as a covariable?

This question might be a duplicate, but a colleague and I have trouble understanding previous answers about the use of weights in lme. So in simple terms: We have an experimental design with 2 ...
0
votes
0answers
13 views

Terminology for comparing anwers to a set of reference questions

I´m conducting a questionnaire in order to examine the behavior of drivers of electric vehicles when providing information, such as parking time, to a charging station. For several reasons it is ...
1
vote
2answers
61 views

Using Kruskal Wallis vs One Way Anova with small sample size

I have an experiment with one factor and five levels. The response is proportion of conversion (ex: 1/11, 1/8...). Doing a power analysis: ...
0
votes
0answers
17 views

Pairwise Learning to Rank - detecting detrimental changes

The idea behind Pairwise Learning to Rank is that if you have a set of search results then a clicked on result can be used as training example to indicate that it should rank more highly that the ...
0
votes
0answers
23 views

Threshold for true experimental status?

This has been bugging me for a while now. I've read numerous sources but I can't really find a definitive answer. Most textbooks deal with generic designs but don't really address designs that ...
1
vote
0answers
29 views

User Study Setup: Correct selection of tasks

I'm struggling with the problem to design a formally correct user study. I have the following circumstances: I want users to assess the (subjective) usefulness of a -so called- trail result. That ...
0
votes
0answers
11 views

Finding redundant parts of a data set for training a nonlinear model

I like to train a nonlinear model based on a data set $D_1$,..$D_n$, where $D_i$ is collected by doing experiments $E_i$. It is possible that $D_i$ is redundant given $D_j$ and $D_k$. Since doing an ...
1
vote
0answers
77 views

Regression on unbalanced two-way with interaction

I am developing my own algorithm to calculate it for me. I am interested in type III SS and using the overparametrized design matrix to estimate my parameters vector and then proceed to the cubic ...
0
votes
0answers
24 views

Have I interpreted the effect of a confounding variable correctly?

I'm interested in whether feeding rate differ between two species of birds, Species A and Species B. However, tide also affects their feeding rate, and so tide is a confounding variable. In the plot ...
0
votes
0answers
13 views

Predicting individual treatment effects as the difference between predicted outcomes with and without treatment

To provide some context, I am trying to (a) identify the best ad to increase support for a particular issue among a large group of people, and (b) identify the people most likely to respond positively ...
1
vote
0answers
22 views

Assign the tree species most representitive of a specific size class

I am replicating another study in which trees were assigned to a class based on diameter. The most representative species of each class was identified for each plot sampled. The classes are sapling ...
0
votes
0answers
14 views

How to make Fractional Factorial designs with constraints?

I want to make a Fractional factorial plan of $2^{100}$ with the following additionnal constraint : $\sum_1^{500} I_{x_i=1} =5$ and $\sum_1^{500} I_{x_i=-1} =95$ ; where $x_i i=1,...,500$ are my two ...