# Questions tagged [experiment-design]

The study of how to structure an information-gathering exercise where variation is present.

1,992 questions
Filter by
Sorted by
Tagged with
1 vote
21 views

### Why can't interaction be measured with a complete block design? [duplicate]

I am struggling to understand why interaction cannot be measured in a CBD. While many sources say it is because there is only one observation per block/treatment combination, could you not compare the ...
33 views

### Looking for an intuitive explanation of D-Criterion for Optimal Design Problem

I know only a little about Fisher information and optimal experimental design, but I'm trying to better understand the subject. If I have an experiment composed of a single detector and my detector ...
• 149
1 vote
30 views

• 11
58 views

### Can regression to the mean also impact heterogeneity?

I understand Regression to the Mean (RM) as a naturally (and likely randomly) occurring shift in the scores of a sample of extreme subjects (super high or low scorers) from each measurement time to ...
• 397
149 views

### how to deal with treatment dropouts in experimental designs

I conducted a between-subjects experiment with one 3-level factor (high group vs low group vs control group). Because of dropouts from the treatments, the final distribution is control group: 85 ...
• 41
102 views

### Performing a Difference-in-Difference Analysis where the Control Group is Already Treated

I'm involved in a project where the outcome is the proportion of cancer patients who have received surgery. The treatment event is a state-level policy change that mandated moving all these cancer ...
65 views

### How to Include a 'No Shift' Scenario in a Temperature Shift DOE

I'm currently working on a Design of Experiments (DOE) for a process that involves temperature shifts at three different times. My challenge is incorporating a 'No Shift' scenario as one of the ...
79 views

### How do data/observations themselves contribute to our ability to make determinations of whether a hypothesis is true or false?

Let's say that I have a hypothesis, and I'm trying to determine whether the hypothesis is true or false. If I remember correctly, in statistics, the standard philosophical view is that, technically, ...
• 2,096
93 views

### Is it possible to use simulated (bootstrap) A/A tests of historic data to estimate the impact of confounding factors on the treatment effect?

I recently heard a proposal for a method to measure the degree to which confounding variables impact historic results of A/B tests. In order to ascertain the degree to which confounding has impacted ...
• 91
1 vote
68 views

### How to code a lme, lmer, or glmer model for a split-plot design (ANOVA)?

I have a study where the initial height of seedlings were measured at year 0 and again 11 years after treatments were applied and a net change in height was recorded. I have a split-plot design as ...
100 views

### Power analysis for a quasi-experimental factorial design 3(manipulated) x 1 (measured) ANCOVA

I'm experiencing an hard time looking for the proper analysis to use to compute the power for an experiment i'd like to implement, so here is my question for you. I'd like to run a quasi-experimental ...
• 143
32 views

### What is the appropriate design for a discrete choice experiment?

I need to develop a discrete choice experiment in R, which is an unlabeled experiment. However, after delving into the theory behind discrete choice experiments, it remains unclear whether there is a ...
1 vote
33 views

### Discretization in regression, experimentation, and causal inference as deafult [duplicate]

It crossed my mind that when designing an experiment and you're not interested in NHST but full regression model where coefficients for treatment exposure and relevant covariates are desired, perhaps ...
• 3,382
867 views

### Causal diagrams necessary in randomized controlled trials?

I understand how a properly administered RCT rules out confounders because there are no variables influencing the treatment/control group assignment except randomization (meaning no backdoor paths ...
• 6,174
1 vote
60 views

### How to mathematically prove the "transitive property of nested predictors"?

QUESTION I am studying the structure of experiment data sets, and I want to propose a rule that I call the "transitive property of nested predictors". The general idea is that… if there are ...
49 views

### Validating my experiment design and Mann-Whitney U test usage

There are four different methods I use to generate solutions for different domains. To determine which solution is the most useful, I want to conduct an experiment with participants. As I have some ...
35 views

### Caclulating the standard error of difference in Conditional Average Treatment Effects (CATEs)

Some perceive scientific information (for example, scientific evidence of climate change) as accurate, but others don't. I want to know under which condition this biased evaluation increases or ...
• 21
1 vote
44 views

### Which field of mathematics should be used to formalize the analysis of a dataset's "geometric" structure [closed]

I want to know if mathematical formalism can be applied to understand the "geometric" structure of an experiment's data set, and esp. to the relationships between its categorical predictors. ...
30 views

### Using Difference-in-Differences With No Natural Groupings

I'm running across a number of analyses at my organization where people are doing difference-in-differences on individual-level data with no natural groupings. For example, one looked at the effect ...
• 21
153 views

### Is there a good reason for a lab to repeat experiments instead of conducting a single larger blocked experiment

It is not uncommon for biologists to repeat experiments to confirm initial results. Intuitively this makes some sense but to me seems inefficient and potentially problematic. (For example, one client ...
• 2,460
39 views

### Appropriate design for two experimental conditions and incomplete blocking

I'm planning to perform an experiment in which I will be assessing the role of two experimental variables (A: 6 levels, B: 4 levels) on a defined outcome which, however, might be affected by external ...
• 21
8 views

### Conceptual question on Recognition vs conformation

So, this is a conceptual question on the design of a model. I am getting started with ML and on a slight time crunch to get some results. My problem is not a classical recognition problem. It’s more ...
25 views

### Use of other ICU patients as control group

I am reviewing an article that is not yet published, so I cannot be too specific. Briefly, the authors did an unmatched case-control study. The cases were patients admitted to the ICU for a specific ...
• 125k
25 views

### Testing correlations between different varibles from two measurements

The field study investigates the relationship between root traits and plant performance traits in 12 genotypes, using a randomized complete block design with four replications per location. Root ...
27 views

### How to choose the sample size

How do I choose a sample size for a multiple factors irrigation experimental research? Here is what I mean, I want to compare the effect of precision irrigation and conventional irrigation on crop ...
1 vote
26 views

### Mixed effects model in R with subsampling in replicates

I am working on a mixed effects model in r where I have 2 treatments, 5 replications and subsampling with each site. I dont have access to the raw subsampling data though, I just have the mean effect ...
14 views

### How to adjust blocks in a 2x2 factorial experiment (Minitab)?

I'm currently in the planning phase of an experiment involving 2 factors, each with 2 levels, and 3 replications per combination, resulting in 12 experimental runs. In Minitab, the suggested blocks in ...
132 views

### Designing an experiment to assess the form of a distance measure

BACKGROUND: I do research in budget-proposal aggregation: each person reports their ideal budget-allocation, and a central authority has to decide on an actual budget-allocation. An important ...
• 1,029
48 views

### AB Testing with and without counterfactuals

My boss wants us to run a simple experiment where we manipulate the search results on our website. He is insisting that we must have counterfactuals for the results to be valid. The way I see ...
• 221
45 views

### Validating power analysis

I'm currently running some experiments in web. The main idea is to validate the impact in some conversion metrics. The typical funnel we have is: Traffic -> Signup -> some Activation event. Our ...
• 187
74 views

### How does G*Power calculate sensitivity in z-test for two independent proportions

I am trying to recreate sensitivity calculation in Python by applying the same methodology as used in G*Power z-tests > Proportions: Difference Between Two Independent Proportions > Sensitivity: ...
• 213
11 views

### What is the relationship between maximum entropy sampling and bayesian d-optimal design?

In regards to optimal design, specifically sequential design or active learning for parameter inference (e.g. linear regression). As I understand it, Bayesian D-optimal design maximises the expected ...
22 views

### Degree of Freedom in DoE modeling

Past the standard full factorial and fractional designs, I am getting the impression that non-regular designs (OME, Hall, mixed-level OA, etc.) are just trying to fit in as many factors as possible. ...
1 vote
16 views

### How to fractionate a 2^4 x 3 factorial with a nominal categorical

I've only just been taking a dive into DoE, so I'm still green on how to setup the designs according my experiment, so this question is more about confirming my understanding of experimental design. I'...
1 vote
31 views

### balanced and unbalanced dose response experiments

Consider a dose response study where there are four active treatments (from the highest dose and lowest dose) and also a control. One goal is to test the hypothesis that treatments are more effective ...
• 1,173
154 views

### How should I analyse this experiment with two blocking factors

In this experiment, a machine is used to compare the wear resistance of 4 different types of rubber-coated fabric (variable mat coded A, B, C and D). To do this, ...
• 293
292 views

### What is a Randomized Complete Block Design. How do we create one and analyze it?

I have been reading about experimental design, and Randomized Complete Block designs (RCBD) in particular and I have a few queries. What exactly is a randomized complete block design ? Is there a ...
• 293
72 views

### How to consider independent samples in a mixed-design experiment?

I collected data from an experiment with a mixed-design, specifically a 2x3x4 mixed-design, where the factors are populations (2 levels), conditions for the first population (3 levels), and conditions ...
182 views

### Statistically testing for differential attrition in R?

Context I have a randomized controlled trial with three groups and three time measurements (pre, post, follow-up). I noticed that from pre to post, and then from post to follow-up, the attrition rates ...
• 281
29 views

### Physical model for multilocation RCBD with repeated measures in time

I am trying to write a model for an experimental design that looks like this: There are 5 farms (A,B,C,D,E) , and each farm has a RCBD design with 2 treatments(1,2) randomized in 4 blocks in each farm....
• 89
1 vote
36 views

### Is it better to sample more time points or more replicates at constant sample size?

I would like to analyze my data with a linear regression: t*k = x x is my measurement with some error t is time I want to fit k as best as I can with the best ...
• 131