# Questions tagged [experiment-design]

The study of how to structure an information-gathering exercise where variation is present.

622 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
401 views

### Are non-square latin hypercubes viable?

At https://github.com/OpenMDAO/OpenMDAO-Framework/issues/599 it is stated that non-square Latin Hypercube experimental design is not well defined (I assume that for higher dimensions that means ...
4k views

### AB test sample size calculation by hand

Evan Miller has created a well-known online AB test sample size calculator. For the sake of being able to program and modify this formula, I would like to know how to calculate sample size Evan Miller-...
563 views

### How good is an optimal design (DOE)?

I am looking at an experiment with 5 factors (4 numeric and one nominal) with three levels for each numeric and 2 levels for the nominal. Instead of the 162 runs, I am interested in a small design (30 ...
203 views

### Pooling samples — what are the effects

There is an experiment in which biological samples are taken for several treatments and a control. For each treatment, we have enough resources to evaluate 5 samples. Some researchers suggest (for ...
49 views

### Modification to Latin Square Design

I have an experiment where I am having participants rate the readability of 10 different texts. I have 37 participants and I would like them to rate the readability for 6 texts each so that each text ...
301 views

### Optimum approximate theory D-Optimal design

I am using optFederov, from package AlgDesign, to create D-Optimial designs. However, I am a bit confused on what measure to use as efficiency measure. I'd like to use D-Optimal but I don't know which ...
262 views

### Sample Space of Machine Learning Classification “Experiment”

If you're trying to classify some input, $\mathbf{x} \in \mathbb{R}^{n}$, to one of $d$ classes using a model with parameters, $\theta$, how are you supposed to think about the experiment of learning ...
124 views

### Help with designing the analysis of a radio telemetry study

I was wondering if there are any spatial ecologists out there who can provide some insight on the trouble I'm having with my Masters research. I am looking at the association a bat species to high ...
56 views

### D-Optimal Criteria Vs Differential Shannon Entropy

I want to understand how minimizing the determinant of the information matrix is equivalent to maximizing the differential Shannon entropy? A similar question was posted in Math SE but hasnt been ...
46 views

### Treatment interference (causal analysis)

I am doing research on students and their perception of their grades. Specifically, I want to do an experiment where students either (a) see their actual grades in a course (as a percentage) - the ...
305 views

### Analyse sensitivity of hyper-parameters of Machine Learning Models

I want to analyse how sensitive my non neural net machine learning models are to the choice of the different parameters. I am currently using grid search to tune the models. Is there any method that I ...
86 views

### an alternative allocation method for small RCTs?

stratification and minimization are two randomization options to achieve balance in terms of covariates or baselines in small RCTs. in recent years, researchers seem to have favoured minimization, ...
36 views

### Can you derive density from a sample that includes different quadrant sizes?

I wish to estimate the percentage covering of vegetation in an area 1 km long and 600 m wide. Within this area I have percentage cover of vegetation for 10 circles with 10 m diameter and percentage ...
518 views

### Handedness ā Observational study vs. Experiment

Let's say your goal is to determine whether left handed people are more coordinated with their right hands than right handed people are with their left. You gather up 20 left-handed people and 20 ...
162 views

### Combinatorial Block Designs in Statistics

How are combinatorial designs such as BIBD and Steiner triple systems used in statistics in designs of experiments and hypothesis testing.
156 views

### Video Lectures on Design and Analysis of Experiments

Where can I find video lectures or tutorials on design and analysis of experiments? E.g. something similar in scope and depth to Montgomery's Design and Analysis of Experiments?
125 views

### How to design a 2-level fractional factorial experiment given some prior knowledge

We're designing a trial to test four factors (call them A, B, C and ...
242 views

### GLM experimental design issues for count data in landscape experiment

I am analyzing bird count data from surveys conducted each week (from Nov-April, when bird foraging most active near breeding cycle) for 6 years in 9 large experimental plots that are split amongst 3 ...
285 views

### Regression model with heteroskedasticity in both variables

I've been learning (lurking) from this site for a while and I finally have a question I haven't seen answered yet. I'm doing a flight test and trying to fit the resulting data to linear line. From a ...
386 views

### Independent t-tests and Technical Indicators: Voodoo, Axes, and Objectivity

First off, I'm not trying to crowd source a personal printing press (i.e., not doing this: "I'm using strategies $x$, $y$, $z$ in the stock market and..."). Instead, I'm looking for feedback on ...
51 views

### Extending external validation diagnostics to experiments with continuous treatment

Does the external validation diagnostic methods discussed in Stuart et al. (2011) (i.e., inverse propensity score weighted regressions) also apply to the experimental setting in which the treatment is ...
36 views

### Weighing toilet paper with an imprecise scale

A practical, topical problem: Consider a typical roll of toilet paper (TP) with perforated sheets of fairly uniform size, and suppose we're interested in the distribution of a sheet's weight $W$ but ...
30 views

### Intuition of the regression model under fixed design case (nonparametric regression)

Let $(x_1,Y_1), \dotsc, (x_n,Y_n)$ be a random sample from the regression model $$Y_t=m(x_t)+\epsilon_t.$$ When authors want to develop the asymptotic properties of the local linear estimator of $m$ ...
70 views

### ANOVA/ANCOVA - how to analyse

In a basic research design where you want to test how some intervention (let's say our IV is 'drinking' with the categories water; sprite; and rum) affects some continuous measurement (let's say ...
33 views

### What's the rationale behind a normality test followed by a $t$-test?

Correct me if I'm wrong, but from my understanding, the standard procedure of testing whether data from an unknown source have a specific mean is to (a) perform a normality test to see if the data are ...
29 views

### GLMM in seed germination study

I have an experimental design measuring germination of a single species of tree under different treatments. The treatments include; cattle grazing and no cattle grazing and rodents and no rodents. The ...
25 views

### Advice for conducting the same experiment several times?

I'm very new to Bayesian statistics, but I've found myself in a situation where they might be able to help. I'll be running the same experiment repeatedly and analyzing the data every few months. The ...
66 views

### Single-cell RNA-seq: deep & few or shallow & many?

My lab does a lot of single-cell RNA-seq. Our goals are to find out what cell types are present, characterize their gene activity, and (if possible) understand how the different subpopulations are ...
130 views

### How should I specify my random effect when it is correlated to a fixed effect?

I want to perform a GLMM on my data in R using lme4. I have one response variable measured on more than 250 individuals. For each of those individuals, a ...
1k views