Skip to main content

Questions tagged [research-design]

Methods and tips for designing and conducting effective research.

Filter by
Sorted by
Tagged with
0 votes
1 answer
18 views

Data analysis steps to take after correlation [closed]

My hypothesis is that economic inequality is substantially positively associated with crime rates. To test this, I have crime rates for various crime types and percentages of populations in various ...
Steven Morrison's user avatar
3 votes
1 answer
39 views

Inconsistent study design

I have a study design on two sites (each site was set up in a different way) and am trying to find the best approach for the analysis. I'm looking at survival of plant species, under 4 treatments, on ...
Cristina Tarahumara's user avatar
3 votes
2 answers
128 views

Analyzing an experiment which consists of many "small" experiments

Consider the following setting: I am trying to choose between two bakers for my new bakery, Baker A and Baker B. The way that I am evaluating them is on a set of different cakes on the menu: Cake 1, ...
gaussiandynamics's user avatar
1 vote
1 answer
26 views

Appropriate Research Design for Multiple Independent Variables and Dependent Variables

I need some advice on designing the quantitative aspect of my upcoming master's research project. My research design involves a convergent mixed methods study and aims to explore the factors that ...
Domus's user avatar
  • 11
0 votes
0 answers
123 views

Help: G*Power Analysis for Correlation and Moderation

I have 3 measures, all scored on Likert style scales and I will be using the sum of items from each as scores. It is a cross-sectional study. predictor variable is attachment style (with two levels, ...
Cody Banks's user avatar
3 votes
2 answers
44 views

Three continous variables + 2 factors vs. five continous variables to control for confounders?

I am trying to make sense of the design for my Master's thesis. I am looking at how three different types of play relate to anxiety in children. So I have three continuous independent variables ...
Ksenia's user avatar
  • 31
2 votes
0 answers
17 views

Evaluation/Analysis design advice

This is industry related stuff, so I'm not thrilled about being in this position and could just use any helpful other opinions. My company has a program where we provide extra dollars to a hospital to ...
Bobby Thomas's user avatar
1 vote
0 answers
15 views

Statistical models for simultaneous study designs

I have thinking about a problem that can be encountered in environmental epidemiology, but I guess in other research fields too. Background: In environmental epidemiology the interest is mostly to ...
jmarkov's user avatar
  • 683
0 votes
1 answer
68 views

Statistical testing on non-random sample?

I am working with a non-random sample in an observational study but would like to do statistical testing to show certain trends and processes. Statistical tests assume random sampling, which is not ...
manaTEA's user avatar
  • 103
0 votes
0 answers
8 views

(Quantitative) research methods for collocation analysis in corpus linguistics?

I am trying to conduct a collocation analysis. This is a corpus linguistics research, doing so require me to test statistical significance using Mutual Information, as well as frequency normalization ...
user avatar
0 votes
0 answers
86 views

How to make the case for a parallel trends assumption in a within-person DiD with 1 pre-treatment time point 1 post-treatment time point?

Study design: Within a two-year period (2021-2022), both the people in the treatment group and the people in the control group did not receive the treatment of interest at time point #1, and only the ...
Ray's user avatar
  • 11
8 votes
1 answer
154 views

Is there a good reason for a lab to repeat experiments instead of conducting a single larger blocked experiment

It is not uncommon for biologists to repeat experiments to confirm initial results. Intuitively this makes some sense but to me seems inefficient and potentially problematic. (For example, one client ...
George Savva's user avatar
  • 2,460
1 vote
0 answers
29 views

Medication switching in pregnancy

My study design seeks to answer the following question: What are the potential risks of switching medications from pre-pregnancy to pregnancy for (1) individuals who switch from medication A to B; (2) ...
Ashley's user avatar
  • 11
3 votes
3 answers
241 views

Can you compare Propensity Score Matching estimates?

I am considering a research project involving Propensity Score Matching (PSM). For a high-level overview, I am looking at college students. Colleges offer need-based, and merit-based scholarships. I ...
shrey_shankar's user avatar
0 votes
1 answer
139 views

Relationship between Cohen's D effect size and p-value

If a the Cohen's D of a study is 1.13, what would p = 0.003 and p = 0.05 Small, medium or large effect? I believe its a small effect but would like other thoughts and answers.
user400184's user avatar
0 votes
0 answers
29 views

What statistical test should I use to assess changes in Likert scale over 3 points in time?

I had a group of participants that provided responses to a 7-point Likert scale question at 3 points in time (baseline, immediately after a course, and 1 year after the course). What statistical test ...
Shane's user avatar
  • 1
0 votes
0 answers
35 views

Can I use the same regressors for Instrumental variables and the outcome variable?

I'm reading a research paper that uses an IV, they regress A, and B, to estimate C, then they use estimated C and actual B to regress on D an outcome variable. This seems to violate the only through ...
Ahhhhhhhhh's user avatar
1 vote
0 answers
63 views

In R, how to analyze Strip-Plot Design when there are three factors?

I have one dataset like below ...
Jin.w.Kim's user avatar
  • 143
1 vote
0 answers
23 views

Choosing the right analysis for DAG - Which quasi-experimental alternative to instrumental variables?

I am writing a statistical analysis plan for a project but I am having difficulties finding the best analysis to answer my question. I am working with the conceptual framework below: There is likely ...
EpiMarie's user avatar
0 votes
0 answers
27 views

Does my study design have randomization issues?

I am helping to design a study where participants will be randomized to one of three arms -- a control arm, treatment 1 or treatment 2. Within each arm, they will then also receive either no ...
Jay Bee's user avatar
  • 185
0 votes
1 answer
49 views

Which statistical model should I use? Poisson regression with multilevel?

I have a study like this: firstly, select several counties within the U.S., and then select bunches of stores within each country. Based on the stores that selected within each country, I need to ...
NewRUser's user avatar
0 votes
0 answers
72 views

How should I design an exercise study?

I want to design a study to investigate the efficacy of a specific training protocol. I have 20 subjects. All of the subjects will complete an initial test of a physical exercise to failure. The ...
Self student's user avatar
3 votes
1 answer
63 views

What is mixed methods research?

I tried to look up the answer but am confused by what this means exactly. It seems like one is a precursor to the other, thus you need both to conduct a study unless you're working with existing data. ...
jon's user avatar
  • 31
0 votes
0 answers
60 views

What type of design is this experiment? 3x2x2 Factorial design?

I am running an experiment to find out if the pattern of expected and actual guilt people feel when making and not making a purchase is dependent on proximity to their payday (e.g. do people expect/...
user161652's user avatar
2 votes
1 answer
76 views

What is the algorithm to specify a fixed effects design matrix?

I have a procedure for generating the design matrix of an experiment that uses only fixed effect predictors. The procedure depends on knowing the relationship between all pairs of predictors in the ...
Chris Science's user avatar
0 votes
0 answers
8 views

Can all random effects design matrices accept collinear columns?

I am curious about how the random effects design matrix works, within a mixed model. I know that the columns of a random effects design matrix are allowed to be collinear with each other, but I am ...
Chris Science's user avatar
0 votes
1 answer
43 views

How to analyze temporal effect on outcomes in two populations

I'm looking for guidance for how to plan an analysis. I am interested in temporal differences amongst two different populations. More specifically I'm interested in assessing differences in length ...
Ankit Nangia's user avatar
0 votes
1 answer
36 views

IVs: would this rainfall specification cut it?

I need feedback to check whether rainfall is an appropriate instrumental variable. Before you boo me out, hear what I have to say. There are two countries: A and B. A and B are 2000 miles apart. My ...
YouLocalRUser's user avatar
1 vote
0 answers
15 views

How to design study to predict development of a condition B given a condition A

Overall aim: I have patients with a very common condition and I want to see if it is significantly associated with a reduction in a certain type of cancer between 6 months to 5 years later when ...
Sebastian Zeki's user avatar
1 vote
0 answers
36 views

Is it wrong to conduct a non parametric statistical test when the p values are greater than 0.05? [closed]

If the obtained statistical data in a research were tested using Kolmogorov–Smirnov (KS) test and the test was rejected or in other words data were normally distributed, is it possible to utilize the ...
sherl.lol's user avatar
0 votes
2 answers
29 views

Paired t-test with redundant data

As part of my work I've gathered biological data for a set of (n=3) mice under two conditions ~ treatment and control. Since there is some inherent variability in behavioral research, I collected data ...
Brian Constantinescu's user avatar
4 votes
3 answers
723 views

What are several examples of survey questions which have response options designed as mutually exclusive when they are not?

Statisticians and Data Analysts sometimes draw conclusions from surveys given to people. Often times, there is a question, and there are 2 to 5 options to choose from if you are a survey respondent. ...
13 votes
2 answers
339 views

The probability of making a Type S error, and the average amount of magnification (type M error) as a function of power

When you filter on only viewing results with p<alpha, some of those "statistically significant" results go in the wrong direction. This is called a Type S error ("S" for sign). ...
Harvey Motulsky's user avatar
0 votes
0 answers
17 views

missing data without baseline characteristics measurements in one survey data

Suppose I obtained two survey data $D_1,D_2$. (I did not design surveys and I am told to conduct analysis. The survey sample is not a probability sample but a "census" of convenient sampling....
user45765's user avatar
  • 1,445
2 votes
1 answer
85 views

Post-stratification with missing subpopulations in the survey

I have some survey data on a population described by age, gender, and weight. It’s quite skewed so I want to reweight it to a known target population (a larger ...
cgreen's user avatar
  • 1,002
1 vote
0 answers
78 views

How to compare AI model with other models for research purposes

If I have X and Y datasets, I will apply meta-learning few-shot-learning by training the model on the X dataset and applying meta-testing using the Y dataset. While I compare my result with other ...
AMAS AL's user avatar
  • 33
0 votes
1 answer
29 views

Assessing the Validity of Conclusions Based on Limited Findings

Introduction: Archaeological research often involves drawing conclusions about past societies and cultures based on a limited number of artifacts or findings. In some cases, such as the study of ...
Yanirmr's user avatar
  • 101
1 vote
1 answer
26 views

Right way of comparing my model's result with state of the arts

I know that I have to use the same datasets and experimental settings. In this way, I don't have to run their codes. What if I used different datasets? Is it OK to use their code from GitHub to get ...
AMAS AL's user avatar
  • 33
0 votes
1 answer
88 views

Difference-in-difference with border areas: how to create indicator for matched area?

I'm trying a DiD by comparing adjacent districts which lie on two sides of state border, before and after a policy. The scheme is following: state A introduced a policy in year t, while state B (...
Jan3's user avatar
  • 1
0 votes
0 answers
20 views

obtaining the unit of observation for critical review of a research design

Hi I am writing a critical review for one of my assignments, and I am struggling to extract the unit of observation. I have written a critical review for one of my assessments at university which is a ...
Lisa's user avatar
  • 11
1 vote
0 answers
51 views

Analysis with data from different sources

I have data from 3 different sources, measuring different variables for different samples taken from the same population (a country). All of the data is from country-wide studies and should be ...
ouroboro's user avatar
0 votes
0 answers
21 views

Selecting correct study design and statistical analysis for my project

I am analyzing risk factors associated with surgical site infections where we want to have a 3:1 case-control study. Other than some brief lectures in my classes, the only thing we were taught about ...
Zaichik's user avatar
1 vote
0 answers
11 views

Disproportionate stratified sampling that follows proportional trend?

I'm conducting a study across four counties to determine which of four different methods is most effective in detecting nutria. 60 sites will be randomly selected within a 5-meter buffer of any open ...
dwhip's user avatar
  • 11
1 vote
0 answers
37 views

Can paired t-test be used when data comes from different task conditions at a single time point?

In my experiment a single group of participants performed a cognitive task with two interleaved types of blocks (A and B). Blocks A and B differed in terms of the type of stimuli used but were ...
PSchul's user avatar
  • 11
3 votes
1 answer
204 views

Is multivariate ordinal regression suitable for my reserach?

I want to test what leads to the support for two policies (Likert scale ß disagree to strongly agree). There are independent variables, some of which are demographic and two are of interest (...
Lia's user avatar
  • 31
0 votes
0 answers
31 views

Example studies that use inferences from cross-validation of the entire dataset

I am performing a study where I perform inferences based on cross-validation metrics that use the entire dataset. My reasoning behind this is (a) my dataset is small and imbalanced and (b) this is ...
Adam_G's user avatar
  • 371
2 votes
1 answer
40 views

Is a mixed-model really required?

I've got data from a retrospective cohort analysis. There are two groups that differ by a certain baseline characteristic, who were all exposed to an event (surgical procedures). The outcome of ...
biostatsjunior's user avatar
0 votes
0 answers
77 views

Wilcoxon Signed-Rank Test N>300

There were similar questions here but as a person with little knowledge about statistics I couldn't understand any of it. I was looking for critical value tables that reached up to to higher amounts ...
Jamal Kareem's user avatar
0 votes
1 answer
94 views

Questions Regarding Sampling Bias

I'm taking a course in R: "Data Analysis in R" on Coursera, and I came across this question during the lecture: A retail store considering updates to their credit card policies randomly ...
JackJackAttack0214's user avatar
1 vote
0 answers
32 views

Advice on study design involving longitudinal clusters and measurements

I'm conducting an analysis on several hundred thousand individuals to understand if there are longitudinal differences in an outcome across clusters of the individuals. My outcome is healthcare cost (...
stats134711's user avatar