Questions tagged [research-design]

Methods and tips for designing and conducting effective research.

78 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
4 votes
1 answer
294 views

Ablation Study training until when?

Given that deep learning models can take weeks to train, having to train 20 different models becomes infeasible when performing an ablation study. Are there some formally accepted common practices on ...
iordanis's user avatar
  • 485
3 votes
0 answers
40 views

To what degree does reproducibility of research differ across disciplines?

Have there been any statistics meta studies that compare the reproducibility of results, as well as the willingness of researchers to provide reproducible data, analysis, and code, in their studies ...
stevec's user avatar
  • 303
2 votes
0 answers
17 views

Evaluation/Analysis design advice

This is industry related stuff, so I'm not thrilled about being in this position and could just use any helpful other opinions. My company has a program where we provide extra dollars to a hospital to ...
Bobby Thomas's user avatar
2 votes
1 answer
129 views

Is multivariate ordinal regression suitable for my reserach?

I want to test what leads to the support for two policies (Likert scale ß disagree to strongly agree). There are independent variables, some of which are demographic and two are of interest (...
Lia's user avatar
  • 21
2 votes
0 answers
75 views

How to deal with ragged power curve

I am exploring various methods for sample size calculation and power analysis from binomial data, and frequently coming up against ragged power curves that go up and down as sample size increases. I ...
bobverity's user avatar
  • 381
2 votes
1 answer
68 views

In clinical trials, why do we not always use Equivalence trials instead of superiority and non-inferiorty?

So I understand what these three types are aimed for, I know they answer different questions. However, why wouldn't we always use equivalence trials? I mean if for example were are comparing two drugs ...
Ammar Aldawoodyeh's user avatar
2 votes
0 answers
91 views

Imposing a distribution on a dependent variable to increase variation in the dependent variable - disaggregating data

The question I have essentially has to do with dis-aggregating data, based on a known distribution of the data with respect to a certain variable. It has some resemblances with post-stratification, ...
Tom's user avatar
  • 448
2 votes
0 answers
51 views

What is the appropriate analysis for this type of repeated measures multi-binary data?

There is a popular theory within psychology that certain emotions will trigger "prototypical" facial expressions defined by the simultaneous contraction of specific facial muscles. For example, if a ...
Jeffrey Girard's user avatar
2 votes
0 answers
214 views

Variables common to all individuals in a panel

I have been tasked with evaluating the efficiency of different marketing tools for a microfinance bank. I have a panel of seven individuals (seven districts of Tajikistan) over 17 months. Dependent ...
Matthew B.F.'s user avatar
1 vote
0 answers
11 views

Statistical models for simultaneous study designs

I have thinking about a problem that can be encountered in environmental epidemiology, but I guess in other research fields too. Background: In environmental epidemiology the interest is mostly to ...
jmarkov's user avatar
  • 683
1 vote
0 answers
29 views

Medication switching in pregnancy

My study design seeks to answer the following question: What are the potential risks of switching medications from pre-pregnancy to pregnancy for (1) individuals who switch from medication A to B; (2) ...
Ashley's user avatar
  • 11
1 vote
0 answers
51 views

In R, how to analyze Strip-Plot Design when there are three factors?

I have one dataset like below ...
Jin.w.Kim's user avatar
  • 143
1 vote
0 answers
23 views

Choosing the right analysis for DAG - Which quasi-experimental alternative to instrumental variables?

I am writing a statistical analysis plan for a project but I am having difficulties finding the best analysis to answer my question. I am working with the conceptual framework below: There is likely ...
EpiMarie's user avatar
1 vote
0 answers
14 views

How to design study to predict development of a condition B given a condition A

Overall aim: I have patients with a very common condition and I want to see if it is significantly associated with a reduction in a certain type of cancer between 6 months to 5 years later when ...
Sebastian Zeki's user avatar
1 vote
0 answers
72 views

How to compare AI model with other models for research purposes

If I have X and Y datasets, I will apply meta-learning few-shot-learning by training the model on the X dataset and applying meta-testing using the Y dataset. While I compare my result with other ...
AMAS AL's user avatar
  • 33
1 vote
0 answers
49 views

Analysis with data from different sources

I have data from 3 different sources, measuring different variables for different samples taken from the same population (a country). All of the data is from country-wide studies and should be ...
ouroboro's user avatar
1 vote
0 answers
11 views

Disproportionate stratified sampling that follows proportional trend?

I'm conducting a study across four counties to determine which of four different methods is most effective in detecting nutria. 60 sites will be randomly selected within a 5-meter buffer of any open ...
dwhip's user avatar
  • 11
1 vote
0 answers
37 views

Can paired t-test be used when data comes from different task conditions at a single time point?

In my experiment a single group of participants performed a cognitive task with two interleaved types of blocks (A and B). Blocks A and B differed in terms of the type of stimuli used but were ...
PSchul's user avatar
  • 11
1 vote
0 answers
31 views

Advice on study design involving longitudinal clusters and measurements

I'm conducting an analysis on several hundred thousand individuals to understand if there are longitudinal differences in an outcome across clusters of the individuals. My outcome is healthcare cost (...
stats134711's user avatar
1 vote
0 answers
18 views

Examples of statistical research affected by errors in package/library code

I can't figure out if this belongs in Cross Validated, Stack Overflow, or Academia, but I think this may be a good place to start: Can anyone suggest examples of published prospective/retrospective/...
1 vote
0 answers
18 views

Effect size and statistical significance correspondence

While I understand that it is possible to have a small effect size with statistical significance and a large effect size without statistical significance, is it ever possible to find this across two ...
user359198's user avatar
1 vote
0 answers
106 views

Ordinal Regression - Using a Continuous Attribute of 3 Categories as a Covariate as a Proxy for the Categories

I'm conducting an ordinal regression with SPSS 28. I have 3 subsets in my data (n=87 total, mostly equally distributed between the subsets) that represent 3 different scenarios where study ...
Meow_ly's user avatar
  • 73
1 vote
1 answer
51 views

In a 2-Factor Repeated Measures design, Why do the ANOVA Expected Mean Squares have the values that they do?

I am studying experiment design, and I am trying to understand why certain designs have the Expected Mean Squares that they do. Today, I want to ask about a particular design: the 2-Factor Repeated ...
Chris Science's user avatar
1 vote
0 answers
301 views

Using Pearson Moment Correlation For Establishing Validity Between Two Questionnaires

I'm moderately new to psychometrics and test design, and I'm currently in the process of attempting to develop a questionnaire that measures soft skills (communication, collaboration, work ethic, ...
Jace's user avatar
  • 11
1 vote
0 answers
130 views

How to call this experiment research design?

I am doing research in user interface design. I will conduct a user study where the participants will have to give label to a sentence(positive or negative sentiment). To label sentences, the user ...
rickyfajrin93's user avatar
1 vote
0 answers
167 views

Sample Obtained is it Random Sample?

I feel embarrassed but I am confused with the below question. An interviewer plans to stand at an entrance to a popular shopping mall and conduct interviews. $$$$Is the below statement true? $$$$ ...
Mia's user avatar
  • 221
1 vote
0 answers
54 views

How many types of randomization are there? And how they each dealt with in the experiment's design or statistical analysis?

I am trying to understand randomization in experiment design, and am very confused, because there appear to be several types of randomization possible. For example, for a Categorical Factor with Non-...
Chris Science's user avatar
1 vote
0 answers
30 views

Statistical Responses/tests for Yes/No, Pre/Post surveys

I am completing a research paper regarding clinician adherence to a protocol. One of the questions is whether or not they use adjuctive therapy to the treatment. I have a pre and post survey, yes/no ...
Hayden Kleinhenz's user avatar
1 vote
0 answers
34 views

Conceptual framework for predicting customer probability of changing to online purchases

I'm likely to be tasked to create a predictive model for predicting if our customers will start using our online store. I have 2 frameworks to do it. I'm pretty certain of one framework and very ...
Anssi Kiesi's user avatar
1 vote
0 answers
20 views

What statistical analysis should I use for this proposed study?

The aim of this study is to determine the impacts of monolingualism and bilingualism on the literacy skills of primary aged children with ASD. This experiment is a between subject’s design as it will ...
Milly's user avatar
  • 11
1 vote
0 answers
34 views

Are these the major response variable types?

I am a biologist with an interest in experiment design. I recently refreshed my memory about what kinds of response variables that are possible, and made this chart (see jpeg). I would like feedback ...
Chris Science's user avatar
1 vote
0 answers
27 views

Research area about - Forecasting time series with added items

I'm wondering is there any time series research area about the change of forecasting with added items. For example, in the prototype below, when we check each recommended item, the forecast about ...
Cherry Wu's user avatar
  • 331
1 vote
0 answers
67 views

Would a repeated measures MANOVA be appropriate for a 9DV, 2IV within subjects study design?

I am trying to get an estimate of participants to strive for in my study. Being rather new to the research and stats scene, I was hoping the community could help me out a little bit? The study has 9 ...
sc4s2cg's user avatar
  • 11
1 vote
0 answers
34 views

Is causal relationship between two variables a theory?

I was asked if Y causes Z a theory, and I noticed that I have a gap in my knowledge on that. I know that theory could be causal, descriptive or predictive in its explanation. However, a theory is an ...
afarensis's user avatar
1 vote
0 answers
27 views

How to correctly plan for Missing Data in Longitudinal / Repeated Measures Design?

Using an hierarchical questionnaire for a longitudinal study, I face strict constrains in how many items can be processed by each subject per week. The questionnaire contains 51 Items in total, but ...
Comfort Eagle's user avatar
1 vote
0 answers
41 views

How to measure the difference between the results of 2 T-tests?

For some context, I am currently trying to come up with the right type of research methodology for my masters in education and my thesis is basically comparing the difference between performances of ...
Lysium's user avatar
  • 11
1 vote
0 answers
93 views

should I resample/downsample the patients in the control arms?

I have retrospectively collected clinical data of two sets of patients, one set with the diagnosis of tumor A (group A) and the other with tumor B (group B). There're 90 patients in group A, and 1100 ...
Daniel Yan's user avatar
1 vote
1 answer
118 views

Biological replicates

We are currently doing an screening where supernatans from a bacteria genus are tested againts a pathogenic bacteria cell culture in a 96-well plate where OD is measured each 2 hours. Each ...
Neuls's user avatar
  • 25
1 vote
0 answers
58 views

How to study the separate effect of a variable?

Suppose I have a relationship between 3 variables: A = B + C and that I know that B and C are related with an other variable D that has opposite effect on B and C: Increasing D will increase B but ...
Ste's user avatar
  • 41
0 votes
0 answers
14 views

Good way to select reference and/or performing normalization of data points across experiments?

I have a set of objects S1 = {a1, b1, c1, d1, ..., z1} that perturbed a reference object q and were tested for effects in ...
neo4k's user avatar
  • 1
0 votes
0 answers
6 views

(Quantitative) research methods for collocation analysis in corpus linguistics?

I am trying to conduct a collocation analysis. This is a corpus linguistics research, doing so require me to test statistical significance using Mutual Information, as well as frequency normalization ...
pindakazen's user avatar
0 votes
0 answers
81 views

How to make the case for a parallel trends assumption in a within-person DiD with 1 pre-treatment time point 1 post-treatment time point?

Study design: Within a two-year period (2021-2022), both the people in the treatment group and the people in the control group did not receive the treatment of interest at time point #1, and only the ...
Ray's user avatar
  • 11
0 votes
0 answers
28 views

What statistical test should I use to assess changes in Likert scale over 3 points in time?

I had a group of participants that provided responses to a 7-point Likert scale question at 3 points in time (baseline, immediately after a course, and 1 year after the course). What statistical test ...
Shane's user avatar
  • 1
0 votes
0 answers
33 views

Can I use the same regressors for Instrumental variables and the outcome variable?

I'm reading a research paper that uses an IV, they regress A, and B, to estimate C, then they use estimated C and actual B to regress on D an outcome variable. This seems to violate the only through ...
Ahhhhhhhhh's user avatar
0 votes
0 answers
23 views

Does my study design have randomization issues?

I am helping to design a study where participants will be randomized to one of three arms -- a control arm, treatment 1 or treatment 2. Within each arm, they will then also receive either no ...
Jay Bee's user avatar
  • 101
0 votes
0 answers
71 views

How should I design an exercise study?

I want to design a study to investigate the efficacy of a specific training protocol. I have 20 subjects. All of the subjects will complete an initial test of a physical exercise to failure. The ...
Self student's user avatar
0 votes
0 answers
55 views

What type of design is this experiment? 3x2x2 Factorial design?

I am running an experiment to find out if the pattern of expected and actual guilt people feel when making and not making a purchase is dependent on proximity to their payday (e.g. do people expect/...
user161652's user avatar
0 votes
0 answers
8 views

Can all random effects design matrices accept collinear columns?

I am curious about how the random effects design matrix works, within a mixed model. I know that the columns of a random effects design matrix are allowed to be collinear with each other, but I am ...
Chris Science's user avatar
0 votes
0 answers
31 views

Would it be appropriate to inspect the mean inter-item correlation for an ordinal scale?

I'm analyzing the data from a questionnaire using ordinal scales with five response options (Strongly Agree to Strongly Disagree). I'm conducting my analysis using R, and have recoded the item ...
Darko's user avatar
  • 43
0 votes
0 answers
17 views

missing data without baseline characteristics measurements in one survey data

Suppose I obtained two survey data $D_1,D_2$. (I did not design surveys and I am told to conduct analysis. The survey sample is not a probability sample but a "census" of convenient sampling....
user45765's user avatar
  • 1,406