Questions tagged [research-design]
Methods and tips for designing and conducting effective research.
78
questions with no upvoted or accepted answers
4
votes
1
answer
294
views
Ablation Study training until when?
Given that deep learning models can take weeks to train, having to train 20 different models becomes infeasible when performing an ablation study. Are there some formally accepted common practices on ...
3
votes
0
answers
40
views
To what degree does reproducibility of research differ across disciplines?
Have there been any statistics meta studies that compare the reproducibility of results, as well as the willingness of researchers to provide reproducible data, analysis, and code, in their studies ...
2
votes
0
answers
17
views
Evaluation/Analysis design advice
This is industry related stuff, so I'm not thrilled about being in this position and could just use any helpful other opinions.
My company has a program where we provide extra dollars to a hospital to ...
2
votes
1
answer
129
views
Is multivariate ordinal regression suitable for my reserach?
I want to test what leads to the support for two policies (Likert scale ß disagree to strongly agree). There are independent variables, some of which are demographic and two are of interest (...
2
votes
0
answers
75
views
How to deal with ragged power curve
I am exploring various methods for sample size calculation and power analysis from binomial data, and frequently coming up against ragged power curves that go up and down as sample size increases. I ...
2
votes
1
answer
68
views
In clinical trials, why do we not always use Equivalence trials instead of superiority and non-inferiorty?
So I understand what these three types are aimed for, I know they answer different questions. However, why wouldn't we always use equivalence trials? I mean if for example were are comparing two drugs ...
2
votes
0
answers
91
views
Imposing a distribution on a dependent variable to increase variation in the dependent variable - disaggregating data
The question I have essentially has to do with dis-aggregating data, based on a known distribution of the data with respect to a certain variable. It has some resemblances with post-stratification, ...
2
votes
0
answers
51
views
What is the appropriate analysis for this type of repeated measures multi-binary data?
There is a popular theory within psychology that certain emotions will trigger "prototypical" facial expressions defined by the simultaneous contraction of specific facial muscles. For example, if a ...
2
votes
0
answers
214
views
Variables common to all individuals in a panel
I have been tasked with evaluating the efficiency of different marketing tools for a microfinance bank.
I have a panel of seven individuals (seven districts of Tajikistan) over 17 months.
Dependent ...
1
vote
0
answers
11
views
Statistical models for simultaneous study designs
I have thinking about a problem that can be encountered in environmental epidemiology, but I guess in other research fields too.
Background: In environmental epidemiology the interest is mostly to ...
1
vote
0
answers
29
views
Medication switching in pregnancy
My study design seeks to answer the following question: What are the potential risks of switching medications from pre-pregnancy to pregnancy for
(1) individuals who switch from medication A to B;
(2) ...
1
vote
0
answers
51
views
In R, how to analyze Strip-Plot Design when there are three factors?
I have one dataset like below
...
1
vote
0
answers
23
views
Choosing the right analysis for DAG - Which quasi-experimental alternative to instrumental variables?
I am writing a statistical analysis plan for a project but I am having difficulties finding the best analysis to answer my question.
I am working with the conceptual framework below:
There is likely ...
1
vote
0
answers
14
views
How to design study to predict development of a condition B given a condition A
Overall aim:
I have patients with a very common condition and I want to see if it is significantly associated with a reduction in a certain type of cancer between 6 months to 5 years later when ...
1
vote
0
answers
72
views
How to compare AI model with other models for research purposes
If I have X and Y datasets, I will apply meta-learning few-shot-learning by training the model on the X dataset and applying meta-testing using the Y dataset. While I compare my result with other ...
1
vote
0
answers
49
views
Analysis with data from different sources
I have data from 3 different sources, measuring different variables for different samples taken from the same population (a country). All of the data is from country-wide studies and should be ...
1
vote
0
answers
11
views
Disproportionate stratified sampling that follows proportional trend?
I'm conducting a study across four counties to determine which of four different methods is most effective in detecting nutria. 60 sites will be randomly selected within a 5-meter buffer of any open ...
1
vote
0
answers
37
views
Can paired t-test be used when data comes from different task conditions at a single time point?
In my experiment a single group of participants performed a cognitive task with two interleaved types of blocks (A and B). Blocks A and B differed in terms of the type of stimuli used but were ...
1
vote
0
answers
31
views
Advice on study design involving longitudinal clusters and measurements
I'm conducting an analysis on several hundred thousand individuals to understand if there are longitudinal differences in an outcome across clusters of the individuals. My outcome is healthcare cost (...
1
vote
0
answers
18
views
Examples of statistical research affected by errors in package/library code
I can't figure out if this belongs in Cross Validated, Stack Overflow, or Academia, but I think this may be a good place to start:
Can anyone suggest examples of published prospective/retrospective/...
1
vote
0
answers
18
views
Effect size and statistical significance correspondence
While I understand that it is possible to have a small effect size with statistical significance and a large effect size without statistical significance, is it ever possible to find this across two ...
1
vote
0
answers
106
views
Ordinal Regression - Using a Continuous Attribute of 3 Categories as a Covariate as a Proxy for the Categories
I'm conducting an ordinal regression with SPSS 28. I have 3 subsets in my data (n=87 total, mostly equally distributed between the subsets) that represent 3 different scenarios where study ...
1
vote
1
answer
51
views
In a 2-Factor Repeated Measures design, Why do the ANOVA Expected Mean Squares have the values that they do?
I am studying experiment design, and I am trying to understand why certain designs have the Expected Mean Squares that they do. Today, I want to ask about a particular design: the 2-Factor Repeated ...
1
vote
0
answers
301
views
Using Pearson Moment Correlation For Establishing Validity Between Two Questionnaires
I'm moderately new to psychometrics and test design, and I'm currently in the process of attempting to develop a questionnaire that measures soft skills (communication, collaboration, work ethic, ...
1
vote
0
answers
130
views
How to call this experiment research design?
I am doing research in user interface design. I will conduct a user study where the participants will have to give label to a sentence(positive or negative sentiment). To label sentences, the user ...
1
vote
0
answers
167
views
Sample Obtained is it Random Sample?
I feel embarrassed but I am confused with the below question.
An interviewer plans to stand at an entrance to a popular shopping mall and conduct interviews.
$$$$Is the below statement true? $$$$
...
1
vote
0
answers
54
views
How many types of randomization are there? And how they each dealt with in the experiment's design or statistical analysis?
I am trying to understand randomization in experiment design, and am very confused, because there appear to be several types of randomization possible.
For example, for a Categorical Factor with Non-...
1
vote
0
answers
30
views
Statistical Responses/tests for Yes/No, Pre/Post surveys
I am completing a research paper regarding clinician adherence to a protocol. One of the questions is whether or not they use adjuctive therapy to the treatment. I have a pre and post survey, yes/no ...
1
vote
0
answers
34
views
Conceptual framework for predicting customer probability of changing to online purchases
I'm likely to be tasked to create a predictive model for predicting if our customers will start using our online store. I have 2 frameworks to do it. I'm pretty certain of one framework and very ...
1
vote
0
answers
20
views
What statistical analysis should I use for this proposed study?
The aim of this study is to determine the impacts of monolingualism and bilingualism on the literacy skills of primary aged children with ASD. This experiment is a between subject’s design as it will ...
1
vote
0
answers
34
views
Are these the major response variable types?
I am a biologist with an interest in experiment design. I recently refreshed my memory about what kinds of response variables that are possible, and made this chart (see jpeg). I would like feedback ...
1
vote
0
answers
27
views
Research area about - Forecasting time series with added items
I'm wondering is there any time series research area about the change of forecasting with added items.
For example, in the prototype below, when we check each recommended item, the forecast about ...
1
vote
0
answers
67
views
Would a repeated measures MANOVA be appropriate for a 9DV, 2IV within subjects study design?
I am trying to get an estimate of participants to strive for in my study. Being rather new to the research and stats scene, I was hoping the community could help me out a little bit?
The study has 9 ...
1
vote
0
answers
34
views
Is causal relationship between two variables a theory?
I was asked if Y causes Z a theory, and I noticed that I have a gap in my knowledge on that. I know that theory could be causal, descriptive or predictive in its explanation. However, a theory is an ...
1
vote
0
answers
27
views
How to correctly plan for Missing Data in Longitudinal / Repeated Measures Design?
Using an hierarchical questionnaire for a longitudinal study, I face strict constrains in how many items can be processed by each subject per week. The questionnaire contains 51 Items in total, but ...
1
vote
0
answers
41
views
How to measure the difference between the results of 2 T-tests?
For some context, I am currently trying to come up with the right type of research methodology for my masters in education and my thesis is basically comparing the difference between performances of ...
1
vote
0
answers
93
views
should I resample/downsample the patients in the control arms?
I have retrospectively collected clinical data of two sets of patients, one set with the diagnosis of tumor A (group A) and the other with tumor B (group B). There're 90 patients in group A, and 1100 ...
1
vote
1
answer
118
views
Biological replicates
We are currently doing an screening where supernatans from a bacteria genus are tested againts a pathogenic bacteria cell culture in a 96-well plate where OD is measured each 2 hours.
Each ...
1
vote
0
answers
58
views
How to study the separate effect of a variable?
Suppose I have a relationship between 3 variables:
A = B + C
and that I know that B and C are related with an other variable D that has opposite effect on B and C:
Increasing D will increase B but ...
0
votes
0
answers
14
views
Good way to select reference and/or performing normalization of data points across experiments?
I have a set of objects S1 = {a1, b1, c1, d1, ..., z1} that perturbed a reference object q and were tested for effects in ...
0
votes
0
answers
6
views
(Quantitative) research methods for collocation analysis in corpus linguistics?
I am trying to conduct a collocation analysis. This is a corpus linguistics research, doing so require me to test statistical significance using Mutual Information, as well as frequency normalization ...
0
votes
0
answers
81
views
How to make the case for a parallel trends assumption in a within-person DiD with 1 pre-treatment time point 1 post-treatment time point?
Study design:
Within a two-year period (2021-2022), both the people in the treatment group and the people in the control group did not receive the treatment of interest at time point #1, and only the ...
0
votes
0
answers
28
views
What statistical test should I use to assess changes in Likert scale over 3 points in time?
I had a group of participants that provided responses to a 7-point Likert scale question at 3 points in time (baseline, immediately after a course, and 1 year after the course). What statistical test ...
0
votes
0
answers
33
views
Can I use the same regressors for Instrumental variables and the outcome variable?
I'm reading a research paper that uses an IV, they regress A, and B, to estimate C, then they use estimated C and actual B to regress on D an outcome variable. This seems to violate the only through ...
0
votes
0
answers
23
views
Does my study design have randomization issues?
I am helping to design a study where participants will be randomized to one of three arms -- a control arm, treatment 1 or treatment 2.
Within each arm, they will then also receive either no ...
0
votes
0
answers
71
views
How should I design an exercise study?
I want to design a study to investigate the efficacy of a specific training protocol. I have 20 subjects. All of the subjects will complete an initial test of a physical exercise to failure. The ...
0
votes
0
answers
55
views
What type of design is this experiment? 3x2x2 Factorial design?
I am running an experiment to find out if the pattern of expected and actual guilt people feel when making and not making a purchase is dependent on proximity to their payday (e.g. do people expect/...
0
votes
0
answers
8
views
Can all random effects design matrices accept collinear columns?
I am curious about how the random effects design matrix works, within a mixed model.
I know that the columns of a random effects design matrix are allowed to be collinear with each other, but I am ...
0
votes
0
answers
31
views
Would it be appropriate to inspect the mean inter-item correlation for an ordinal scale?
I'm analyzing the data from a questionnaire using ordinal scales with five response options (Strongly Agree to Strongly Disagree).
I'm conducting my analysis using R, and have recoded the item ...
0
votes
0
answers
17
views
missing data without baseline characteristics measurements in one survey data
Suppose I obtained two survey data $D_1,D_2$. (I did not design surveys and I am told to conduct analysis. The survey sample is not a probability sample but a "census" of convenient sampling....