Questions tagged [research-design]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
0answers
29 views

Can my two Independent variables overlap? [closed]

brand A brand B utilitarian goods Product 1 Product 2 Hedonic goods Product 3 Product 4 Can I use (product 1 NO. per transaction +...
0
votes
0answers
14 views

Experimental, Control and Waitlist Control analysis - treating waitlist control as 2 groups: experiment and control?

I have a 2.5 month intervention program that I would like to test. I have 30 experimental subjects, 30 control subjects and 30 waitlist control subjects. For experimental subjects, data were ...
1
vote
0answers
25 views

Sample Obtained is it Random Sample?

I feel embarrassed but I am confused with the below question. An interviewer plans to stand at an entrance to a popular shopping mall and conduct interviews. $$$$Is the below statement true? $$$$ ...
0
votes
0answers
15 views

Beginner questions about mediation analysis in psych intervention (2 intervention + 2 mediator system)

I am studying, and am fairly new to research methods and design, and hence hope to get some guidance on my analysis plan. I have 3 questions here, and attaching a structural model as reference. ...
1
vote
1answer
31 views

Imputing missing data using testing data

My supervisor has instructed another person in my lab to use both training and testing data to impute missing values for use building a machine learning model. The results of the analysis haven't ...
1
vote
3answers
38 views

In a RCT, what are the risk of selection bias if no allocation bias is present?

In the Wikipedia page about Randomized Controlled Trials (RCT), the procedures section states that RCT minimize selection bias and allocation bias. My understanding is that selection bias "occur ...
2
votes
1answer
17 views

What is a "split-body" RCT?

I am reading the RCT Wikipedia page, in particular the classification by study design. There are described four types of RCT: (i) parallel groups (ii) crossover (iii) cluster (iv) factorial. Then ...
4
votes
1answer
71 views

Latent Profile Analysis and Statistical Methods in Psychology

There has been a popular phenomenon that has several ‘hallmark’ components, and are uniquely associated with sexual abuse survivors. I would like to verify that the components can stand as a construct,...
0
votes
0answers
17 views

How many types of randomization are there? And how they each dealt with in the experiment's design or statistical analysis?

I am trying to understand randomization in experiment design, and am very confused, because there appear to be several types of randomization possible. For example, for a Categorical Factor with Non-...
0
votes
0answers
36 views

What is the correct analysis for this case? [duplicate]

My research question examines the best delivery time to give out instructions. My data consists of 3 conditions: receive instructions at the beginning receive instructions halfway through the task ...
0
votes
0answers
4 views

Handling existing groups with different instructors for analysis between two teaching modalities for the same course

I am working on a quasi-experimental research study. The study aims to see if there is a difference between student scores on clinical skills between a skills course that is taught in two different ...
0
votes
1answer
60 views

Prospective study and ascertainment of the exposure during the follow-up period

This question landed here after two migration requests from "Medical Sciences" and "Operations Research" I'm reading several prospective studies published in top journals where a ...
0
votes
0answers
47 views

Cluster regression

I have a dataset and divided the sample into 6 groups based on 4 binary criteria (e.g. "1" for has a Chief Digital Officer and "0" otherwise). Now I want to conduct a regression of ...
1
vote
1answer
45 views

Can this additional data improve the validity of Difference-in-Differences estimate

I am aiming to measure the impact of a treatment (a marketing stimulus) on product revenue. The data has resulted from a natural experiment. The set-up is tabulated below. Cells in the table indicate ...
0
votes
0answers
16 views

Do hierarchical linear models (HLM) require random samples?

Excuse me if this is a naive question, but do hierarchical linear models require data collected from random samples? I ask because most of the literature I find on this topic does a poor job of ...
0
votes
0answers
4 views

When performing randomisation tests on my single-case design data, do I include all participants?

I have just completed a single-case, multiple baseline design study with 5 participants. I was planning to perform visual analysis and randomisation tests (RT). However, 2 participants have >50% ...
0
votes
0answers
17 views

Is this a valid method to test textual difference?

For some research I am trying to reject/ not-reject the null-hypothesis that the proportion of a word is higher in a certain sample of a text than in the rest of the text. The full text is a ...
0
votes
0answers
5 views

Advice on how to analyze effectiveness of two categorizations of the same data set

I have a set of samples that were categorized based on two different sets criteria. (Low vs High), and (Mild, Moderate, Severe). These categories are supposed to predict the likelihood of becoming ...
1
vote
0answers
10 views

Statistical Responses/tests for Yes/No, Pre/Post surveys

I am completing a research paper regarding clinician adherence to a protocol. One of the questions is whether or not they use adjuctive therapy to the treatment. I have a pre and post survey, yes/no ...
0
votes
0answers
9 views

Power analysis for anova when one set of comparisons is particularly of interest

I've been messing around with how to perform a power analysis for an experiment with three groups: control, disease model, and disease model + treatment. From past studies I have a good estimate of ...
1
vote
1answer
274 views

Is a three-way fixed effects model equivalent to a triple difference estimator?

I have a conceptual question about the fixed effects model and the difference-in-differences (DD) estimator. Since a two-way fixed effects model is equivalent to a DD estimator, I was wondering if ...
2
votes
1answer
51 views

Does 'proper' experimental design, in terms of ensuring scientific validity, require that the same skilled individual perform all of the measurements?

I'm not sure if this is on-topic here. If not, then please tell me and I'll delete it. I have a question about the proper way to design biomedical experiments that involve human-administered ...
0
votes
0answers
12 views

Questionnaire design taking into account info from an older questionnaire

5 years ago, we designed a questionnaire with 300+ questions and we got responses from 1400 people, all of them from the same country. We then applied a PCA in order to reduce the dimensionality. We ...
3
votes
0answers
25 views

To what degree does reproducibility of research differ across disciplines?

Have there been any statistics meta studies that compare the reproducibility of results, as well as the willingness of researchers to provide reproducible data, analysis, and code, in their studies ...
1
vote
0answers
24 views

Conceptual framework for predicting customer probability of changing to online purchases

I'm likely to be tasked to create a predictive model for predicting if our customers will start using our online store. I have 2 frameworks to do it. I'm pretty certain of one framework and very ...
0
votes
1answer
35 views

measurement error in categorical dependent variable

Let's just say that in my field several studies find some significant associations between a variety of CEO attributes and some organizational policy (binary categorical dependent variable). Many use ...
0
votes
1answer
35 views

What is the right machine learning research methodology to compare two neural network approaches against eachother?

I am new to machine learning research, and I have a general question regarding how to compare different models on the same data set. How does a top researcher do this, and what is expected from a ...
1
vote
0answers
35 views

Ablation Study training until when?

Given that deep learning models can take weeks to train, having to train 20 different models becomes infeasible when performing an ablation study. Are there some formally accepted common practices on ...
0
votes
0answers
14 views

How to test whether group membership type 1 predicts group membership type 2?

I am planning an experiment in which I will categorize participants into groups based on performance on two tasks. Based on task 1, participants will be categorized into a "high performer" ...
0
votes
0answers
29 views

Relating Temp / Size / Time to Mortality Rates from Catch and Release Fishing

I am conducting a fish catch and release mortality study and have hit a wall with the statistics portion of my report and could use a nudge in the right direction. I am trying to relate a few ...
0
votes
1answer
31 views

Is it possible to do correlational analyses on unmatched data? Trying to understand a research paper

My stats knowledge is average but not great, so I apologise if this is something I just haven't come across before. Basically, I've just read a paper which seems to state that it has conducted ...
2
votes
1answer
35 views

How to tell if one value is different from another?

I have a dataframe made up of counts in different time periods as so: ...
0
votes
0answers
6 views

Number of Tests necessary for object detection (test/experiment design)

I want to find out the number of tests necessary to validate certain performance characteristics of an object detection system with a certain confidence. The system just detects if a relevant object ...
2
votes
0answers
84 views

Imposing a distribution on a dependent variable to increase variation in the dependent variable - disaggregating data

The question I have essentially has to do with dis-aggregating data, based on a known distribution of the data with respect to a certain variable. It has some resemblances with post-stratification, ...
0
votes
0answers
10 views

Comparing rates of hospital admissions or refusal rates year against year

I am trying to design a study for introducing a treatment and seeing if this would change rates of admission or leaving the hospital against medical advice. I would compare Jan-Dec 2020 (no tx offered)...
1
vote
0answers
17 views

What statistical analysis should I use for this proposed study?

The aim of this study is to determine the impacts of monolingualism and bilingualism on the literacy skills of primary aged children with ASD. This experiment is a between subject’s design as it will ...
3
votes
1answer
44 views

Crossing Frequentism and Bayesian Analysis

Has anyone considered giving the posteriors of an analysis a sampling distribution and seeing where, methodologically, things could go from there? For details, check out: https://sdba-stats.weebly.com
3
votes
1answer
23 views

Evaluate change in participant population characteristics

The Project I'm doing an analysis concerning a major drop in service uptake since the beginning of COVID. I have access to administrative data for those using services, including relevant demographic ...
2
votes
1answer
36 views

Bayesian design for a small sample and how to include informed priors

I am new to Bayesian approaches so thank you in advance for your patience. I am looking to investigate the influence of a specific type of brain lesion on the lateralization of verbal memory in a data ...
0
votes
0answers
23 views

What is the appropriate way to analyze data subsetted into bins and compare those bins across conditions?

I am wondering how to approach the analysis of a data set that I've obtained. I have animal trajectories moving toward a target under multiple experimental conditions. One of my analyses was to look ...
1
vote
0answers
24 views

Are these the major response variable types?

I am a biologist with an interest in experiment design. I recently refreshed my memory about what kinds of response variables that are possible, and made this chart (see jpeg). I would like feedback ...
2
votes
2answers
78 views

How to do meta-analysis of diagnostic tests with only sensitivity and specificity?

I am a junior physician, and I've run into some problems with the meta-analysis of diagnostic tests and I was hoping to get some input. Some background: Aside from my undergraduate statistics courses ...
1
vote
0answers
19 views

Research area about - Forecasting time series with added items

I'm wondering is there any time series research area about the change of forecasting with added items. For example, in the prototype below, when we check each recommended item, the forecast about ...
1
vote
0answers
50 views

Would a repeated measures MANOVA be appropriate for a 9DV, 2IV within subjects study design?

I am trying to get an estimate of participants to strive for in my study. Being rather new to the research and stats scene, I was hoping the community could help me out a little bit? The study has 9 ...
1
vote
1answer
251 views

Real noise modeling/ noise map generation (image processing, deep learning)

I am working on a project with really noisy images. I have trained a detector that can detect the characters but fails in some cases (noise is high). So far I have gone through many denoising, ...
0
votes
1answer
53 views

Why linear regression is widely adopted given its (sometimes) poor prediction

Linear regressions are in nearly every paper I've read. The authors always model the response variable as a linear combination of independent variables without regards to how the data is actually ...
0
votes
1answer
407 views

Formulating Null and Alternative Hypotheses in a Regression Model

I have a simple question regarding formulating research null and alternative hypotheses in a simple econometric regression model. In my research Hypothesis, I expect X to negatively affect Y (from ...
0
votes
1answer
9 views

Statistical test for change in traffic flow at border crossing point

I have an assignment, where I'm supposed to measure whether an intervention at a border crossing point will an effect on the traffic flow. We have a total of 7 border crossing points and we ...
1
vote
2answers
38 views

What to do when there’s no statistical test for this type of data?

I am looking at the effects of resistance to a drug intended to increase serotonin levels on the course of depression. Basically, every participant (N=20) takes a pre measurement of serotonin levels (...
2
votes
1answer
15 views

Combining results of two studies due to incomplete data

I am doing a study looking at the effects of a certain virus in rats. We are looking at certain concentrations of bio markers in the blood. I came into this project part way through and no power ...