Questions tagged [reproducible-research]

Research practice of making full experimental description, entire collected data, and all the data analysis scripts publicly available, so that the published results can be reproduced elsewhere.

17 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
3
votes
0answers
48 views

Has the reproducibility crisis affected confidence intervals as well?

The reproducibility crisis has given many pause over the value (?) of $p$-values to measure the relevance of statistical findings. Given the interpretation of a $p$-value and some knowledge of ...
2
votes
0answers
61 views

Put Together Results from GLM Gamma Models

I have a set of healthcare data in which I used GLM Gamma to model the healthcare spending. Then I am trying to put together the results in a style that is similar to this: http://onlinelibrary.wiley....
2
votes
0answers
93 views

How to organise an iterative manual rotation of n component pairs?

I am currently building a q.rotate() function for the qmethod R package for Q Methodology. As is desirable for Q, I'd like users to be able to iteratively rotate ...
1
vote
0answers
14 views

How to determine statistical significance of physics dataset?

I am working on a physics paper, which looks at the dependence of resistivity on physical temperature. I obtained data showing a linear trend of the form $$\rho(T)=\rho_0[1+\alpha(T-T_0)]$$ Based on ...
1
vote
0answers
38 views

Replicating a wrong analysis

A study measures the performance of patients and controls in two tasks. In task 1, a t-test reveals no significant differences between patients and controls. In task 2, a t-test reveals significant ...
1
vote
0answers
87 views

Two samples t-test and ANOVA

B) When doing a two way ANOVA After calculating the sum of squares column(between), the sum of squares error(within), and the sum of squares block. 1. Are there any other sum of squares? 2. What is ...
1
vote
1answer
62 views

Sample size for clinical research

I determined the sample size already (25), but I want to know if it has to be increased because of a minor change. Our study consists of two groups - one will be sedated and the other will not. For ...
0
votes
0answers
18 views

Research on neural networks mimicking behavior

My question is regarding neural networks mimicking noise specifically. The idea is to have a clinically clean image generated by a ray tracer and a neural network (type does not matter) that is ...
0
votes
0answers
20 views

R - Making legit RandomForest results reproducible with set.seed

I guess that my question is kinda weird but: I'm working on a university project where I have to use a RandomForest model to predict if patients have depressive tendencies. And while I'm getting ...
0
votes
0answers
25 views

Repeatability and Reproducibility Coefficients of Variation

I sometimes see in papers report Repeatability CVs% and Reproducibility CV%. Sometimes its described as within-group CV% and between-group CV%. But in papers I've seen these calculated multiple ...
0
votes
0answers
21 views

Setting seeds despite repeated training of CNNs?

I would like to compare the classification performance (like accuracy, precision, recall etc.) of different CNN architectures. I'm using Google Colab (GPU support), Tensorflow and Keras. Since it is ...
0
votes
0answers
57 views

How to plot the EOC of a Non Linear Activati

I was trying to replicate this plot as shown in the paper: https://arxiv.org/abs/1802.09979 The plot: The paper describes the formulation of how to obtain this graph for a non-linear activation ...
0
votes
0answers
39 views

Does a high negative concordance imply reproducible features

Does a high negative(-1) Lin's concordance correlation coefficient(Lins CCC) imply reproducible features ? I am calculating Lin's CCC of radiomic features between two different CT scan settings , ...
0
votes
0answers
7 views

Comparing treatment outcomes

I am a statistics noob, my field is medicine, so I'm hoping someone can help me with this: I came across the following problem: "Researchers found that at the end of a 5-year study, 34% of the ...
0
votes
0answers
25 views

Use Deep learning or RL to maximize long term hit in caching file?

Suppose I have F video files with different file size and with different popularity. I have a memory cache of fixed size. What I have to do is following: I want to cache n files (n < F) in ...
0
votes
0answers
124 views

Calculate Cronbach's alpha for three observers

I have a dataset which contains 100 observations, and I asked three expert to describe each observation by one of the letters {A,B,C}. The following three tables shows a sample of the dataset with the ...
0
votes
1answer
117 views

How to calculate Cronbach's alpha

For my dissertation I am observing horse race videos to see if horses are right or left handed. In flat races where the horse comes out of the starting stalls I observe which leg (right or left) they ...