2
votes
1answer
70 views

How to compare two datasets using metrics drawn from unknown distributions and with small sample sizes?

I have two datasets consisting of metrics from several experiments. Dataset 1 is the collection of results of experiments E performed by user A on product A, repeated N times. Dataset 2 is the ...
1
vote
0answers
31 views

Do we need to apply the same transformation of predictors on a test dataset?

This maybe a stupid question. But I hope someone could help me. I first divide the dataset into training (75%) and test (25%). Then fit a logistic regression model on training data set. When fitting ...
0
votes
3answers
78 views

How to use LOF for outlier detection as I have training and test dataset?

I want to use the Local Outlier Factor (LOF) algorithm for outlier detection but it simply finds outliers on unlabed data as whole and you do not need to have a training and test set. However in my ...
5
votes
3answers
149 views

Statistical Test for Analyzing Practice Test Data

A problem I've been toying around with: Company A helps a group of students to prepare for a standardized test. A perfect score on the test is 100, but most of Company A's students receive scores ...
3
votes
2answers
137 views

Detecting fishy data

Just a little thought I've been having. If we rolled a fair dice 60 times, and got 60 sixes in a row, we would (wrongly?) definitely assume that something fishy's going on. Is there any statistical ...
35
votes
4answers
1k views

Do we have a problem of “pity upvotes”?

I know, this may sound like it is off-topic, but hear me out. At Stack Overflow and here we get votes on posts, this is all stored in a tabular form. E.g.: post id voter id vote type ...
4
votes
2answers
278 views

What to do with a small (27) medical dataset?

I'm working with a lot of data that was collected by obstetricians regarding the health of infants (birth weight, gestational age at delivery, mother's BMI), and I am trying to connect this data with ...
21
votes
1answer
635 views

Are there statistical lessons from the “Bible Code” episode

Although this question is somewhat subjective, I hope it qualifies as a good subjective question according to the faq guidelines. It is based on a question that Olle Häggström asked me a year ago and ...