# Questions tagged [bias-correction]

The tag has no usage guidance.

121 questions
Filter by
Sorted by
Tagged with
48 views

### What is the difference between using logistf and brglm2 when dealing with complete separation in a logistic regression?

I am trying to looking at how the three factors A (5 levels, a-e), B (2 levels, a and b) and C (2 levels, a and b) affect the likelihood of event Y (1 = occured, 0 = did not occur). I initially ran a ...
130 views

### What to show as error-bar if the bootstrap distribution is biased?

Say I have a sample, of finite size $N$, and I compute some statistic $\theta$ from it. I want to plot this sample estimate, $\hat{\theta}$, with an error-bar. To compute the error, I am using ...
• 170
15 views

### Methods to level spatiotemporal data when simultaneous measurements of the same physical quantity are different

I have data of (simulated) measurements of the density content of ionized ozone in the atmosphere with three different satellites. Specifically, I have a unique set of observations x1,x2,x3,...xN for ...
29 views

### Why does the jackknife reduce bias? [duplicate]

Given a sample $x = (x_1, \ldots, x_n)$, define $x_{(-i)}$ as the sample values excluding sample $x_i$. That is, $$x_{(-i)} = (x_1, \ldots, x_{i-1}, x_{i+1}, \ldots x_n).$$ Now given estimator $T(x)$...
• 121
1 vote
41 views

• 133
387 views

### How to address 'immortal time bias' using R - equivalent to Stata stset?

We have a dataset on cancer patients who have consented to join a study after their diagnosis, which could be months or even years later. After some follow-up, an event occurs. We can fit this data ...
• 270
1 vote
26 views

### How to account for bias in experiment data when quantifying treatment efficacy?

Say my randomization wasn't very effective, so I have two groups, each with 100 individuals and the difference in success rates is 3% before the treatment has ever been administered. I want to know ...
• 3,382
1 vote
151 views

### Implementing bias-adjustion for step3 latent profile analysis in R [closed]

I am identifying a latent profile model with the Mclust package in R. After identifying an optimal number of cluster I would like to identify possible covariates and distal outcomes via logistic/...
1 vote
49 views

### Suggestions on dealing with outliers when sample size is very small AND you must order the results

I run competitive events. In our normal event, we have 8 adjudicators split between to categories. Skill and Artistry. For each category we throw out the high and low scores and average the remaining ...
39 views

### Correction of biased probabilities

I have a classifier that outputs biased predictions, that I want to correct for in a mathematically sound way. I define bias as the difference between the true class distribution and the average ...
• 211
65 views

### Estimating the Absolute Difference in Mean Between Two Normal RVs

I've seen more general questions of this nature, but none that discuss specifically the problem setup that I'm interested in, which I believe is substantially simpler. Suppose that we observe two ...
60 views

### How to correct for sampling bias in one population when comparing against another

I have two populations that I'd like to compare across certain metrics. However, most members of population A did not respond to our request for data, and those respondents that did are not ...
• 207
1 vote
102 views

### Python implementation of standard Expectation maximization algorithm to estimate position bias in LTR

Is there any Python implementation that would allow to use logs data of clicks and their ranking, and return and estimate of relative position bias as discussed in section ...
• 11
125 views

### Correcting for pre-experiment bias in proportions test?

Say I have an obstacle course, which not everyone completes, though, globally, most do. I hypothesize that the treatment, drinking Gatorade, will cause an increase in the obstacle course completion ...
• 3,382
1 vote
95 views

### Standard deviation in generated data with specified autocorrelation - correction factor?

I want to generate time-series data with specified AR(1) and standard deviation. I am using arima.sim to generate univariate time series. (Ultimately, I want to use ...
• 11
33 views

### Significance of parameter on cointegrating vector

I have been reading Section 6.2 (page 96) of this manual, where a procedure called "fully modified least squares" is discussed, and was developed on a paper of Phillips and Hansen (1990) . ...
• 101
197 views

### Finite population correction for the variance

Just when I thought I was starting to understand Bessel's correction, I noticed that it is not valid when the sample size equals the population size and so likely not valid for sample sizes close to ...
• 263
1 vote
69 views

### Biased logistic regression in pytorch

My model has decently high AUC=90%, but is biased, underestimating the probability $y=1$. This is systematic across some of the input features as well. How can I nudge the bias term, or otherwise ...
251 views

### ADAM bias correction derivation

Where $\beta_2\in [0,1)$ and $g_i$ is the gradient at step i. We approximate E[gi^2] with E[gt^2] by a correction term $\zeta$. I think this is because it is assumed that the gradients are bounded. Is ...
• 21
92 views

### Covid data analysis question

This might be a dumb question but I'm doing a basic data analysis for a medical group. Previously, I did a project for them where we looked at patient outcomes in a major hospital (let's call it "...
• 23
149 views

### How to bias-correct proportions for a prop.test in R?

Let's say I ask 200 participants in a study what experience brought the most joy to their lives: A, B, C, or D. ...
661 views

### Bias Correction and Variance Estimation of Inverse Log-Linear Regression

My question is related to this one, but it has no answers or comments. So, I try to ask with a different way. I have a physical quantity $X > 0$ and a noisy sensor $Y$ which has the following ...
• 111
1 vote
179 views

### Reasons to prefer low bias with higher variance over the alternative (and vice versa)

I am trying to understand the bias-variance tradeoff in practice. I have read several related questions and answers, but still have a few questions: Assume we are estimating a structural equation ...
• 115
4k views

### Linear Regression of non-normally distributed data [duplicate]

I am trying to understand the relationship between royalties received (independent variable) and health expenditures (dependent variable) for each municipality through a linear regression. My ...
• 5
1 vote
103 views

### How to combine stratified sampling and avoid common driver in both training & test set - R Cross-Validation

I want to build a random forest or gradient boosting model on very heterogeneous data using cross-validation in R. Due to data heterogeneity and dependency between the observation (the same subject ID ...
• 21
327 views

### Multivariate sampling bias correction for data analysis

I have a dataset of properties for 20,000 samples and 200 of these samples have a categorical label (A, B or C); and I'm trying to assess the relationships between the properties and the labels. I am ...
• 228
1 vote