The Stack Overflow podcast is back! Listen to an interview with our new CEO.

Questions tagged [weighted-regression]

Weighted least squares regression is a generalization of OLS regression used when different data points have different importance, or "weights". See also [weighted-data].

258 questions
Filter by
Sorted by
Tagged with
16 views

Determining weights for fitting non-uniformly spaced measured data (v2)

Let's pretend I have some data to which I want to fit a line. If the data are uniformly spaced along the x-axis, I get the following: If the data are not uniformly spaced, I get a different fit line:...
19 views

Determining weights for fitting non-uniformly spaced measured data

I have a system of generally known behavior, and some non-uniform measurements of that behavior (let's say without measurement error). Now I want to fit a simple function to a subset of the ...
8 views

Selection of sample_weight for gradient boosted regression

I'm looking for any information on how the sample_weight parameter is typically selected for gradient boosted regression tree's - i.e. implementations such as ...
27 views

Convergence of weighted regression solution to the solution of L1 regression

I have read in this paper that the weighted regression solution converges to the solution of L1 regression, for weights, $$W_i=1/|y_i-\hat y_i|$$ I worked this out but unfortunately, I lost. Could ...
46 views

101 views

Why do stabilized IPW weights give the same estimates and SEs as unstabilized weights?

In Cole & Hernán (2008), the authors mention that using stabilized weights can decrease the variance of the effect estimate. Regular inverse probability weights use the probability of being in the ...
36 views

Different error weighting for positive and negative residuals for OLS?

For OLS-estimators in multivariate regression analysis, it logically doesn't matter whether an error is positive or negative. I was wondering if in some situations it might make sense to weight a ...
33 views

Problem from Introductory Wooldridge regarding WLS

I was reading the book introductory econometrics by "Wooldridge", and in Chapter 8 (Heteroscedasticity), it is stated that (see pink part) I could not understand, if $u$ and $x$ are uncorrelated, ...
11 views

Calculate mean by decile in Svydesign object

So, I´m working with ENIGH - Database, which stands for ¨National Survey of Household Income and Expenses¨ in Spanish, this is an exercise conducted by the Mexican government and like most surveys of ...
111 views

Are GLMs just glorified WLS regressions?

When performing weighted least squares $L = \frac{1}{2} \sum_i w_i r_i^2$, Aitken showed that one ought to weight each sample by the inverse of its variance $w_i=1/\sigma_i^2$. This leads to gradients ...
15 views

Probability Weights and Dropping Observations

I am trying to determine how applied empirical analyses adjust probability weights after dropping observations. For example, say I have a strict subset of the population that takes a 2013 cross ...
46 views

Posterior distribution of ATE with Bayesian propensity score model?

I am using propensity score weighting (PSW) to estimate the average treatment effect (ATE) of some treatment $D$ on an outcome $Y$ with covariates $X$. I have seen several ways in the literature (both ...
48 views

Why weighted glm coefficients differ from weighted mean?

Let's consider the following dataframe: ...
36 views

When to use variance stabilizing method?

Let's suppose we want to estimate $p$ from $m$ independant realisations of $X\sim Bin(n,p)$: $x_1,x_2,\dots,x_m$, with respective size $n_i$ $i$ in $\{1,\dots,m\}$. Let $p_i$ be $p_i:=x_i/n_i$. To ...
118 views

How to fit a weighted mixed effects model?

I am looking to get help into specifying the structure of the variance matrix within the gls() function in R's nlme package (or recommendations of other packages ...
103 views

64 views

Weighted Regression where Weights are associated with Response Variable

I am trying to carry out a simple linear regression analysis represented by the standard formulation: $$y_i = \beta_0 + \beta_1x_i +\epsilon_i$$ However, there is an issue with my data. There is no ...
147 views

How to use White-test to check if the heteroscedasticity has been effectively dealt with by a WLS?

Consider an OLS model with $n$ observations and $p$ explanatory variables (including an intercept term) $$y=X\beta + \epsilon$$ We may use a White test to (approximately) check for the presence of ...
40 views

How to use weighted data in linear modeling?

I have data from studies where each study has the means for that sub sample and the sample size is n, so the n is a frequency. There is one categorical predictor. The dependent variable is a % (the % ...
22 views

I am looking for an explanation of inference of results from weighted regression for a ratio of two continous variables.

I am performing a weighted regression for a ratio $R = \frac{Y}{X}$ using $X$ as weights. Y and X are normal and they are not independent. Is it valid to use $X$ as weights? What is the interpretation ...
276 views

Weighted linear regression from log-likelihood?

I have 500 time-series and for each one, I compute the best (aka max likelihood) parameter α in a model that I'm testing, along with the corresponding log-likelihood. Now I wish to uncover a linear ...
25 views

Switching attention - is there a statistical tool to mimic perceptive response?

I was driving this morning to work. Another car made sudden lane change. I noticed an interesting thing: for a brief moment my attention focused in this car. It almost physically felt that everything ...
146 views

How to do a regression with a percent as the dependent variable and with sample mean values?

I have 60 sample of data from various studies. All I get is a mean for x and y, and a sample size. Furthermore y is a percentage. Sometimes we get the standard error of the mean. IIRC, percentages ...
261 views

How to fit a line to data using weighted least squares (WLS) regression?

I am newbie to WLS regression topic. I am being asked to fit a line to a data using WLS. I am working in minitab. My data is as follows: cost (independent variable) (x-axis); production (dependent ...