Questions tagged [total-least-squares]
A technique to estimate parameters $\beta$ of the linear model $Y=X\beta$ when both $Y$ and $X$ are subject to measurement error. Includes Orthogonal and Deming regression as special cases.
69
questions
1
vote
0
answers
13
views
Mixed-level Deming regression?
Is there an implementation of Deming regression that also handles random intercepts and slopes in the sample? We have a situation where we have compelling theoretical reason to believe that one ...
- 1,117
0
votes
0
answers
29
views
Method comparison: removing double-zeros before orthogonal regression, deming or passing-bablock?
I am comparing two pieces of equipment / methods which are supposed to measure the same information over time.
I looked into the literature and decided Passing-Bablock seemed like the right approach (...
- 249
0
votes
0
answers
23
views
Model selection when dealing with orthogonal columns
Let $L$ be a subset of indices referring to orthogonal columns $X_i$. Let $RSS_L:=\lVert y-H_L y\rVert^2$. I have shown that the relative projection matrix $H_L$ is given by $H_L=\sum_{i \in L} H_i$.
...
- 201
0
votes
0
answers
49
views
How to estimate the covariance matrix of total least squares parameters
The slope(s) and intercept(s) of a total least squares regression can be obtained by principal component analysis, as explained in this old post. How does one obtain the covariance matrix of the fit ...
- 343
3
votes
1
answer
61
views
What does Deming regression estimate?
Least squares regression estimates conditional means.
Least absolute regression estimates conditional medians.
Quantile regressions estimate conditional quantiles (a special case of which is the ...
- 51.2k
3
votes
1
answer
117
views
What is the name of this regression model?
I am wondering how I can map this problem to something known.
Let us start with a standard linear regression framework, and suppose we want to reconstruct an observed signal $y$ from single known ...
- 425
0
votes
0
answers
15
views
Usiing Deming regression within structural equation modeling?
Is it valid to use Deming regression within structural equation modeling? If so, how would I go about doing that?
- 1,117
2
votes
0
answers
65
views
Total least squares estimator
In the paper Ivan Markovsky, Sabine Van Huffel - Overview of Total Least Squares Methods, at the top of the sixth page, it is claimed that the estimate of $\beta$ in the total least squares model $y \...
- 18.1k
1
vote
1
answer
23
views
Reorder dataset to achive LSE between two data sets
Assume I have two datasets, each one containing 5000 samples, and each sample has three dimensions. I am looking for a way to "reorder" the samples in one (or probably both) dataset such ...
- 43
0
votes
0
answers
93
views
Orthogonal regression that minimizes absolute error instead of squared error
Fitting a line through 3D points is usually done by orthogonal least squares (aka "total least squares"), i.e., by minimizing the mean squared orthogonal distance between the points and the ...
- 3,940
1
vote
0
answers
17
views
duel regression with orthogonal constraints on coefficients [closed]
I'm trying to solve a problem where I need to find two deming style regression models onto two different data sets of equal dimension who's coefficients(A,B) satisfy the following criteria with ...
- 11
2
votes
0
answers
39
views
Propagating uncertainty in least squares regression
I am currently running a nonlinear regression on $y=f(x,\theta)$, the variable $x$ being a known input and $y$ being a measurement result. I would like to estimate the parameters $\theta$ as well as ...
1
vote
0
answers
26
views
How to handle nondifferentiable points of the objective function in the geometric circle fit?
We a given measured points in $(x_i,y_i) \in \mathbb{R}^2$, $i=1,..,n$. The geometric circle fit is the circle with center (a,b) and radius $r$ that minimizes the squared Euclidean distances between ...
0
votes
1
answer
218
views
Errors only in variables model, and polynomial fitting
I have a bunch of data points $(x, y)$, and I know that they fit well to a model of the form $y = a + bx + c x^2$, with $a \approx 0.01, \ b \approx 1\ \textrm{and}\ c \lesssim 0.1$. I'd like to fit ...
- 101
2
votes
1
answer
162
views
Use of ordinary least squares line in correlation analyses
I want to study and plot the correlation between two variables, X,Y. Both are measured, so they have comparable noise. Correlation (and not regression) is the correct analysis here.
In a paper, I ...
- 388
1
vote
0
answers
75
views
How to do Error in Variables regression with known standard errors
I need some help with EiV regression and comparison of two methods.
I have used two different methods to estimate the size of the same population and would like to find out how good method 1 is ...
- 11
2
votes
1
answer
49
views
Linear regression with normally distributed data and model with arbitrary covariance
Consider the linear regression problem $$(A+\Delta A)x = b + \Delta b.$$
If $\Delta A = 0$ and $\Delta b$ is identically and independently distributed, then ordinary least-squares gives a good (BLUE) ...
- 131
1
vote
1
answer
39
views
Which is more correct to calculate least squares (errors) during nonlinear curve fitting, calculating after transformation or in the original form?
I am studying curve fitting and linear regression. I am supposed to find a and b in the equation $$
P=ae^{bh}
$$
so I transformed it to
$$
lnP=ln a +bh
$$
then
$$
Y=c+bX
$$
after that I solved it to ...
user277410
0
votes
0
answers
68
views
Identifying an algorithm described as 'Tukey approach' for ignoring outliers?
MVTec's machine vision library Halcon has an operator fit_line_contour_xld for robustly fitting lines to 2D points. Here's the documentation entry for that operator:...
3
votes
2
answers
1k
views
Including model uncertainty in non-linear least squares minimization
The problem
I have experimental data $Y$ with heteroscedastic and normally distributed uncertainties characterized by covariance matrix $C_{exp}$. I want to fit the data using model $F(X, \beta)$ ...
- 49
0
votes
0
answers
34
views
Standardizing regression coefficients in the case of Total Least Squares Regression
So I know that there exits a method to standardize regression coefficients by simply multiplying them with the ratio of the standard deviations of the two variables. I'm wondering if this holds true ...
2
votes
1
answer
141
views
Difference between estimating parameters for prediction and estimating parameters for their own sake
In a 1989 paper on orthogonal regression, Ammann and Van Ness write:
An important caveat should be noted. The errors-variables-model is useful when the primary goal is to estimate the model ...
- 2,522
2
votes
1
answer
488
views
Statistical library for orthogonal distance regression with a ridge penalty?
There are many libraries in R and python for doing orthogonal distance regression and for doing ridge regression separately. Is there one for doing them at the same time?
- 2,522
3
votes
0
answers
2k
views
Difference between "orthogonal distance regression" and "total least squares"
I'm trying to figure out the difference(s) between total least squares (TLS) and orthogonal distance regression (ODR). Both techniques are used when there is error in the dependent variable. Per this ...
- 65
1
vote
0
answers
43
views
least absolute deviation version of deming [closed]
Based on what I know, deming minimizes the sum of square of perpendicular distance to the regression line. Is there a package in R that can run regression that minimize the sum of absolute value of ...
- 111
3
votes
2
answers
2k
views
Why my Deming Regression line change so much when switching variables? If they seem to be a linear relationship betwen them?
I am trying to fit a line that best predicts the production of energy Y given the speed of wind X, a typical Y = xm + b , using deming regression. I am looking for the slope and the intercept of that ...
1
vote
1
answer
122
views
Correct way to fit a line in 3D (x-position vs y-position vs other quantity)
I have measured the position of light spots $(x,y)$ in an arbitrarily chosen basis and I compare that to some other measured quantity, say the brightness of each spot $B$.
Now, in theory all the ...
- 123
-1
votes
1
answer
619
views
Deming regression prediction interval using jackknife resampling
I am trying to write a custom Deming function following the maths in Linnet (1993):
https://www.ncbi.nlm.nih.gov/pubmed/2281234
Using jackknife resampling I calculate the standard error for the ...
- 115
1
vote
1
answer
750
views
Standard error of coefficient estimates for model II regression
I'm working with time series data that has error in both the dependent and independent variables, so I'm analyzing each half hour of data with model II linear regression, specifically geometric mean ...
- 31
0
votes
1
answer
583
views
Selecting appropriate likelihood during non-linear regression
When performing regression to fit a function, $f (x,{\bf \beta})$, to a set of observed data, $y_i(x_i)$, we are seeking to optimize the parameters, $\beta$, of the fitting function, to minimize some ...
- 457
1
vote
0
answers
35
views
Can total least squares be used to account for uncertainty due to measurement timing?
Suppose we have a dataset in which we wish to perform regression analysis, and where the response/dependent variable is a measurement at time T. But due to pragmatic sampling we do not have ...
- 433
0
votes
1
answer
59
views
Regression to estimate parameters
I would like some suggestions to tackle the following problem.
Given a system
$y = X\beta$
where $y \in \mathcal{R}^m$, $X \in \mathcal{R}^{m \times n}$, $m\geq n$, and $\beta \in \mathcal{R}^n$,
...
- 131
2
votes
1
answer
263
views
Orthogonal polynomials + cross validation: should subsetting be done prior or after constructing the orthogonal polynomials?
So, just to start... I've just learned of orthogonal polynomial regression today. I've gone through the master's-level linear models courses, and we did not cover that topic. I was always under the ...
- 4,213
5
votes
2
answers
1k
views
Why does the total least squares line in 2D pass through the average across all data points?
I have $N$ data points $\mathbf{m_k}$ and I want to fit a line through them with minimal error $$J = \sum_k^N ||\mathbf{m_k^*} - \mathbf{m_k}||^2 = \sum_k^N ||\mathbf{m_0} + a_k\mathbf{e} - \mathbf{...
- 1,336
1
vote
0
answers
910
views
Advantage of orthogonal polynomials
What is the sense or background of orthogonal polynomials (regarding using mixed models)? I would like to know why they shall or should be orthogonal. Is it to build independent sample points?
On Is ...
- 3,051
2
votes
1
answer
622
views
Least Squares Derivation
I come from physics and would like to derive the chi-square function given by the Particle Data Group:
\begin{equation}
\chi^2 (\boldsymbol\theta) = (\boldsymbol y-\boldsymbol\mu(\boldsymbol \...
- 161
2
votes
1
answer
207
views
Deming regression implementation: force intercept to 0
I implemented Deming Regression in a known programming language, using the algorithm from here: https://en.wikipedia.org/wiki/Deming_regression
However, the algo does not specify what to do in case we ...
- 151
4
votes
0
answers
223
views
What's the shape of confidence interval for linear regression estimated through TLS (total least squares)?
So, we know the shape of confidence intervals for vanilla linear regression estimated through OLS (ordinary least squares): Shape of confidence interval for predicted values in linear regression.
In ...
- 17.4k
10
votes
1
answer
2k
views
When to use Deming regression
I am currently working on a way to transform two different phosphorus test values into each other.
Background
There exist many (extraction) methods to measure plant available phosphorus in soil. ...
- 101
3
votes
1
answer
7k
views
Generating Random Data Sets for Linear Regression with Random Slope and Error Term in R
I want to test the effects of sample size on Deming regression using simulated paired data in R.
As the data are paired, the expected slope value should be 1 and the intercept 0.
The code I have ...
- 115
2
votes
0
answers
205
views
Specifying the Error Ratio in Deming Regression
We use Deming Regression for method validation in our clinical ELISA laboratory. As we run clinical trials this needs to be performed if we get a new reagent batch, batch of plates, new plate reader ...
- 115
1
vote
0
answers
53
views
Regression of dataset with many x values per y value
I am performing a total least squares regression in which I have many x observations for a given y observation. The x observations are normally distributed.
I am aware I could do some sort of ...
- 147
4
votes
2
answers
545
views
Find best fit diagonal matrix for error minimization
I want a set of input values to be as similar to the output values as possible.
I have an input matrix X (m*n) that has m data points and n dimensions for each data point. I also have an output matrix ...
- 63
0
votes
0
answers
693
views
What weights for weighted Total Least Square (TLS) regression?
I have a dataset with known errors in both the X and Y and want to perform a simple linear regression. From reading other posts, it seems I want to TLS over OLS due to the presence of error in both ...
- 147
3
votes
0
answers
81
views
Multiple errors-in-variables regression with collinearities
I have a $[k \times N]$ matrix of predictors / independent variables and a $[k \times N]$ matrix of predictands / dependent variables. I have uncertainty estimates for each predictor and each ...
- 1,447
2
votes
0
answers
61
views
$X$ and $Y$ at different scales in total least squares?
As this section of the Wiki article says, the best (in total least squares sense) matrix $B$ that projects $X$ to $Y$ is given by $$B=-V_{XY}V_{YY}^{-1},$$ where $V_{XY}$ and $V_{YY}$ come from the ...
- 2,508
2
votes
1
answer
142
views
Is quantile regression a better option than total least squares RMA in this case
I have paired cobalt concentrations in bird blood and feathers. Blood levels give me an idea of how recent the cobalt exposure was (<30days), feather give the 6 month accumulated total.
Previous ...
- 31
2
votes
0
answers
589
views
Confidence/prediction intervals for total least squares regression
I am learning the ropes of total least squares regression and I found this thread How to perform orthogonal regression (total least squares) via PCA? where the answer by @amoeba, together with some R ...
- 203
1
vote
0
answers
101
views
Introductory references about total least squares
I am an engineering student and I've been recently told about the Total Least Square (TLS) method. I am interested in applying it to topographic measurements and in comparing the results with the ...
3
votes
0
answers
1k
views
Model selection: OLS vs TLS
I have two sets of real-valued data and I am interested in their correlation. From my perspective, there appear to be errors both variables, so I am inclined to perform a regression with TLS (Total ...
- 841