Questions tagged [back-transformation]
Back transformation refers to efforts to reverse the effects of a transformation of one or more variables. Usually, the transformation has been done to meet assumptions of a model, but interest is in the original variable(s).
124
questions
0
votes
0
answers
14
views
Can you back-transform standard errors from log-transformed data? [duplicate]
I fit a model with transformed data with log10 transformation. I would like to report the results using the original scale and not the transformed means. I know you can back transform the log means by ...
- 129
0
votes
0
answers
35
views
Advice on transforming back the integrated output to real/true values
I see several questions here at SSE about transforming the processed output [0,1] back to real/true values. However, my case is slightly different, where I am using Rfmtool package to do weighted ...
0
votes
0
answers
14
views
Back transformation of mixed models
Need your help:
I did my thesis about influence of parenteral nutrition on the liver with repeated measurements and missing data (retrospective aspect) so I used mixed models for statistical analysis.
...
- 1
0
votes
1
answer
137
views
What is the inverse normal transformation (INT) and what are the reasons behind using it?
I noticed a statistical method called inverse normal transformation in the following research article FTO genotype is associated with phenotypic variability of body mass index. I attached the ...
- 1
0
votes
0
answers
55
views
How do you reverse log, square root, and Ln data transformations?
If you have transformed your data, is it true that when reporting results, such as descriptive statistics (e.g. mean, median, range, variance, standard deviation etc.), you need to revert the data ...
- 1
1
vote
0
answers
130
views
GLMM with scaled variable: do I need to back-transform?
I am fitting a GLMM to powerline collision data for a bird species- using distance to seasonal water, habitat and the presence/absence of line markers as predictors. Incident is a binary response (50 ...
0
votes
0
answers
34
views
Back Transformed Truncated Negative Binomial Model Results Less Than One
I'm using a truncated negative binomial model to describe my count data where all values are >=1. I have attempted to back-transform my model results using emmeans. However, all of my back ...
1
vote
1
answer
60
views
How to transform prediction std of gaussian process back to origin
I am looking for a way of rescaling the predictions of my Gaussian Process Model back to the original scale.
The data is scaled for training using a ...
- 13
0
votes
0
answers
13
views
Interpreting regression output estimates with normal and square root transformed predictors and some log transformed response variables
I understand this topic is well covered here, but having read several threads, I can't find an explicit or clear answer to my question. I looked at the following threads and can't glean an answer from ...
- 33
1
vote
1
answer
32
views
GLMM Outputs from LMER: Random Effect Variance does not reside within 95% CIs in log-transformed response variables
I have produced a mixed-effects model (lmer) that is analysing the difference in area between three protocols of growing mini-brains. I have takes into account various fixed effects including the type ...
- 11
1
vote
0
answers
48
views
Interpreting Predictions from the Log-Linear Model (or Log-Log Model...)
I understand that when we fit an OLS regression to the log(y) (as either a log-linear or log-log model), the predicted value from that model [log(y).hat] cannot be simply exponentiated to solve for y....
- 75
0
votes
0
answers
78
views
Back-transformation of confidence intervals
I have read that I can simply back-transform my confidence intervals from my (mixed) linear models, which seems very handy for model interpretation.
What I don't understand is why log-transforming the ...
- 1
1
vote
1
answer
244
views
R: emmeans back-transformation when using a constant value in the response formula
I am fitting a linear mixed model
...
- 517
0
votes
1
answer
44
views
Converting scaled parameters to unscaled parameters in exponential regression
I would like to calculate two types of bivariate exponential models on scaled data (therefore both variables are expressed as z-scores):
Model 1:
$$
y=b_{0}*e^{b_{1}x} + \epsilon
$$
Model 2 (is ...
- 21
0
votes
1
answer
171
views
Back transform predict.gam() from nb link log model run?
I have model with 1 covariate. I would like to run y values from gam in another model. I used nb(log=link) in gam model. Because I used nb and link log in gam, do I need to back transform to use ...
2
votes
0
answers
63
views
How to deal with output transformation at inference/prediction time?
Suppose A machine learning model (e.g. RandomForest) which uses $x$ as input and produces $y$. Now as part of preprocessing and feature engineering, I applied some ...
- 21
0
votes
1
answer
196
views
How to correctly invert a confidence interval after a power transformation?
I have the following situation:
I have some dataset in the form of samples $y_i, x_{i,j}$. I'm doing a GAM regression after a power transform (Yeo–Johnson - similar to Box-Cox). So I first learn the $\...
0
votes
0
answers
323
views
Back transforming from a log-transformed and subsequently standardized (outcome) variable
Due to skewness of my data I've performed a natural log transformation of my outcome variables, dealing with scores of 0 by adding 1 to all measurements.
Then, to be able to compare relationships ...
- 129
0
votes
0
answers
348
views
Transformed Data with Boxcox and negative Lambda
unfortunately I'm a statistics beginner. I am trying to transform my data. Here, according to Boxcox, a transformation with negative lambda has resulted ( L =-0.25).
But If I now run a T-tests with ...
- 1
-2
votes
1
answer
117
views
Given marginal tables back solve for contingency table
How to programmatically solve problems similar to the below:
Most basic example: Given two marginal tables, solve for 2x2 distribution.
A
Sum
0
3
1
7
B
Sum
0
4
1
6
Solve for
A
B
Sum
0
0
0
1
...
0
votes
0
answers
182
views
Is this the correct way to compute confidence intervals on the original scale for GLM(M)s?
Suppose I have fitted a GLM and want to produce a confidence interval (or a prediction interval) on the original scale of the outcome. What I would do is estimate it on the link scale and then inverse ...
- 10.5k
1
vote
1
answer
100
views
Pearson's Correlation after power transformation of dependent variable
I have a simple model.
y ~ x
y is continuous (habitat gained per million $)
x is continuous ...
- 113
2
votes
1
answer
157
views
Back-transforming meta-analysis results in metafor
The R package metafor offers various ways of back-transforming the results of a meta-analysis with a transformed effect size/...
- 489
0
votes
1
answer
33
views
Interpreting log multiple linear regression, backtransformations?
I'm investigating adherence to a special diet (that is scored from 0-18) in relation to C-reactive protein level and am in the process of building multiple linear regression models:
To achieve a ...
- 1
1
vote
1
answer
122
views
Bias correction for regression with t-distributed error
I have a GAM /regression model which is originally defined as:
log10(Y)~s(log10(X1))+s(log10(X2))+s(log10(X3)) #using R mgcv
The response needs to be back ...
- 83
0
votes
0
answers
73
views
Interpreting multiple regression with transformed response variable
I have build regression model focused on association between physical activity and fat mass. The model is as follows:
...
- 21
2
votes
1
answer
490
views
Bayesian lognormal model: how to correctly back-transform the estimates?
I have a Bayesian model of the form:
$$
\begin{align}
y & \sim logNormal(\mu, \sigma)\\
\mu_n & = \alpha + \beta_0 c_n + \beta_1 d_n + \beta_2 c_n d_n
\end{align}
$$
Where:
$y$ is a ...
- 73
0
votes
0
answers
19
views
First difference in logs transformation produces biased results on back-transformation [duplicate]
I have a strongly trended series where the trend appears to be exponential and I believe the errors tend to be proportional to the current value. In order to convert it to a stationary series for ...
- 2,647
1
vote
1
answer
490
views
Reversing Log-transformed target after training : r2 score interpretation
I have been running a log-transform on my target values because the distribution appears to be highly right skewed as you can see in the picture.
After having called
...
- 537
0
votes
0
answers
62
views
Multiple linear regression - assumption of normaly distributed estimates
In linear regression, there is said that normal distribution of residuals is required. Other than that I have found that it can be violated if the dataset is large enough. But what is large enough? Is ...
- 21
1
vote
0
answers
73
views
How to interpret a transformed linear regression model
I'm playing with the trafo R-package and this small data. After using the assumptions function, I found the log shift opt transformation is the best for normalizing ...
- 517
0
votes
0
answers
116
views
Back-transformation in pairs function (lmer analysis)
I'm running lme4 and Im working with a dataset where the variables a,d,e are logtransformed. I wonder how to handle back-transformation concerning the "pairs" function. How do I get the ...
- 177
2
votes
1
answer
740
views
Back transformed Median of log normal data, not equal to median of original data
l was working with these data:
160,320,160,160,320,320,160,320,160,320,160,320.
I needed to calculate the median so decided to calculate while the data was log transformed and I would just back ...
- 95
1
vote
0
answers
153
views
Backtransform a log-odds transformation of the dependent variable in a Fixed Effects panel regression
I'm modeling a fixed effects (within) panel regression for a fractional dependent variable (DV) bounded between 0 and 1. My aim is to model the relationship so that I can predict the frational DV on ...
- 83
1
vote
1
answer
461
views
Back-transformations
I have been having trouble grasping the idea of back-transforming data in R. Lets assume that I would like to perform an ANOVA on transformed data. I transform the response variable and all the ...
- 11
0
votes
1
answer
204
views
Standardize-back the Standard deviation
I run an lmer model using standardized data like scale(y) ~ 1 + (1|categorical)
Now, I have a standard deviation for the random effect in normalized world but I ...
- 255
0
votes
0
answers
15
views
Can we transform back calendar adjusted forecast?
I've monthly data, I adjusted it for monthdays and conducted a forecast. After that can I adjust it back and compare it with untransformed time serie?
- 289
0
votes
0
answers
219
views
Back-transformation of coefficients in a log-log model, and a model with a boxcox transformed y
There's a number of posts out there on back-transformations but none that I've been able to use to answer this problem, internet searches are returning surprisingly little on the issue of back-...
- 11
1
vote
0
answers
1k
views
Pairwise contrasts for logistic regression in emmeans, back-transform or not?
I ran a mixed effects logistic regression in R (glmer). The model identified a significant three-way interaction that I am interested in decomposing using post-hoc multiple comparison in emmeans. In ...
1
vote
0
answers
32
views
predicting waste per capita: is a Gaussian model correct?
I am trying to predict the daily amount of waste per person produced in the fishery sector. We surveyed fishing boats at the end of their fishing trip and the variables I have are duration of trip (...
4
votes
1
answer
3k
views
XGboost Regression Log Transform Target
I'm training a XGBoost Regressor to predict price which has a highly right skewed distribution. (all prices are positive)
I took log transformation on the target thinking it would help to 1) stable ...
- 41
0
votes
0
answers
180
views
Back-transforming coefficients of glmer model fit using rescaled independent variables for prediction & plotting
I've fit a model using the glmer function from the lme4 package. Because my predictor variables are on very different scales, I ...
- 65
1
vote
0
answers
154
views
Back-transforming forecast points and error bounds from a VAR model applied to alr-transformed compositional time series
The data
I have a k=3 compositional time series from which I am trying to forecast future values.
The series is compositional in that at each time ...
- 113
1
vote
0
answers
53
views
How do I back-transfrom my estimates (and confidence intervals) from log10 variables (both independent and dependent) in linear model
I ran linear models for a bunch of variables in R. Both variables are log10 transformed (dependent and independent). I already took a look in some online documents and videos about this but i guess I'...
- 11
2
votes
2
answers
953
views
How to get the actual mean absolute error in cross validation after transforming the target variable y?
For a target variable y, it is transformed using np.log1p. Then a random forest regression model is trained using the ...
- 135
17
votes
1
answer
2k
views
Predicting y from log y as the dependent variable
In the book Introductory Econometrics by Wooldridge the chapter, which deals with predicting values of $\hat{y}$ (chapter 6.4 in the 5th edition) states the following:
If the estimated model is: ...
- 451
0
votes
1
answer
187
views
Which one is correct presentation for descriptive statistic of a transformed variable between retransformed mean (estimated SD), and median (qurtiles)
If a collected variable has a skewed distribution toward one side and transformed for statistical analysis, which one is better for descriptive statistics presentation between re-transformed mean and ...
- 31
6
votes
1
answer
483
views
When is performing back-transformation of inferences on transformed variables Ok, and when is it not Ok?
Caveat: This question may be a tad rambly, and I welcome comments with specific directions for me to improve it.
During a too brief exchange with the worthy @NickCox I got to thinking about ...
- 27.2k
1
vote
0
answers
248
views
How to plot estimate + raw data of a Bayesian zero inflated poisson?
GENERAL QUESTION:
How to back-transform estimates from a zero-inflated poisson to obtain the original scale in R?
(I tried exponential like for poisson but the results are wrong)
DETAILED ...
- 266
0
votes
0
answers
181
views
Why are the confidence intervals so large for the difference of differences?
I have run a generalized linear mixed effects model with the glmmTMB package to determine if there is an interaction between two categorical predictors, treatment and location, in predicting the ...
- 81