Shifting and rescaling data to assure zero mean and unit variance.

learn more… | top users | synonyms (1)

0
votes
0answers
4 views

Comparing scaled error

Say I have a regression technique (in my case I'm using ANNs) I am tuning on a data set. Say I am minimising a loss function that is not scale free, such as mean square error. Usually I would ...
0
votes
1answer
29 views

DCC GARCH model diagnostics in R

I have fitted a DCC GARCH model to my multivariate financial data. So, now I need to check the fitted model by using the standardized residual and its squared process. A good fitted model should have ...
1
vote
0answers
18 views

Should I centre or standardise variables in a linear mixed model analysis?

My study is looking at skin lesions in pigs. I have 2 partially cross-classified random factors (weaning pen and finishing pen) and several predictor variables. I have centred pig weights by pen ...
0
votes
0answers
32 views

Q-Q plot standardized log returns vs log returns

When working with financial returns and detecting heavy tails with EVT, Q-Q plots can be used to make assumptions of the normality of the data(e.g.). Using standardized log returns in qq plots one ...
1
vote
0answers
20 views

'Z-standardizing' data based on Poisson process

Hello all this is my first post on Cross Validated, so please let me know if it is not in an acceptable form. I have been attempting to analyze a data set where I have a Bernoulli process that is ...
1
vote
2answers
92 views

Should I ever standardise/normalise the target data/ dependent variables in regression models?

After standardising the explanatory variables the difference in magnitude between the explanatory variables and the target data is ~3 orders of magnitudes. I want to know if transformation of the ...
0
votes
0answers
9 views

Should I be using Raw or T scores in my mixed ANOVA?

My data that tests infants at 4 time points on the same measure (Motor skills). There are also 3 groups of infants (typically developing, atypical and unsure).I want to use a mixed ANOVA to look at ...
0
votes
1answer
32 views

Feature standardization for convolutional network on sparse data

I am preprocessing input data for a convolutional network (ConvNet), which is trained with SGD. For instance, see this quote from Ilya Sutskever (A brief overview of Deep Learning). It is ...
5
votes
2answers
85 views

How do regression results change after standardization, as a general rule?

Based on the simulation below, it appears that standardizing all variables in a data set affects OLS results in the following ways: Coefficient estimates change Standard errors change P-values ...
0
votes
1answer
20 views

Informativeness of t-score?

My organization recently did a morale survey. Results were given as t-scores. I had never seen that before, so I embarked on a web journey. I found a very similar survey. My question isn't about the ...
0
votes
1answer
23 views

Reference for standardizing non-normal variables for comparison

I need a reference to justify standardizing non-normal data. I will first explain what I am doing. I had a survey with ~30 questions. The answers to the questions were numeric; the range of possible ...
2
votes
0answers
19 views

What to do with categorical data when calculating standardized z-scores?

I have numerous environmental variables I'd like to correlate to some tree species data. The environmental variables vary greatly in scale, so I'd like to standardize each by calculating standard ...
0
votes
0answers
10 views

Lasso - standardize y or only x? [duplicate]

In lasso, I am standardizing the input, x. What do I need to do with the output, y? Are any transformations necessary? Only centering? Both centering and scaling? This question is not a duplicate ...
0
votes
1answer
21 views

Normalizing a large set of ratios

I have a problem that has been causing headaches. To set up the problem, here's what I have. Bear with me, since I'm trying to clarify the problem as much as possible: A large set of personnel These ...
0
votes
1answer
45 views

Is it possible to normalize data by different group leaders separately?

I have a dataset that contains different states of a country. In every state there are different companies and one company in every state is manager of other companies in that state (other companies ...
1
vote
1answer
46 views

Standardizing or normalizing count data

I have a dataset where I counted the number of a species in different environments and grouped it into different categories ranging from 0 to 5. 0= no occurrence; 5= very high occurrence. All ...
0
votes
0answers
23 views

Before applying multidimensional scaling, should the variables be standardized?

I am trying to apply multi-dimensional scaling using Matlab, I used cosine distance. The data is 4D. Should I scale the variables to unit variance especially given that I am using cosine distance?
1
vote
0answers
35 views

Power transform before aggregating data: benefits and risks

I have several physiological recordings from different users, for example heart rate. I would like to aggregate these time-series into a single "metric". Let's say that I want to apply the mean ...
1
vote
2answers
75 views

Standardized estimates give different p-value with a glmer/lmer

I have a large data set where I relate the response variable to multiple explanatory variables; since I have different areas I have also included a random factor. The response variable is binomial ...
0
votes
1answer
35 views

Standardize binary variable to create interaction term in regression?

I am currently running a multiple linear regression, and I have a question regarding how to properly construct an interaction term between one binary variable (sex) and continuous variable (age) to ...
0
votes
0answers
9 views

Simple question on the procedure for normalising data to a baseline period

I would like to transform a monthly time series of over 100 years so that it follows a standard normal N(0,1) distribution. Furthermore, I would like to perform the normalisation procedure relative to ...
1
vote
0answers
23 views

Can I use z-scores in independent samples T-test?

I have two datasets from different groups. I am interested in comparing the difference of an attitudinal outcome between the groups. However, the outcomes were measured on different scales so I had to ...
1
vote
0answers
41 views

How to pre-process data for partial least square PLS regression in R?

I have a data frame that is consisted of 20 observations and 35 variables. I want to prepare the data for partial least square regression PLS in R. Many authors suggest: 1)Check whether the ...
1
vote
1answer
37 views

Determine the original standard error of the intercept in a regression estimated with standardized covariates

The present question is related to these two questions: Converting standardized betas back to original variables and Intercept from standardized coefficients in logistic regression The R package I am ...
0
votes
0answers
32 views

Standardization versus Normalization

After reading the suggested articles on normalization versus standardization, I'm less sure about the path I'm supposed to take. I have 3D biomechanical motion analysis data (30 subjects, 120 trials) ...
1
vote
1answer
120 views

Should we standardize the data while doing Gaussian process regression?

I am performing Gaussian process regression (GPR) and optimizing over hyper-parameters. I am using minFunc to perform all optimizations. My question is should we ...
0
votes
0answers
15 views

Does it make sense to standardize residual using $SSE/(n-1)$?

See[Dean and Voss]Design and Analysis of Experiments,1999. pp.105 The authors proposed that we standardize residuals using: $$z_{it}=\frac{\hat{e_{it}}}{\sqrt{ssE/(n-1)}}$$ where ...
1
vote
0answers
41 views

Why subtracting the means in PCA, but not dividing by standard deviations? [duplicate]

I know this can vary, but in the standard setup, when calculating principal components (PCs), we begin by subtracting the means of each feature (dimension), but we do not divide by the standard ...
0
votes
1answer
21 views

Standardize or not standardize before clustering [duplicate]

Objects in my sample have multiple dimensions. Some dimensions are measured in kilometers and some in kilograms, there are also categorical variables that I need to quantify. I am planning to use ...
1
vote
0answers
37 views

Triple standardization with triple weighting

I have a question about triple standardization and weighting. I came across a published article that standardizes the same data three times. My statistical knowledge is limited, but I am wondering if ...
1
vote
0answers
21 views

Unstandardize Logistic Regression Coefficients

Given design matrix X and vector of binary responses y, we can standardize X and fit a logistic regression and obtain "standardized" coefficients. How can I obtain the unstandardized coefficients? I ...
1
vote
2answers
90 views

Logistic regression intercept representing baseline probability

In a linear regression, when you standardize your numeric variables, the resulting intercept has the same value as the mean of your sample. Is there any way in a logistic regression, with numeric ...
1
vote
0answers
40 views

PCA on bimodal data: how to standardize the data?

My set of data points can roughly be broken up into 2 sets with different means. In each set, the points are close to each other (geometrically). Moreover, the variance is the same across both sets of ...
2
votes
1answer
82 views

How to apply standardization/normalization to train- and testset if prediction is the goal?

Do I transform all my data or folds (if CV is applied) at the same time? e.g. (allData - mean(allData)) / sd(allData) Do I transform trainset and testset ...
0
votes
0answers
28 views

Boxplot of standardized data matrix

I have boxplotted a standardized data matrix. It seems all fine and the boxplot looks good, but how can I interpret it? The values are very different from the non-standardized data matrix, so I can ...
2
votes
0answers
24 views

Comparing which set better represents data

Here's the question/assignment: Twenty football players practised goal shooting, each had 6 attempts. Here's the per-player score results: $$ \begin{array} {|r|r|} \hline 4 & 4 & 5 & ...
1
vote
2answers
92 views

Lasso centering and standarization with R

I am working with a lasso regression with the glmnet package. I read these threads: When conducting multiple regression, when should you center your predictor variables & when should you ...
0
votes
0answers
47 views

How to get prediction from a neural network since its output is standardized?

This is probably a silly question, however, I'm using a neural network in R ("neuralnet" package) to predict a continuous variable from a series of 10 continuous predictors. Using the model without ...
0
votes
0answers
13 views

standardized betas from unstandardized predictors

I have a logistic regression with several predictors that is part of a larger computational model of decision-making. I would like to compare the betas from this regression not only in their sign, but ...
2
votes
1answer
34 views

Showing SEM model as figure - report unstandardized or standardized values?

I want to show results of a CFA in two figures, proposing a 7 factor model and a 7 factor model with a major general factor. Now I wonder whether it's better to report the full standardized solution ...
0
votes
0answers
18 views

How to add two standard deivations from different scale?

I have two standard deviations for my measurement data. Unfortunately one of them is in a log scale while the other is in a normal scale. I need to add them so that ultimately, I would have only one ...
2
votes
0answers
125 views

Can I interpret Standardized Regression Coefficients for an Interaction Term?

can I interpret standardized regression coefficients for an interaction term that is based on a binary and continuous variable? How would I interpret it: Would I add the standardized coefficients if ...
1
vote
1answer
98 views

No need for standardization with Adadelta? (RNN/LSTM)

Often it is best to standardize data before inputting it into a machine learning algorithm. This is also the case with deep learning algorithms such as convolutional neural network. However, when ...
6
votes
5answers
348 views

Standardizing a Standard normal Variable

If I standardize a standard normal random variate , will it be still standard normal ? That is, if $X\sim N(0,1)$ , then can I do $$X^*=\frac{x-\bar x}{sd(x)}$$ ? and will $X^*\sim N(0,1)$ ? In ...
2
votes
1answer
56 views

Standardized beta on standardized variables

I am having trouble understanding why the standardized beta option in regress in Stata gives me different results when I ...
0
votes
1answer
79 views

Standardization before applying ANOVA?

I have a matrix where the rows are the data points (samples) and the columns are the features. It is a multiclass (4 classes) problem. On this data I want to apply machine learning classifiers. But ...
2
votes
0answers
42 views

Test-retest correlation for panel data

I've run an experiment in which subjects rate how much they like six different objects on a 1-5 scale on two occasions. I'd like to obtain a summary measure of how consistent are the subjects in their ...
0
votes
0answers
28 views

What is the name of this procedure?

Frequently, normalization means subtracting the mean and dividing by SD. What if one standardizes the data by subtracting the median and dividing by interquartile range? Does that procedure have a ...
0
votes
0answers
48 views

What is the limitation with using a pooled standard deviation in a dependant sample?

I am not very experienced in statistics, but want to perform a meta-analysis on a number of pre-post studies. The studies have relatively small sample size ranging from around 10-38 subjects. They are ...
0
votes
0answers
195 views

Normalization or standardization for distances in a Q-mode cluster and principal components analyses

I want to run a cluster analysis and a PCA between some sites to classify them in terms of their multivariate dissimilarity. This is a Q-mode analysis. I am working on a data matrix made of sites in ...