Questions tagged [optimal-scaling]

Optimal scaling or optimal quantification is an algorithmic approach to transform categorical variables into scale (interval) ones which would be "optimal" in some statistical sense (for example, their linear correlations will be maximized). There exist nonlinear "optimal scaling versions" of many classic linear kinds of analysis, including regression, PCA, etc.

Filter by
Sorted by
Tagged with
4 votes
1 answer
2k views

scaling for SVM destroys my results [duplicate]

I'm applying standard 0-1 scaling of features before SVM classification for financial data but the results are worse. This is the results before scaling ...
Krzysztof Fajst's user avatar
5 votes
1 answer
3k views

What is the advantage of transforming variables from nominal to ordinal/numerical when it reduces variance explained in CatPCA?

Context I have a dataset of 8 categorical variables. And I want to apply Categorical Principal Component Analysis (CatPCA). Before doing that, I have been advised to look at the transformation plots ...
Tune's user avatar
  • 51
9 votes
1 answer
3k views

How can I use optimal scaling to scale an ordinal categorical variable?

In an answer to this question about treating categorical data as continuous, optimal scaling was mentioned. How does this method work and how is it applied?
Freya Harrison's user avatar
7 votes
1 answer
231 views

How can we verify the intuition that in the RW-Metropolis-Hastings algorithm with Gaussian proposal too small and too large variances are bad choices

Let $d\in\mathbb N$ and consider the Random Walk Metropolis-Hastings algorithm with a Gaussian proposal kernel $Q$ such that $Q(x,\;\cdot\;)=\mathcal N_d(x,\sigma^2_dI_d)$ for all $x\in\mathbb R^d$. ...
0xbadf00d's user avatar
  • 281
6 votes
1 answer
166 views

How does the celebrated result about the diffusion limit of the Random Walk Metroplis-Hastings algorithm help us to find the optimal scaling

Let $d\in\mathbb N$ with $d>1$ $\ell>0$ $\sigma_d^2:=\frac{\ell^2}{d-1}$ $f\in C^2(\mathbb R)$ be positive with $$\int f(x)\:{\rm d}x=1$$ and $g:=\ln f$ $Q_d$ be a Markov kernel on $(\mathbb R^...
0xbadf00d's user avatar
  • 281
6 votes
1 answer
1k views

Scaling regression coefficients Take 2: Gelman (2008) approach

I am asking a follow-up question about interpreting regression coefficients that have been scaled following Gelman's (2008, 2009) recommendations. Original recommendation to divide continuous ...
ksroogl's user avatar
  • 413
4 votes
1 answer
134 views

Estimate the asymptotic efficiency of a Markov chain sampling by the method of batching

In the paper Efficient Metropolis Jumping Rules, the author is writing that he used "the method of batching" for the estimation of $\operatorname{eff}_{\overline\theta_i}$ in Table 1 (on page 605). ...
0xbadf00d's user avatar
  • 281
3 votes
2 answers
2k views

How to understand optimal Scaling in R: The Package homals for novices

Does anyone know of a step-by-step guide for the practical implementation of Gifi Methods for Optimal Scaling in R: The Package homals? Although I have an OK theoretical understanding (thanks chl for ...
Mike's user avatar
  • 71
1 vote
1 answer
773 views

Optimal scaling level for variables categorized from continuous data

A variable was categorized into $10$ equally spaced intervals from a continuous variable which was originally in proportion. Now, we have to use this variable in ...
Blain Waan's user avatar
  • 3,595
0 votes
1 answer
330 views

K-means to cluster texts, scaling

I want to cluster a folder of texts. I created a data file where for each text, I write whether a certain word appears in it or not. I want to cluster according to this. So my matrix is globally only ...
Marine Galantin's user avatar
0 votes
1 answer
1k views

categorical predictors in partial least squares

I am interested in running a partial least squares analysis using PROC PLS in SAS 9.4. I understand that, by default, the predictors and response variables in PLS are centered to a mean 0 and scaled ...
Mark G's user avatar
  • 1