User theGD

361

votes

3

answers

231k

views

Relationship between SVD and PCA. How to use SVD to perform PCA?

Aug 20 '18 at 19:03 amoeba says Reinstate Monica 75.2k

112

votes

6

answers

54k

views

Should one remove highly correlated variables before doing PCA?

correlation pca

Sep 16 '16 at 19:34 Community♦ 1

99

votes

6

answers

48k

views

Why L1 norm for sparse models

regression lasso regularization ridge-regression

Sep 9 '18 at 5:39 solver149 188

99

votes

9

answers

178k

views

What is the difference between linear regression on y with x and x with y?

regression correlation linear-model pearson-r

Feb 10 at 12:43 SiXUlm 228

95

votes

2

answers

175k

views

What is covariance in plain language?

correlation repeated-measures terminology covariance independence

Oct 9 '13 at 15:19 Community♦ 1

85

votes

7

answers

36k

views

Bias and variance in leave-one-out vs K-fold cross validation

machine-learning variance cross-validation bias bias-variance-tradeoff

May 5 at 1:39 Vincent Granville 701

68

votes

5

answers

111k

views

Loadings vs eigenvectors in PCA: when to use one or another?

pca

Oct 23 '18 at 8:28 D.Zhang 1

59

votes

7

answers

9k

views

Optimization when Cost Function Slow to Evaluate

gradient-descent optimization bayesian-optimization

Nov 5 at 17:25 Sycorax says Reinstate Monica 51.3k

54

votes

3

answers

62k

views

Using principal component analysis (PCA) for feature selection

r pca feature-selection

Jul 17 '15 at 11:37 chl 46.6k

54

votes

7

answers

26k

views

Best PCA algorithm for huge number of features (>10K)?

pca algorithms model-evaluation high-dimensional

Apr 25 at 7:42 Kolya Ivankov 151

47

votes

3

answers

9k

views

Understanding Naive Bayes

machine-learning naive-bayes

Feb 5 at 21:17 Matt Krause 16.2k

41

votes

5

answers

49k

views

How to derive the ridge regression solution?

regression least-squares regularization ridge-regression

Aug 29 '18 at 7:27 Ferdi 4,371

37

votes

3

answers

3k

views

Variance of $K$-fold cross-validation estimates as $f(K)$: what is the role of “stability”?

regression machine-learning variance cross-validation predictive-models

Oct 13 '18 at 1:01 Community♦ 1

36

votes

3

answers

58k

views

How to estimate shrinkage parameter in Lasso or ridge regression with >50K variables?

r lasso ridge-regression high-dimensional

Jul 27 '15 at 4:19 smci 1,258

35

votes

3

answers

21k

views

How to select a clustering method? How to validate a cluster solution (to warrant the method choice)?

clustering validation model-evaluation hierarchical-clustering

Mar 13 at 9:30 ttnphns 43.3k

33

votes

2

answers

5k

views

Theory behind partial least squares regression

regression references regularization svd partial-least-squares

Dec 3 '17 at 13:38 amoeba says Reinstate Monica 75.2k

32

votes

1

answer

26k

views

PCA objective function: what is the connection between maximizing variance and minimizing error?

pca optimization

Feb 3 '15 at 12:50 Community♦ 1

32

votes

3

answers

31k

views

How to draw neat polygons around scatterplot regions in ggplot2 [closed]

ggplot2 scatterplot

Jul 19 '17 at 19:07 Charles Martin 51

29

votes

1

answer

17k

views

Proof that the coefficients in an OLS model follow a t-distribution with (n-k) degrees of freedom

regression linear-model least-squares t-distribution

Dec 11 '14 at 22:01 Community♦ 1

26

votes

1

answer

6k

views

PCA, LDA, CCA, and PLS

pca discriminant-analysis partial-least-squares canonical-correlation

Jan 30 '15 at 17:50 amoeba says Reinstate Monica 75.2k

25

votes

3

answers

30k

views

What is the relationship between orthogonal, correlation and independence?

correlation independence

Nov 13 '18 at 23:20 linan huang 1

21

votes

2

answers

914

views

The limit of “unit-variance” ridge regression estimator when $\lambda\to\infty$

pca regularization ridge-regression partial-least-squares constrained-regression

Oct 24 at 21:07 Sextus Empiricus 13.5k

19

votes

1

answer

21k

views

Not normalizing data before PCA gives better explained variance ratio

pca

Jul 3 '14 at 9:54 Matt.135 601

19

votes

3

answers

7k

views

Relationship between ridge regression and PCA regression

regression pca regularization ridge-regression

Nov 21 '18 at 7:07 davidhigh 1,130

16

votes

1

answer

38k

views

What is “feature space”?

machine-learning svm feature-selection cart feature-construction

Aug 1 '18 at 21:44 minggli 3

15

votes

4

answers

3k

views

The proof of equivalent formulas of ridge regression

regression lasso regularization ridge-regression lagrange-multipliers

Apr 3 at 4:15 Royi 711

14

votes

2

answers

2k

views

Why linear regression has assumption on residual but generalized linear model has assumptions on response?

regression generalized-linear-model assumptions linear

Feb 24 '18 at 2:27 Cliff AB 15.5k

13

votes

2

answers

4k

views

From a statistical perspective: Fourier transform vs regression with Fourier basis

fourier-transform functional-data-analysis

Jan 7 '17 at 9:07 DeltaIV 12.2k

13

votes

2

answers

539

views

What is Bayesian Deep Learning?

bayesian deep-learning

Apr 5 '18 at 3:29 Zen 18.8k

10

votes

1

answer

3k

views

Is PCA still done via the eigendecomposition of the covariance matrix when dimensionality is larger than the number of observations?

pca

Jun 30 '16 at 13:28 Community♦ 1

Stack Exchange Network

current community

your communities

more stack exchange communities

Next privilege

Next badge

37 Favorites

Relationship between SVD and PCA. How to use SVD to perform PCA?

Should one remove highly correlated variables before doing PCA?

Why L1 norm for sparse models

What is the difference between linear regression on y with x and x with y?

What is covariance in plain language?

Bias and variance in leave-one-out vs K-fold cross validation

Loadings vs eigenvectors in PCA: when to use one or another?

Optimization when Cost Function Slow to Evaluate

Using principal component analysis (PCA) for feature selection

Best PCA algorithm for huge number of features (>10K)?

Understanding Naive Bayes

How to derive the ridge regression solution?

Variance of $K$-fold cross-validation estimates as $f(K)$: what is the role of “stability”?

How to estimate shrinkage parameter in Lasso or ridge regression with >50K variables?

How to select a clustering method? How to validate a cluster solution (to warrant the method choice)?

Theory behind partial least squares regression

PCA objective function: what is the connection between maximizing variance and minimizing error?

How to draw neat polygons around scatterplot regions in ggplot2 [closed]

Proof that the coefficients in an OLS model follow a t-distribution with (n-k) degrees of freedom

PCA, LDA, CCA, and PLS

What is the relationship between orthogonal, correlation and independence?

The limit of “unit-variance” ridge regression estimator when $\lambda\to\infty$

Not normalizing data before PCA gives better explained variance ratio

Relationship between ridge regression and PCA regression

What is “feature space”?

The proof of equivalent formulas of ridge regression

Why linear regression has assumption on residual but generalized linear model has assumptions on response?

From a statistical perspective: Fourier transform vs regression with Fourier basis

What is Bayesian Deep Learning?

Is PCA still done via the eigendecomposition of the covariance matrix when dimensionality is larger than the number of observations?