Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results for curse dimensional*
Search options not deleted
23 votes
4 answers
5k views

Does "curse of dimensionality" really exist in real data?

I understand what is "curse of dimensionality", and I have done some high dimensional optimization problems and know the challenge of the exponential possibilities. … (In most books "curse of dimensionality" says dimension > 10 could be problematic. In their demos they use uniform distribution in all dimensions, where entropy is really high. …
Haitao Du's user avatar
  • 37.3k
110 votes
13 answers
41k views

Explain "Curse of dimensionality" to a child

I heard many times about curse of dimensionality, but somehow I'm still unable to grasp the idea, it's all foggy. … How would the increase of dimensionality make the job of clustering their toys harder? …
Kobe-Wan Kenobi's user avatar
5 votes
2 answers
2k views

curse of dimensionality & nonparametric techniques

I have seen it many times in a number of articles that nonparametric techniques are subject to the curse of dimensionality, which may lead to the failure of these methods. Why does this happen? …
shijing SI's user avatar
1 vote
1 answer
365 views

Deep learning and curse of dimensionalty

From "] Learning Deep Architectures for AI". see: http://www.iro.umontreal.ca/~lisa/pointeurs/TR1312.pdf (see section 3.1) "The local generalization issue is directly connected to the literature on the curse … of dimensionality, but the results we cite show that what matters for generalization is not dimensionality, but instead the number of “variations” of the function we wish to obtain after learning. …
lars's user avatar
  • 297
4 votes
3 answers
336 views

Curse of dimensionality: How PCA improves my model?

After having read about the curse of dimensionality, I have been looking into a filtered version of the Superconductivity dataset. … Is there any possible situation where reducing the dimensionality of the data lead to a increase of the prediction power? …
Alfonso_MA's user avatar
0 votes
0 answers
20 views

Curse of dimensionality in Time series with K-means

I have been looking at the following notebook: time series clustering where the writer says that the dataset is affected by the "Curse of Dimensionality", so applying TimeSeriesKMeans offered by tslearn … The dataset in the article has only 2 features (timestamp, value) and many data, so in my opinion, there is no "Curse of dimensionality", hence doing the PCA on all the "value" columns is useless. …
Zackbord's user avatar
3 votes
0 answers
866 views

How is UMAP a valid dimensionality reduction technique when it uses KNN, which suffers from ...

UMAP is touted as an excellent dimensionality reduction technique by constructing a high-dimensional topological graph, and then reconstructing said graph in low dimensional space. … If we're using UMAP to escape the curse of dimensionality by collapsing some of the feature space, why are we uses KNN to do this, a technique which suffers directly from the curse of dimensionality? …
Julian L's user avatar
  • 134
8 votes
2 answers
607 views

PCA as a Cure for the Curse of Dimensionality

I would like some clarification as to how principal component analysis mitigates the Curse of Dimensionality problem. … How have I evaded the Curse of Dimensionality? It is really not obvious to me. …
Andrew Beaven's user avatar
6 votes
0 answers
508 views

How does UMAP deals with the curse of dimensionality?

The curse of dimensionality states that in high dimension every distance between pairs of points tends to be the same. See this answer for more details. …
maRmat's user avatar
  • 169
8 votes
1 answer
2k views

Why is the curse of dimensionality also called the empty space phenomenon?

The curse of dimensionality refers to the fact that the huge number of correlated features tends to increase the complexity of the treatment that has to be applied to the data set. …
Joseph Stone's user avatar
15 votes
4 answers
13k views

PCA on high-dimensional text data before random forest classification?

I'm dealing with high dimensional text data, and I want to do feature reduction to help avoid the curse of dimensionality, but don't Random Forests already to some sort of dimension reduction? …
Maus's user avatar
  • 253
0 votes
0 answers
596 views

Mean shift clustering and the curse of dimensionality

(1) First point where the curse of dimensionality starts to bother us: Where exactly the breaking down (vanishing) of KDE prevents us from having good clusters? …
Mathmath's user avatar
  • 761
1 vote
0 answers
101 views

the accuracy of covariance between two high-dimensional vectors

Question Is the covariance between high-dimensional vectors less accruate than covariance between two vectors in low-dimensional vecotrs? … We have 10 day-long vectors(10 dimensional) 2 vectors above. …
Eiffelbear's user avatar
1 vote
0 answers
181 views

How much data versus dimensions are needed to overcome the curse of dimensionality?

Are there any guidelines for knowing how many training samples are needed based on the number of features you have in order to not have accuracy degradation as a result of the curse of dimensionality? …
user123959's user avatar
2 votes
2 answers
4k views

The curse of dimensionality? (linear SVMs)

I feel like the dimensionality is affecting my results - is there a way to check if it's true? Do I need to have several examples for each combination of the feature values? …
user3010273's user avatar

1
2 3 4 5
15 30 50 per page