Skip to main content
Bumped by Community user
Bumped by Community user
Bumped by Community user
Bumped by Community user
added 135 characters in body
Source Link
sitnarf
  • 129
  • 3

The objective of clustering is to find interesting groups in data. My question is, whether feature selection can substantially help with this objective.

I understand feature selection can remove redundant variables, which might help with interpretation. However, the feature selection finds a subset by optimizing for compactness/separation. Thus, it might find a subset, which has a higher compactness/separation but actually has lower association with the concept I am looking for.

Doesn't make more sense to manually select the features, because it is, in fact, defining the task I am interested in?


More clarification: In supervised learning there is a label, that defines a task. Then, I can remove features or do anything else, as long as it predicts the label. In clustering, on the other hand, the definition of a task are the unlabeled data itself. Thus, by changing the data (feature selection) I am changing the task and might searching for something not meaningful.

The objective of clustering is to find interesting groups in data. My question is, whether feature selection can substantially help with this objective.

I understand feature selection can remove redundant variables, which might help with interpretation. However, the feature selection finds a subset by optimizing for compactness/separation. Thus, it might find a subset, which has higher compactness/separation but actually has lower association with the concept I am looking for.

Doesn't make more sense to manually select the features, because it is, in fact, defining the task I am interested in?

The objective of clustering is to find interesting groups in data. My question is, whether feature selection can substantially help with this objective.

I understand feature selection can remove redundant variables, which might help with interpretation. However, the feature selection finds a subset by optimizing for compactness/separation. Thus, it might find a subset, which has a higher compactness/separation but actually has lower association with the concept I am looking for.

Doesn't make more sense to manually select the features, because it is, in fact, defining the task I am interested in?


More clarification: In supervised learning there is a label, that defines a task. Then, I can remove features or do anything else, as long as it predicts the label. In clustering, on the other hand, the definition of a task are the unlabeled data itself. Thus, by changing the data (feature selection) I am changing the task and might searching for something not meaningful.

Post Reopened by mkt, mdewey, Tim
added 135 characters in body
Source Link
sitnarf
  • 129
  • 3

The objective of clustering is to find interesting groups in data. My question is, whether feature selection can substantially help with this objective.

I understand feature selection can remove redundant variables (correlated), which might help with interpretation. However, the feature selection finds a subset by optimizing for compactness/separation. Thus, it might find a subset, which has higher compactness/separation but actually has lower association with the concept I am looking for.

Doesn't make more sense to manually select the features, because it is, in fact, defining the task I am interested in?

I understand feature selection can remove redundant variables (correlated), which might help with interpretation. However, the feature selection finds a subset by optimizing for compactness/separation. Thus, it might find a subset, which has higher compactness/separation but actually has lower association with the concept I am looking for.

Doesn't make more sense to manually select the features, because it is, in fact, defining the task I am interested in?

The objective of clustering is to find interesting groups in data. My question is, whether feature selection can substantially help with this objective.

I understand feature selection can remove redundant variables, which might help with interpretation. However, the feature selection finds a subset by optimizing for compactness/separation. Thus, it might find a subset, which has higher compactness/separation but actually has lower association with the concept I am looking for.

Doesn't make more sense to manually select the features, because it is, in fact, defining the task I am interested in?

deleted 46 characters in body; edited title
Source Link
sitnarf
  • 129
  • 3

Does automatic feature selection for clustering make sensehelps with finding meaningful clusters?

Let's say I have a reasonable amount of featuresunderstand feature selection can remove redundant variables (~30correlated), which might help with interpretation. My understanding isHowever, that features included represent the task defined byfeature selection finds a data scientistsubset by optimizing for compactness/separation. Thus, by using different set of features, Iit might befind a subset, which has higher compactness/separation but actually exploring very different concepts insidehas lower association with the data.concept I understand removing redundantam looking for.

Doesn't make more sense to manually select the features thought, sincebecause it might helpis, in fact, defining the interpretability and does not change clustering result.task I am interested in?

Does automatic feature selection for clustering make sense?

Let's say I have a reasonable amount of features (~30). My understanding is, that features included represent the task defined by a data scientist. Thus, by using different set of features, I might be actually exploring very different concepts inside the data. I understand removing redundant features thought, since it might help the interpretability and does not change clustering result.

Does automatic feature selection for clustering helps with finding meaningful clusters?

I understand feature selection can remove redundant variables (correlated), which might help with interpretation. However, the feature selection finds a subset by optimizing for compactness/separation. Thus, it might find a subset, which has higher compactness/separation but actually has lower association with the concept I am looking for.

Doesn't make more sense to manually select the features, because it is, in fact, defining the task I am interested in?

Post Closed as "Needs details or clarity" by Peter Flom
deleted 2 characters in body
Source Link
sitnarf
  • 129
  • 3
Loading
Source Link
sitnarf
  • 129
  • 3
Loading