I'm reviewing the kernel trick and there are a lot of toy examples of how a 2D classification which can't usually be separated by a linear SVM can be separated in 3 space.
This is fine, but how is the kernel trick applied in a real environment where you have maybe hundreds of features? The immediate problem I see is that you can't visualize that many dimensions. So how would one even know what, if any, kernel needs to be used?
Off the top of my head, it seems like if you did dimensionality reduction first to get down to 3D, then maybe one would have an easier time applying the kernel trick.