I'm working on a binary classification problem using 10 predictors. I have 4508 data points. I am required to have a prediction scheme which achieves an accuracy of 80% or better. However I am discouraged by the appearance of my data. It seems like the classification problem is not possible with what I have been given. Here are two group/scatter plots over two pairs of predictors. (It's same over all pairs.)
What do you recommend?
Update: Here is a non-linear embedding of a subset of the data into 2 dimensions. Red colours are class one and blue colours are class zero. (Sorry for the picture size)