Meaning of unusual residual plot

I'm trying to use a residual plot in order to get a better understanding of my dataset and what I should be doing.

My data is a series of scored labels with a bunch of distance features used to predict them. I'm hoping to use linear regression.
When I generated my residual plot I ended up with the following unusual graph which I haven't seen before. In my limited knowledge I'm aware that ideally a Residual plot should contain a cluster of points with a mean of 0. In a bad case scenario the plot is non random, most examples indicate a spiked residual error value at a given predicted value.

My graph however looks nothing like examples I have seen and I'm not certain how to interpret it. Could is perhaps be that my dataset is not suited for a regression model? What does the residual plot indicate about my data?

Additonal Information that may be useful: r2 value: 0.32812704493994505

• It looks to me as if the model is missing some predictive factor, in part because the regression line does not pass through two groups of points on the plots. I suggest visually inspecting scatterplots of the raw data to see if a non-linear relationship might be apparent. – James Phillips May 1 '18 at 11:43
• It sounds like a "scored label" might merely be an arbitrary assignment of numbers to distinguish different values of a response. If so, your model is unlikely to work well (and the residuals show that). Could you explain more about these "scores"? – whuber May 1 '18 at 11:48
• Thanks for the advice about investigating scatterplots. A non-linear relationship did occur to me. The scores are indeed arbitrary. They represent the level of match between two users as labelled by someone based on some values. Is this not a application for a regression model? I've been sceptical about whether this would work from the onset however I was told to do it anyway. The only data available was a series of lists for each user consisting of roles they picked. These roles were then turned into distance values by way of turning them into a tree like structure and measuring distances. – harrison May 1 '18 at 12:06
• It looks like you have a categorical predictor with five levels and one or more continuous predictors. Can you give more details about your model? – mdewey May 1 '18 at 12:30
• Consider an ordinal regression model. It will automatically handle the nonlinearity. – whuber May 1 '18 at 12:35