A linear pattern occurs on my residual plot: what can I do? I'm a bit stuck with a problem here and any kind of help would help a lot :)
Just to give a clue about my data. I have 6 independant variables (IV) which are:

*

*$X_1$ = Population -within a block-

*$X_2$ = Households -within a block-

*$X_3$ = Total Rooms -aggregated-

*$X_4$ = Total Bedrood -aggregated-

*$X_5$ = Median Income

*$X_6$ = Ocean Proximity [Categorical]

and my dependant variable (DV) is $Y$ = Median House Price.
I ran a regression including all IVs but there is a violation for almost all OLS assumptions in addition to huge multicollinearity. Here are the residual plot and normality plot before any adjustments.

What I did then is transform all my IVs and my DV using the Box-Tidwell method which I think it is not the correct way of solving the issue so this is my first question what can I do to solve the normality issue?
The other problem is that even after transforming all variables I still have an issue in my residual plot which is the main problem here. I have a linear pattern on the graph that I don't know how to solve. I run my DV against each IV separately and still have the same issue. Here is the graph for the transformed model.

 A: Residuals following a linear boundary are typically the result of a ceiling effect or a floor effect. If your sample is large enough, the results are biased only slightly (note that linear models are quite robust to normality violations if you are working with a large sample, unlike, for example, homoskedasticity violations ).
Basically, you have two options. You can use a different model (e.g. lognormal regression, Poisson regression, depending on the specific data), or you can ignore the problem and rely on the fact that the results are only slightly biased since you have a large data set.
A: Regarding the linear pattern: this happens frequently when your response takes the same value for a number of observations. For those observations, $(y-pred)$ is of course a linear function of $pred$, as $y$ is constant.
A: Just to help you understand what you are looking at a bit better on your residual plot, your data looks something like this:

Your model is fine until the price gets capped; then you need to determine whether the rest of the model is valid or not. The capped price has to be due to unrecorded data above that price because you would not expect to see data like that in reality for your particular problem. So then you have to think about what the data looks like above that price. It may be that the linear relationship no longer holds once you go above the grey line and this would be a limitation of using a linear model here. The data may curve and flatten off in reality, in which case a logarithmic curve would fit much better, so it would be unwise to predict data above that line with a linear model.
Also, do you care what happens above the grey line, or do you only need the model for the part where the model is valid? If you are only interested in the portion of the model that is valid, then you don't need to worry about the rest. These are some of the things you might want to think about.
A: I'm not sure why the linear model, with its many assumptions, was chosen as the default model.  Ordinal semiparametric models are very efficient and are invariant to how Y is transformed.  They allow for floor and ceiling effects, bimodality, and any other kind of distributional quirks you can throw at them.  The most popular semiparametric models are the proportional odds and proportional hazards models.
I would also not want to assume up front that the continuous predictors operate linearly.  I'd expand them using regression splines such as restricted cubic splines (aka natural splines).  A detailed case study may be found in Chapter 11 of the RMS course notes.
