Geometry of robust linear model $L_2$ minimisation has a very nice geometric explanation as projection onto a subspace of the appropriate size. Is there a similar "real explanation" for any of the approaches to robust regression?
Edit: For example Huber's M estimates of regression and Yohai's MM estimator of regression.
 A: Yes! Robust regression has a clear geometric interpretation. 
One can think about the geometry of an estimator by looking at the group of equivariance to which it belongs. Quick example; 
Example  scale estimator $S(x)$ (the usual variance, $\sigma^2(x)$, and the median absolute deviation, $\mbox{mad}(x)$, are two cart bearing members of this group) are  equivariant  to multiplications of the data by a constant: 
$$S(\alpha x)=|\alpha|S(x),\quad\alpha\in\mathbb{R}$$
In other words, the group of equivariance defines the transformations of the data which, in some sense, you don't need to care about when using the estimator because when such a transformation is applied to the data, the estimator changes with the data 'in the natural way'.  
These groups of equivariance also have bearing on important properties of the estimators such as consistency. 

Likewise, a regression estimator $T(\pmb x,y)\in\mathbb{R}^p$ is characterized by at least two group of equivariance:


*

*$T(\pmb x,y)$ is regression equivariant: 
$$T(\pmb x,y+\pmb\beta'x)=T(\pmb x,y)+\pmb\beta,\quad\pmb\beta\in\mathbb{R}^p$$

*$T(\pmb x,y)$ is affine equivariant: 
$$T(\pmb x\pmb A,y)=\pmb A^{-1}T(\pmb x,y)$$
for any non singular matrix $\pmb A\in\mathbb{R}^{p\times p}$.
This implies that $T(\pmb x,y)$ is residual admissible: the regression estimates only depend on the data through the vector of residuals. 


The regression estimator estimated by rlm, like the usual OLS estimators, all satisfy affine and regression equivariance.

Note that there exist some robust regression estimators that belong to group of equivariance to which OLS doesn't belong (e.g. that have in this sense a stronger geometry than OLS). Think of invariance to monotone transformations that holds for quantile-based estimators such as the $\mbox{mad}(x)$ (and in the case of monotone transformation of the responses for quantile regression) but not for the variance (or the usual OLS estimators).
