4
$\begingroup$

The following is written on the Wikipedia entry of Taxicab Geometry:

The [taxicab] geometry has been used in regression analysis since the 18th century, and is often referred to as LASSO.

Unfortunately, no references are given on this point. I would appreciate if someone could explain this connection or point me to a reference.

$\endgroup$
1
  • 1
    $\begingroup$ I am not sure Wikipedia is correct: isn't there a distinction between regression to minimise the sum of absolute residuals and regression to minimise the sum of squares of residuals constrained by a sum of absolute parameters or a penalty based on a sum of absolute parameters? $\endgroup$
    – Henry
    Commented Oct 6, 2023 at 9:44

2 Answers 2

5
$\begingroup$

“Taxicab geometry” refers to the $\ell_1$ norm in linear algebra or functional analysis, where, loosely speaking, you only travel left/right or up/down (never diagonal), kind of like how a taxicab drives on a the roads of a city with a grid layout (think of the dominant pattern in Manhattan).

LASSO regression uses the $\ell_1$ norm of the parameter vector (often without the intercept), giving the connection to taxicab geometry.

$\endgroup$
1
  • 6
    $\begingroup$ I've also seen this referred to as "Manhattan distance" for the same reason. $\endgroup$
    – G_B
    Commented Oct 6, 2023 at 3:54
0
$\begingroup$

Taxicab geometry is also commonly referred to as Manhattan distance as Manhattan (a subdivision of New York, USA) has an exceptional number of roads which meet at right angles, and uses a numerical based indexing system (see https://www.etsy.com/listing/224325979/manhattan-map-prints-and-manhattan-wall for an example of how angular the roads are).

The reason it's called Taxicab distance is this is the distance a taxi would need to drive and since it's all right angles and easily indexed, taxis could usually pre-compute the approximate cost of taking you places in Manhattan.

LASSO is used to refer to regularizing using Manhattan distance. Personally, I believe this is a backronym because a Lasso is a rope knot which shrinks to hold things tight (usually livestock) making it an easy mnemonic to remember that it shrinks the parameter magnitude (and often number of parameters)

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.