When computing the mean squared error of a regression model, we get a metric in square units. For ease of interpretation, we can therefore instead compute the root mean squared error, which are in units of the target variable and also in a value range that is is closer to the actual values that we are predicting, and hence easier to reason about that the squared errors which can be several orders of magnitude larger.

As I understand it, Brier score is a mean squared error for probabilistic classification outputs. Granted that probabilities don't have units, I would have expected it to still be more straightforward to report the probabilistic error as "root Brier score" as this would allow us to talk about the average probability deviation of the model instead of the average squared probability deviation. The latter not only seems less intuitive to me, but also means that it would bias towards lower numbers since squaring probabilities would make them smaller.

I noticed that there is something called a Brier Skill Score, which seems to be similar to a $R^2$ score in the sense that it is comparing the model towards a baseline model. I also found this post Name of mean absolute error analogue to Brier score? explaining the lack of an absolute version of the Brier score: it is not a proper scoring rule (although I don't fully understand the linked paper). It also makes sense that something like MAPE does not need to exist as probabilities are bounded 0-1. However, I could not find anything on a "root Brier score". I wonder if there is a fundamental reason for this, e.g. something related to the 0-1 probability space, that makes this variation of the Brier score redundant or if there are other reasons (maybe just the lack of units and that the scale distortion of squaring is not as large for probabilities?) that it is not used to the same extent as RMSE is used in regular regression problems.

When computing the mean squared error of a regression model, we get a metric in square units. For ease of interpretation, we can therefore instead compute the root mean squared error, which are in units of the target variable and also in a value range that is is closer to the actual values that we are predicting, and hence easier to reason about than the squared errors which can be several orders of magnitude different.

As I understand it, Brier score is a mean squared error for probabilistic classification outputs. Granted that probabilities don't have units, I would have expected it to still be more straightforward to report the probabilistic error as "root Brier score" as this would allow us to talk about the average probability deviation of the model instead of the average squared probability deviation. The latter not only seems less intuitive to me, but also means that it would bias towards lower numbers since squaring probabilities would make them smaller.

I noticed that there is something called a Brier Skill Score, which seems to be similar to a $R^2$ score in the sense that it is comparing the model towards a baseline model. I also found this post Name of mean absolute error analogue to Brier score? explaining the lack of an absolute version of the Brier score: it is not a proper scoring rule (although I don't fully understand the linked paper). It also makes sense that something like MAPE does not need to exist as probabilities are bounded 0-1. However, I could not find anything on a "root Brier score". I wonder if there is a fundamental reason for this, e.g. something related to the 0-1 probability space, that makes this variation of the Brier score redundant or if there are other reasons (maybe just the lack of units and that the scale distortion of squaring is not as large for probabilities?) that it is not used to the same extent as RMSE is used in regular regression problems.

When computing the mean squared error of a regression model, we get a metric in square units. For ease of interpretation, we can therefore instead compute the root mean squared error, which are in units of the target variable and also in a value range that is is closer to the actual values that we are predict, and hence easier to reason about that the squared errors which can be several order of magnitudes larger.

As I understand it, Brier score is a mean squared error for probabilistic classification outputs. Granted that probabilities don't have units, I would have expected it to still be more straightforward to report the probabilistic error as "root Brier score" as this would allow us to talk about the average probability deviation of the model instead of the average squared probability deviation. The latter not only seems less intuitive to me, but also means that it would bias towards lower numbers since squaring probabilities would make them smaller.

I noticed that there is something called a Brier Skill Score, which seems to be similar to a R^2 score in the sense that it is comparing the model towards a baseline model. I also found this post Name of mean absolute error analogue to Brier score? explaining the lack of an absolute version of the Brier score with that it is not a proper scoring rule (although I don't fully understand the linked paper). It also makes sense that something like MAPE does not need to exist as probabilities are bounded 0-1. However, I could not find anything on a "root Brier score". I wonder if there is a fundamental reason for this, e.g. something related to the 0-1 probability space, that makes this variation of the Brier score redundant or if there are other reasons (maybe just the lack of units and that the scale distortion of squaring is not as large for probabilities?) that it is not used to the same extend as RMSE is used in regular regression problems.

When computing the mean squared error of a regression model, we get a metric in square units. For ease of interpretation, we can therefore instead compute the root mean squared error, which are in units of the target variable and also in a value range that is is closer to the actual values that we are predicting, and hence easier to reason about that the squared errors which can be several orders of magnitude larger.

As I understand it, Brier score is a mean squared error for probabilistic classification outputs. Granted that probabilities don't have units, I would have expected it to still be more straightforward to report the probabilistic error as "root Brier score" as this would allow us to talk about the average probability deviation of the model instead of the average squared probability deviation. The latter not only seems less intuitive to me, but also means that it would bias towards lower numbers since squaring probabilities would make them smaller.

I noticed that there is something called a Brier Skill Score, which seems to be similar to a $R^2$ score in the sense that it is comparing the model towards a baseline model. I also found this post Name of mean absolute error analogue to Brier score? explaining the lack of an absolute version of the Brier score: it is not a proper scoring rule (although I don't fully understand the linked paper). It also makes sense that something like MAPE does not need to exist as probabilities are bounded 0-1. However, I could not find anything on a "root Brier score". I wonder if there is a fundamental reason for this, e.g. something related to the 0-1 probability space, that makes this variation of the Brier score redundant or if there are other reasons (maybe just the lack of units and that the scale distortion of squaring is not as large for probabilities?) that it is not used to the same extent as RMSE is used in regular regression problems.

When computing the mean squared error of a regression model, we get a metric in square units. For ease of interpretation, we can therefore instead compute the root mean squared error, which are in units of the target variable and also in a value range that is is closer to the actual values that we are predict, and hence easier to reason about that the squared errors which can be several order of magnitudes larger.

As I understand it, Brier score is a mean squared error for probabilistic classification outputs. Granted that probabilities don't have units, I would have expected it to still be more straightforward to report the probabilistic error as "root Brier score" as this would allow us to talk about the average probability deviation of the model instead of the average squared probability deviation. The latter not only seems less intuitive to me, but also means that it would bias towards lower numbers since squaring probabilities would make them smaller.

I noticed that there is something called a Brier Skill Score, which seems to be similar to a R^2 score in the sense that it is comparing the model towards a baseline model. I also found this post Name of mean absolute error analogue to Brier score? explaining the lack of an absolute version of the Brier score with that it is not a proper scoring rule (although I don't fully understand the linked paper). It also makes sense that something like MAPE does not need to exist as probabilities are bounded 0-1. However, I could not find anything on a "root Brier score". I wonder if there is a fundamental reason for this, e.g. something related to the 0-1 probability space, that makes this variation of the Brier score redundant or if there are other reasons (maybe just the lack of units?) that it is not used to the same extend as RMSE is used in regular regression problems.

When computing the mean squared error of a regression model, we get a metric in square units. For ease of interpretation, we can therefore instead compute the root mean squared error, which are in units of the target variable and also in a value range that is is closer to the actual values that we are predict, and hence easier to reason about that the squared errors which can be several order of magnitudes larger.

As I understand it, Brier score is a mean squared error for probabilistic classification outputs. Granted that probabilities don't have units, I would have expected it to still be more straightforward to report the probabilistic error as "root Brier score" as this would allow us to talk about the average probability deviation of the model instead of the average squared probability deviation. The latter not only seems less intuitive to me, but also means that it would bias towards lower numbers since squaring probabilities would make them smaller.

I noticed that there is something called a Brier Skill Score, which seems to be similar to a R^2 score in the sense that it is comparing the model towards a baseline model. I also found this post Name of mean absolute error analogue to Brier score? explaining the lack of an absolute version of the Brier score with that it is not a proper scoring rule (although I don't fully understand the linked paper). It also makes sense that something like MAPE does not need to exist as probabilities are bounded 0-1. However, I could not find anything on a "root Brier score". I wonder if there is a fundamental reason for this, e.g. something related to the 0-1 probability space, that makes this variation of the Brier score redundant or if there are other reasons (maybe just the lack of units and that the scale distortion of squaring is not as large for probabilities?) that it is not used to the same extend as RMSE is used in regular regression problems.