4
$\begingroup$

Suppose I have a nonlinear model of the form: \begin{align}EY|X = \frac{aX}{aX+b}\end{align} where $a, X, b > 0$. I reparameterize the model as \begin{align} EY|X =\frac{\beta X}{1 + \beta X} \end{align} where $\beta = \frac{a}{b}$. $\beta$ is identifiable, so I can estimate it with nonlinear regression or some parametric model.

My question is about terminology. I am working on a complex system where each variable is a similar function of other variables. In each case I have to identify some term to divide by so I have identifiable parameters. For example, in another case I have \begin{align}EY|X_1,X_2 &= \frac{aX_1}{aX_1 +bX_2}\\ &=\frac{\beta X_1}{\beta X_1 + X_2} \end{align} where $\beta = \frac{a}{b}$. Is there a term that desribes the role b plays here, as a parameter that has to be divided out to make the model identifiable? Something like "normalizing constant" except that it is not assumed known and its role is to help identify rather than normalize.

$\endgroup$
2
$\begingroup$

This has a similar flavor to nondimensionalization in physics/engineering. There the "non-identifiability" of the separate parameters is commonly leveraged in design of experiments. This has given rise to many well-known "reduced" parameters in science.

| cite | improve this answer | |
$\endgroup$
1
$\begingroup$

A related kind of parameter rewriting strategy, used as an aid to optimization rather than than identification, is what the economists call concentrating and statisticians calling profiling. See this example.

| cite | improve this answer | |
$\endgroup$
0
$\begingroup$

The process is reparameterization, where, in the example, there is one supernumerary parameter that makes the system unnecessarily underdetermined. An alternative reparameterization is to $\frac{X_1}{X_1-\alpha X_2}$. The set $\{a,b\}$ has one more parameter than needed, but it is arbitrary to say which one, as it is the set that is overdefined, not $a$ or $b$ taken separately. Thus, $b$ by itself is only one of the two parameters that are problematic, and would likely not have a stand alone name. It is the set that is redundant, and would result in regression instability in a spuriously underdefined system such that reparameterization is not optional, it is indicated.

| cite | improve this answer | |
$\endgroup$
  • 3
    $\begingroup$ One could just as well say the same of $a$. I don't think this question is asking what unidentifiability of parameters means ("my question is about terminology"): it appears to be asking about a particular process of limiting a model to a set of identifiable parameters. $\endgroup$ – whuber Dec 30 '16 at 22:35
  • $\begingroup$ The process is reparameterization, where, in the example, there is one supernumerary parameter that makes the system unnecessarily underdetermined. True enough one can say the same for $a$ leading to $\frac{X_1}{X_1-\alpha X_2}$, but that was not asked. $\endgroup$ – Carl Dec 31 '16 at 14:05
  • $\begingroup$ @whuber Yup, thought about it, U R correct, as usual. Changed answer to reflect that. $\endgroup$ – Carl Jan 1 '17 at 20:56

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.