14
$\begingroup$

Let's say I have a model selection problem and I am trying to use AIC or BIC to evaluate the models. This is straightforward for models that have some number $k$ of real-valued parameters.

However, what if one of our models (for example, the Mallows model) has a permutation, plus some real-valued parameters instead of just real-valued parameters? I can still maximize the likelihood over the model parameters, for example obtaining a permutation $\pi$ and a parameter $p$. However, how many parameters does $\pi$ count toward for computing AIC/BIC?

Improve this question
$\endgroup$
4
  • $\begingroup$ Is this AIC on AIC? Mallows Cp model has been shown to be equivalent to AIC. en.wikipedia.org/wiki/Mallows's_Cp $\endgroup$
    – EngrStudent
    Commented Mar 28, 2014 at 21:56
  • $\begingroup$ Mallows Cp is a model selection technique for regression. I'm asking about model selection for a different statistical model that also has its name, but which has a permutation as one of its parameters. $\endgroup$
    – Andrew Mao
    Commented Mar 31, 2014 at 0:05
  • $\begingroup$ Andrew, I had hoped to get a good answer for this. Sorry that it did not work out so well. -mike $\endgroup$
    – EngrStudent
    Commented Apr 8, 2014 at 21:09
  • $\begingroup$ Perhaps there is a simulation approach - something where you can find the answer and publish it. It might be novel material. $\endgroup$
    – EngrStudent
    Commented Jan 25, 2015 at 18:33

1 Answer 1

Reset to default
2
$\begingroup$

Intuitively, I suspect that the set of all permutations on $p$ elements is equivalent to $p^2-2p+1$ parameters.

This is because the permutation matrices are the extremal points of the convex space of doubly-stochastic real matrices of rank $p$, and in general the doubly-stochastic matrices have $p^2-2p+1$ parameters (you get $2p$ constraints because all row sums have to all be 1 and column sums have to all be 1, but one of these is redundant, so you have $2p-1$ constraints on $p^2$ entries).

I have no proof, but it seems right. Maybe it's worth trying it numerically?

Improve this answer
$\endgroup$
2
  • $\begingroup$ Great explanation, but what do you mean by "trying it numerically"? Something also feels wrong about this because giving each element a parameter will induce any permutation, and that is only a total of $p$ parameters. $\endgroup$
    – Andrew Mao
    Commented Feb 25, 2015 at 15:50
  • $\begingroup$ Parameters (at least in the context of AIC, and arguably in general) are continuous. Thinking of an index as a parameter is a common trap, since although the "parameters" (2, 3, 1) specify the permutation (123), there is no obvious way to interpret (2.1, 3, 1). If you think instead of parameters moving mass, you get the doubly-stochastic matrices as I described. By numerically, I mean: simulate data from a known model and then estimate using AIC with the three penalizations $p$ (yours), $p^2-2p+1$ (mine), and $p!$ (naive enumeration) and see which one recovers the known model "best". $\endgroup$
    – Timothy Teräväinen
    Commented Mar 1, 2015 at 3:32

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.