8
$\begingroup$

I recently see a term "semi-parametric" in the answers of my question but not really understand what is this term means.

Wikipedia says

In statistics, a semiparametric model is a statistical model that has parametric and nonparametric components.

And gives Cox proportional hazards model as an example.

I see Cox proportional hazards model and logistic regression are very similar, why we say one is semi-parametric but not say another?

BTW I found this answer, says GLM is not a semi-parametric model.

Improve this question
$\endgroup$

1 Answer 1

Reset to default
16
$\begingroup$

The logistic regression is not "semi-parametric". It has only parametric component. For parametric model, the number of parameters is fixed and does not depend on the number of training data, but only depends on the model itself. This is true for logistic regression since if you have $n$ variables $X_1,\ldots,X_n$ you have $n+1$ parameters $w_0,\ldots,w_n$ to define the logistic regression model, and the number of these parameters does not increase or decrease based on the number of training data. Note that for non-parametric models you also have parameters, but the number of parameters is not fixed and depends on the number of training examples.

Improve this answer
$\endgroup$
6
  • 1
    $\begingroup$ Thanks can i use "if number of parameters are depending on number of row in data matrix" to see if a model is non parametric? $\endgroup$
    – Haitao Du
    Commented Mar 19, 2017 at 3:59
  • 3
    $\begingroup$ Yes. Read this paragraph of the Kevin Murphy's Machine Learning book for more clarification: "does the model have a fixed number of parameters, or does the number of parameters grow with the amount of training data? The former is called a parametric model, and the latter is called a non- parametric model." $\endgroup$
    – Hossein
    Commented Mar 19, 2017 at 4:20
  • $\begingroup$ Then what would a "semi-parametric" model be? Having both a fixed number and a data-dependent number of parameters? $\endgroup$
    – R.M.
    Commented Mar 19, 2017 at 23:11
  • $\begingroup$ Yes! Partially linear regression and the proportional hazards model are two examples. $\endgroup$
    – Hossein
    Commented Mar 20, 2017 at 9:19
  • 1
    $\begingroup$ Why do you think neural networks are non-parametric? A neural net with a fixed structure is parametric. $\endgroup$
    – Hossein
    Commented Mar 21, 2017 at 2:16

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.