2
$\begingroup$

I have been told that one of the main advantages of Semi-Parametric Models (e.g. Survival Analysis, Cox Proportional Hazards Model) is that these models do not require assuming the response variable (e.g. Survival Times) to follow a specific probability distribution, thus allowing for a higher level of flexibility.

This got me to thinking - suppose if the Survival Times are discrete. As an example, suppose that we only have available to us how many years each patient remained in the study.

Initially, I had thought that if we decided to choose a Semi-Parametric Survival Model (e.g. Cox PH), the presence of discrete survival times should not be a problem. As an example, perhaps the true underlying distribution of survival times might follow some discrete probability distribution such as the Poisson Distribution - but since a Semi-Parametric approach (according to my likely flawed understanding) does not require you to specify a specific probability distribution , in theory it should not matter if the true underlying distribution is continuous or discrete.

However, when reading more about this topic (e.g. https://grodri.github.io/glms/notes/c7s6, https://bmcmedresmethodol.biomedcentral.com/articles/10.1186/s12874-022-01679-6), it appears that there have been different models specifically developed for this task (i.e. discrete survival times).

This slightly confuses me - if one of the main advantages of Semi-Parametric Models is their ability to avoid using a specific probability distribution, how come you can't just use a common Semi-Parametric Model such as Cox-Ph when faced with a discrete probability distribution?

The only thing which comes to mind are "philosophical reasons". Perhaps the Cox-PH model was specifically designed for continuous survival times - that is, the advantages of the Cox PH model come into effect only provided that the true probability distribution of survival times are continuous. Perhaps the Cox PH model was fundamentally not intended to be used with discrete data. Thus, in the case of discrete data, you would want to choose a probability distribution that is defined in a "discrete sense" - that is, the random variable can not have negative values nor non-integer values. Although when faced with discrete data, you might be able to "trick" the computer into using a continuous distribution and proceed with a Cox-PH model, perhaps some problems relating to inference and interpretation may later arise (e.g. negative hazards and survival probabilities .... but I am not entirely sure about this).

Can someone please comment on this?

$\endgroup$
5
  • 1
    $\begingroup$ Could you please explain what you mean by "common Semi-Parametric Model"? BTW, non-parametric is not synonymous with not specifying a distribution, even though you will find many statements to that effect on the Web; and "semi-parametric" doesn't even mean "non-parametric." $\endgroup$
    – whuber
    Commented Dec 3, 2022 at 21:31
  • 3
    $\begingroup$ A truly "continuous" response has a 0% probability of observing ties, nevertheless it was necessary to implement methods for ties in Cox models that deal with the possible permutations of events and censored cases at the exact time. Alternately discrete survival models are models for handling interval censoring - consider a study of cancer screening. If I find my cancer at my 5th annual scan, the cancer actually occurred sometime between year 4 scan and year 5 scan. Another individual with cancer found at that time may not have developed it at the same time as me. $\endgroup$
    – AdamO
    Commented Dec 3, 2022 at 21:39
  • $\begingroup$ @ Whuber: "common semi-parametric model" - my colloquial way of reffering to the Cox PH model. I will remove this word "common" to avoid ambiguity. Thanks! $\endgroup$
    – stats_noob
    Commented Dec 3, 2022 at 21:41
  • $\begingroup$ the cox proportional hazards model is assuming proportional hazards, which is a big assumption. A discrete time survival model is just any "probabilistic classifier", logistic regression/xgboost etc.Multistate survival is just replacing with multinomial regression. Providing your data can be approximated as discrete time, you have much more flexibility using a discrete time model. $\endgroup$
    – seanv507
    Commented Dec 5, 2022 at 10:58
  • 1
    $\begingroup$ I noticed that you placed a bounty on this question to "recieve more attention," even though this question has an answer with 4 upvotes at the time of the bounty. Can you clarify what kind of attention you want to receive, and under what circumstances you'll award the bounty? I ask because you often offer bounties without awarding them. In this case, the current answer is ineligible to receive the automatic award of a bounty because it was written before the bounty was offered. So how should a prospective answer-writer understand what you are looking for with this bounty? $\endgroup$
    – Sycorax
    Commented Dec 8, 2022 at 13:22

1 Answer 1

5
+50
$\begingroup$

There are at least two contributing reasons. First, as a number of commenters have indicated, handling tied times in the Cox partial likelihood is inconvenient. Second, there are different ways to end up with discrete survival data, and these have motivated additional research.

So, first: ties. The Cox partial likelihood for continuous data is based on time-point probabilities $P(i\text{ died}|\text{one person died})$. These are nice and easy; the baseline hazard cancels out so we get $$L_i= \frac{\lambda_0(t_i)\exp(z_i\beta)}{\sum_{j\text{ alive}} \lambda_0(t_i)\exp(z_j\beta)}=\frac{\exp(z_i\beta)}{\sum_{j\text{ alive}} \exp(z_j\beta)}$$ For discrete times, the natural extension is $P(\text{exactly these k people died}|\text{k people died})$,which is a sum over exponentially many (in $k$) terms. If $k$ is really large -- say, 10 -- this is no fun at all. There are approximations: the Breslow approximation (Norm Breslow didn't actually like this one) and the Efron approximation. It's not so simple.

Second: why do we have discrete data? It could be interval-censored data: we test people's blood glucose at times $t_k$ and diagnose diabetes if it's too high. It could be grouped data: we round survival times to the nearest day. It could be that the event can only happen at discrete times (cheating on an exam? Sleeping through your alarm?). These lead to different models: if you have proportional hazards in continuous time but you have interval-censored measurement it's not the same as having proportional hazards in discrete time.

So, using the Cox model for discrete-time data doesn't end up making life easier either computationally or in interpretation. It can be worth the effort of using explicit discrete-time models. On the other hand, if your measurement times are the same for everyone and reasonably frequent, pretending that the events happen at the measurement points and that you have proportional hazards actually works pretty well and is fairly common in cohort studies. This paper looks at what happens when measurement times aren't similar.

$\endgroup$
3
  • $\begingroup$ @ Thomas Lumley: Thank you for your answer! Just to clarify what is meant by : P("i" died | one person died) ? Does this mean "the probability of the i-th person died given one person int he study has died)? $\endgroup$
    – stats_noob
    Commented Dec 5, 2022 at 6:54
  • $\begingroup$ In this question here (stats.stackexchange.com/questions/597893/…), I think "discrete survival models" are better suited - do you agree with this? $\endgroup$
    – stats_noob
    Commented Dec 5, 2022 at 6:55
  • $\begingroup$ Yes -- though it's time-specific: probability that person $i$ died at this time point given that exactly one person died at this time point. $\endgroup$ Commented Dec 5, 2022 at 6:56

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.