My question is based on the usual setting in credit scoring. Assume we have historical monthly observations of customers, their risk factors $R_{i,t}$ and the flag whether they are currently in default $ND_{i,t}$ and whether they will default within the forthcoming 12 months $D_{i,t}$.
Then we can estimate a logistic regression based on the risk factors of non-defaulted customers and the flag. The following questions arise concerning the inclusion of observations in the set from which we estimate the logisitc regression:
Can we use repeated observations of a specific customer in a given year? If the customer did not default in, say, January we have them in the set with the target observation 0/no default. Can we include the observation from February again in or estimation set? Obviously, the event of no default within a year starting in January is not independent from the event of no default within a year starting in February. However, the conditional distribution of the default event given the risk factors could be assumed to be independent.
How do we deal with customers that have first observations with no default and then a default which is an absorbing state for many months. E.g. the observation in January with the no-default flag and February and many following with the default flag. What I would do is, to use the observations without default flag (depending on the answer to question 1 above) and the first default event, and all those observations would be contained in the estimation set.
My question: what is the statistically appropriate approach here? Unconditional independence is not given but conditional dependence can be assumed. Is the situation different if there is a default event included (2. above). Are there good references in the literature to this standard problem?
Thank you!
EDIT: To clarify as suggested by a commenting user:
- The risk factors $R_{i,t}$ contain information up to time $t$. This can be some recent account behavior (e.g., arrears of the last 6 months) or some balance sheet information available at time $t$.
- The information whether a customer already is in default, $ND_{i,t}$, is only used to exclude them from the estimation.
- What we want to predict, is the default event within the year after $t$ (i.e., at any monthly observation date $t+1, t+2, \ldots, t+12$) given information up to $t$.
EDIT: I further discussed this issue with colleagues. It turned out that in the statistical literature, the constellation is refered to as "marginal modelling of correlated, clustered responses". It will take a while for me to understand this theory. I assume that it offers strategies to handle bias in coefficients, and/or underestimates of standard errors of coefficients.
What I am still wondering is, what a typical solutions in a market practice setting with statistical rigor looks. This problem must be faced by many model developers in banks ...