Tell me more ×
Cross Validated is a question and answer site for statisticians, data analysts, data miners and data visualization experts. It's 100% free, no registration required.

Have anyone tried modeling number of phone calls using OLS? The dataset is number of calls per months for each customer's account. The dependent variable is number of calls or average number of calls, and the explanatory variables are customer specific variables including number of purchases, total spend and so on....

How do you deal with zero callers? Only small proportion of customers actually call, 5%. I am attempting to build a predictive model, so I want to keep zero callers in the model.

I do not believe that number of call is bounded or censored random variable? I thought zero number of calls is a true zero and there is to account for it? Do I need to use Tobit for the estimation here?

M

share|improve this question

2 Answers

Just from knowing that there are many zeros in the data, this would suggest to me that you use a zero-inflated poisson model - a generalised linear model.

share|improve this answer
Yes, I agree. This is count data and the model you suggest is appropriate. My only concern is that I intepret zero callers as those who chose not to call for some unknown and unobserved reasons. Thus, I was thinking more to apply Heckman's sample selection procedure, i.e., to predict probability to call, obtain inverse Mills ratio and then use the OLS with the ratio included as an independent variable to get the predicted values estimates. Thus, it seems I am restricted in this approach to use OLS. Do not you think so? – Evgeniy Perevodchikov May 15 '11 at 19:32
Well, OLS is a very simple generalised linear model. The wiki page on Heckman's procedure (ref 6) indicates that there are some nonparametric approaches that can be taken, but I don't know a huge amount about these. In addition, I think @IrishStat's suggestion of incorporating time structure into the model is definitely something which would be useful. – richiemorrisroe May 15 '11 at 19:44
yes, agreed, thanks – Evgeniy Perevodchikov May 17 '11 at 8:15

• Since this is time series data you would be well advised to include some form of "time variable" in the model. This could be accomplished by including seasonal dummies and/or seasonal autoregressive structure. You might also have one or more Level Shifts and/or one or more trends in the data. You might have changes in parameters or error variance over time that might need to be incorporated. Incorporating predictor variables would be important making sure that correct contemporaneous and lag effects were treated. Additionally you might want to detect anomalies/pulses so that your model parameters were robust to them via Intervention Detection. In general this is referred to as a Box-Jenkins Model with Causal Variables (ARMAX or Transfer Functions).You might want to Google "regression vs box-jenkins" to find out more about the whys and wherefores of incorporating time series structure into your model. Be careful about some web content that incorrectly positions Box-Jenkins as being non-causative. The univariate (single series approach) is called ARIMA Modelling. This approach is only suggested when you don't want to include predictor variables. Lots of incorrect textbooks and web sites don't make this clear as they assert things like “Box-Jenkins ignores information that might be contained in a structural regression model”

For example google "difference between box-jenkins and regression" and you will get some other hits on this topic. The first hit leads to a typical misrepresentation of what Box-Jenkins models are. For example "Box-Jenkins ignores information that might be contained in a structural regression model" is a half-truth as what is more correct is to say “Box-Jenkins without Causal Variables etc.”

share|improve this answer
Certainly, I agree that with the time series nature of the data as you suggested. I have done a univariate ARIMA modeling on this dataset, but the purpose is to model data using the OLS procedure in order to account for self-selection bias. The problem is that having so many zeros in the dependent variable and the time series nature of the data introduces violations of OLS assumptions. I attempt to correct for autocorrelation and heteroscedasticity. But, the OLS fit is very sensitive to many zeros in the dependent variable which probably bias parameter estimates. – Evgeniy Perevodchikov May 15 '11 at 19:38
@Mermex . I have "seen" data like this but it might help (me) if you actually posted one of these difficult series along with any indicators that you might think are important. – IrishStat May 15 '11 at 20:33

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.