I've got a couple different models (poisson regression vs. OLS linear model on log-transformed DV) and trying to compare the two. They both provide reasonably good fit to the data.
I have heard people state that you cannot use AIC/BIC to compare these two but cannot seem to find a reference to this effect. They are different kinds of models, so I'm curious to know how one should go about making the decision between them.
OLS is not a probabilistic model as it does not have an associated likelihood function. Unless you assume a normal model for the errors in a linear regression model (thus you get the same estimators for the regression coefficients), then you cannot compare it to the Poisson regression model.
If you assume the normal model, then you still cannot justify the comparison on the basis of AIC/BIC as the linear regression model assumes continuous responses, while the Poisson regression model is a discrete model. Thus, the models cannot be compared in terms of these information criteria (which require same support to properly define the Kullback Liebler divergence).
