I am trying to create risk prediction model in R. I am new to logistic regression risk prediction analysis. I obtained reliability curve using
Cal_curve <- calibrate(Multi_model_1, method='boot', B=1000) and the results are (n=2813 Mean absolute error=0.011 Mean squared error=0.00063
0.9 Quantile of absolute error=0.022). But the reliability curve looks poorly calibrated as in the attached image.
The model internal validation looks better.
Sample (approximately 80 events and 2730 non-events for training datasets, 6 independent variables) I used bootstrapped internal validation with all the available sample. Is it right to split the data for testing set?
Is my model good to use or some other techniques can be applied to get better reliability curve for this logistic model?
Confused how to proceed further.