Timeframe for training data in churn models vs prediction data - confused

Question

I am developing a churn model for a subscription business. The churn rate is 7% yearly for it. The training data was prepared in such a way that customer information is tracked at the start of the year where only active customers are tracked. By the end of the year, the customer tag of churned/active customer is taken. The data is also tracked till the end of the period for the active customer and till the churn period for a disconnect customer. There is good accuracy for this approach but during prediction it is poor as there is not much difference between customers who stay active vs those who churn.

Please advice on what should be changed to make better predictions!

Answer 1

If there is not much difference between customers who stay active and those who churn then, pretty much by definition, no method will work well. You need to find some variable (or variables) which do distinguish the two sets.