2
$\begingroup$

How do I incorporate a new stream of data into my classification model? Do I have to retrain the model from the beginning every time I want to incorporate new data, or can I update the existing model with each new data point?

Imagine I have built a binary classification model (I am not concerned about which classification algorithm at this point, so let me know if you think certain algorithms are better suited for the problem I am describing) that predicts whether users pick Option A or Option B. However, over time I keep collecting new data that should be included in my existing model (for example, I obtain true labels for data predicted in the past, and want those to be included in the model). Is there a way to update the model without retraining it completely, or is that the best solution? I imagine it would be time-consuming to entirely retrain the model if data steadily comes (and this would not work for anything that relies on near real-time predictions).

$\endgroup$
  • $\begingroup$ Updating the model incrementally is called online learning/training. How to do it (and whether it's even possible, short of re-training) depends on the classifier. You might consider editing your question to narrow the scope to the classifier you're using. $\endgroup$ – user20160 Nov 13 '18 at 6:32
1
$\begingroup$

Most models in python or R libraries need to be retrained from scratch. Bayesian models can, in theory, incorporate new observations sequentially, but in practice it is often the case that they are retrained (or the posteriors are approximated by analytic distributions and then used as priors in the next round of fitting. Point is, the model needs to be refit one way or another).

It might be beneficial to monitor your model's performance over time. Once performance starts to degrade, you can retrain your model with more recent data. Alternatively, you can schedule models to retrain quarterly or yearly.

EDIT: Look up on-line algorithms which learn sequentially from data, point by point.

$\endgroup$
0
$\begingroup$

There are some good answers from the Data Science Stack Exchange site:

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.