1
$\begingroup$

I got a strange situation of working with a short time series. I want to predict number of cases of a particular procedure (Let's say Knee Surgery) that can be done in a hospital in a month.

Less Sample size or data points because I have only 2 year data.

Plotting the data showed me that the data doesn't have any trend, seasonality is not seen because I have few data points.

Can any one suggest a best approach in this case.

$\endgroup$
6
  • $\begingroup$ For short time series, simple models like exponential smoothing, random walk or constant plus noise usually outperform more complicated ones. This is evidenced by the M competitions (M3 was the last one; M4 is ongoing). Search for Spyros Makridakis or Rob J. Hyndman and forecast competition to learn more. $\endgroup$ Commented Apr 26, 2018 at 10:04
  • $\begingroup$ Thanks Richard Hardy, I am working with same simple forecasting methods like exponential smoothing. Can you give reference for a random walk , constant plus noise models. (If possible formula to predict.) $\endgroup$
    – varun
    Commented Apr 26, 2018 at 10:27
  • $\begingroup$ If your series is a random walk, the forecast for any time point in the future equals the last observed (newest) value. If your series is a constant plus noise, the forecast for any time point in the future equals the sample mean of the series. Super simple. $\endgroup$ Commented Apr 26, 2018 at 11:00
  • $\begingroup$ I think using the last observed value is Naive method. Do you think both are same. Doesn't I think so. $\endgroup$
    – varun
    Commented Apr 26, 2018 at 11:02
  • $\begingroup$ The name naive may be ambiguous, but I guess it is quite popular to define it in the way you do. Such forecasts implicitly come from a random walk model. $\endgroup$ Commented Apr 26, 2018 at 13:04

1 Answer 1

2
$\begingroup$

Time series expect you to provide sufficient observations to detect seasonality or trend phenomenons. If you lack data, or if there are simply no existing trend or seasonality, you cannot expect the model to find one. Let $X_{t+1}$ be the value you want to predict and $\hat{X}_{t+1}$ your prediction. For such cases, time-series model will return most of the time either :

  • The last observed value (random walk) ${\hat{X}_{t+1}}$ = $X_t$
  • The last observed value plus a constant (random walk with drift) $\hat{X}_{t+1} = X_t + c$
  • A weighted average based on a prior period (exponential smoothing) $\hat{X}_{t+1} = \sum_{k=0}^{n}\alpha_k X_{t-k}$

You may accept the model returned by an algorithm, or test one that appears more pertinent to you. While exploring your data, you can make your own assumptions, and test them using your judgement. For instance.

  • Compare year 1 and 2. On average, has the number of cases increased ? Can you can make the hypothesis that this increase will be kept for year 3 ? Is it reasonable to consider that the number of cases at month $X_{t+1}$ will be the same as month $X_{t-11}$ modulo the increase ? $\widehat{X}_{t+1} = (1+\beta)X_{t-11}$ where $\beta$ may either be the ratio between $X_{t-11} / X_{t-23}$ or $\sum_{k=0}^{11} X_{t-k} / \sum_{k=12}^{23} X_{t-k}$
  • Are there any significant distributions among cases between year 1 and year 2 ? Monthly distribution (e.g. between January and February, you observe a decrease of $\gamma$ %) ? Quarterly distribution (e.g. during summer, a decrease of $\sigma$ %) ? Can you assume that such distributions will be kept for year 3 ?

Also, do you have any additional data (features) associated to the time series ? Machine learning is useful when you have a lot of observations, and a significant number of features from which you are unable to distinguish a simple pattern. With 24 points, I highly doubt that you will find anything complex, and may as well go through a manual analysis.

Keep in mind that these assumptions can be hardly tested. You do not have a sufficient range (e.g. 3 years) to build a "model" on the two first years, and test it on the last one.

Bottom line : with limited data, you can perform only limited analysis.

$\endgroup$
4
  • $\begingroup$ I don't have other features to apply machine learning algorithms. Want to know what best can be done in this situation. Thanks. $\endgroup$
    – varun
    Commented Apr 26, 2018 at 9:14
  • $\begingroup$ Then what is left is what I have described above. Make assumptions, and see if you can infer an empirical model. $\endgroup$
    – AshOfFire
    Commented Apr 26, 2018 at 10:08
  • $\begingroup$ can you please elaborate what you are saying. $\endgroup$
    – varun
    Commented Apr 27, 2018 at 6:12
  • $\begingroup$ @varun I have edited my answer. Hope this answers your questions. $\endgroup$
    – AshOfFire
    Commented Apr 27, 2018 at 8:27

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.