# Handling daily time series data for better accuracy

I have a daily observation of call volumes data starting from 28-01-2017 to 31-08-2018 a little over one and half year.On sundays calls volume are less and monday the highest showing weekly pattern. Plotting shows most of days in Nov month shows high call volumes above 2000. Values are also high in other days of different months but they are rare.

data_ts <- msts(data\$Calls,seasonal.periods = c(7,365.25),start = c(2017,28))
autoplot(data_ts)

Data is divided into train test in 80:20 ratio and did dynamic harmonic regression on train data with fourier terms for weekly and annual seasonality. My residual analysis is pathetic and Mape on test data is 25. Increasing value of fourier terms (K in fourier function) not helping any way.

# creating xreg
xreg <- fourier(data_ts,K=c(1,1))
xreg_train <- xreg[1:448,]
xreg_test <- xreg[449:560,]

# fitting model
fit <- auto.arima(train,seasonal = FALSE,xreg = xreg_train)
checkresiduals(fit)

I think i need to work on the data first and then do forecasting. The boxplot of the series is shown as below.

My question is going forward how can i improve model performance to get better accuracy on test data. Do i need to pre-procees the series first and if yes what what should i look into.

EDIT: After doing little research i got some clue here Auto.arima with daily data: how to capture seasonality/periodicity? and created 6 weekly,11 monthly seasonal dummy variables,took 1 fourier terms and passed these additional information in xreg. Below is the xreg matrix

Now the residual analysis plot seems much better than before as shown below and test mape error come down to 20. But still serial correlation exists as seen in the acf plot. Ljung-Box test p value on residual is 0.00023

My objective is to catch those pattern in the residual and thereby possible getting less test mape error may be in single digit. Are there more possible ways to get there. Please suggest

• There is still a lot of autocorrelation in your series, you need to neutralize that, – user2974951 Sep 27 '18 at 7:41
• yeah...that is my query. How to do that? – joy_1379 Sep 27 '18 at 7:45
• Hard to tell, you will have to play around with the arguments, I think there might be a need to add SMA and / or SAR processes. – user2974951 Sep 27 '18 at 7:47
• autocorrelation can arise if there are untreated deterministic factors/features remaining in the residuals e.g. level shifts,local time trends,seasonal pulses ( read: day-of-the-week for example ) – IrishStat Sep 27 '18 at 10:38
• are you still looking for answers ? – IrishStat Mar 20 '20 at 20:48