# Missing value imputation using Amelia when variable count is greater than number of observations

My dataset contains 5000+ variables measured over hourly for just over a week (201 observations).

These measurements are of the same metric, noise levels in a wireless network measured in dBm. These measurements were recorded at various locations across my country, some variables are measured at the same location and some could be hundreds of kilometers away. Please also note that the missingness is MCAR since either the wireless sites were off for maintenance or some sort of outage/physical upgrade.

Of the 5000 or so variables, only ~1% of variables are missing any values over time, please see the missingness map below for details. Time is represented on the Y axis and the 5000+ variables are on the X axis. These 1% of variables also have missingness for less than 5% of their total recordings e.g less than 10 samples over time of the total 201 samples for that variable are missing.

Rather than just cut these variables from the dataset I wish to impute these values using Amelia in R. When I tried to run the imputation I got the following error message:

Amelia Error Code:  34
The number of observations in too low to estimate the number of
parameters.  You can either remove some variables, reduce
the order of the time polynomial, or increase the empirical prior.


On the very bottom row you can see that there are a small number of missing values for a lot of variables. Rather than making the dataset smaller by deleting these values is there a smarter approach to imputing such values.

• You may want to consider treating separate cases with missing data as individual time series that contain missing values to be imputed. Here is a link to an R package designed for time series imputation. You'll need to make sure it is a good fit for your data first. Alternatively, depending on what you want to do with the data in the end, you may want to consider modeling strategies that utilize full information maximum likelihood estimators. – Matt Barstead Jul 22 '17 at 13:07