# When is it appropriate to pool data?

Let's say I have some data on the amount of money spent on tv ads and total revenue from all sales. The data is available for three separate month.

                       Jan     Feb    March
$spent on tv ads 100 110 150 total sales revenue 1000 1000 1500  The problem I am trying to solve is whether the marketing campaign (tv ads) had a significant effect on total sales revenue. Now, I'm still not sure on how to proceed in terms of tests, either time series analysis, etc. (suggestions?) But one other issue is going to occur, and that regards whether or not to pool the data. Should I run separate tests for each month or do I pool the data together? So my question is: When is it appropriate to pool data for analysis? - add comment ## 3 Answers It's appropriate whenever the elements you're pooling together are homogeneous with respect to the parameters you're estimating. Specifically, this means that, if the model underlying each component is the same, with the same parameter values, then it is fine to pool the data. Otherwise, it's tantamount to leaving an important interaction out of a regression model which can cause misleading inferences. To place this into the context of your example - if you were to use regression to assess the relationship between $ spent on tv ads and total sales revenue then

If the relationship between \$ spent on tv ads and total sales revenue is the same across months, then it is OK to pool them together and ignore the month altogether. But, if the effect does depend on month, then you should potentially include interactions that allow the slope and intercept to vary by month. Failing to stratify your parameter estimates by month when they truly should be can cause misleading estimates of the variable effect(see here for a toy example).

So, the answer to your question boils down to whether you think the effects should vary by month. It seems to me that it probably should, but I'm certainly not as familiar with the application as you are.

-
How about if the effect varies by month, but is constant for the cross-section? Can we still pool the dataset then? –  Mariam Sep 6 at 20:30
@Mariam, I'm not sure exactly what you mean but it seems, in that case, it would be ok to pool across subsets of the population but not across time. –  Macro Sep 7 at 17:15
add comment

To add to what Macro said, You can test the assumption of the poolability of the monthly data based on time series analysis. But it would require a lot more monthly data. With the time series analysis you could look for a season trend of a yearly cycle. Even without time series analysis assume several years of data is available you could look for differences between the monthly means and if they appear to be significant then you would not pool the data. The assumption for the test would probably be that the monthly data for any month (say January) is independent from one year to the next. Given a long enough series you could check that assumption to by estimating the year to year correlation.

-
add comment

In terms of aggregation issues which are related to advertising and sales, you could start with Darryl Clarke and then follow the references forward.

Clarke, Darryl G. “Econometric Measurement of the Duration of Advertising Effect on Sales.” Journal of Marketing Research 13, 4 (1976): 345–57.

Clarke makes the point that the duration of the decay effect seems to interact with the frequency of the measurement in a somewhat uncomfortable way. Weekly data tends to produce decays in a short number of weeks. Monthly data in a short number of months. Yearly data in a short number of years. But I am oversummarizing a complicated field.

Or this overall summary by Tellis (who's a good source for what's happened in this field): http://www-bcf.usc.edu/~tellis/AdGeneral.pdf

-
add comment