Timeline for How to determine if survey response samples are comparable?
Current License: CC BY-SA 3.0
9 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| Sep 28, 2013 at 18:28 | comment | added | Wayne | It's good that the regions/sites are stable. I know you only want to compare one year to another, but since you're worried (and rightly so) about the makeup of each month's sites (due to some sites having too few results in that month) it'd be helpful to have more years, say 5-10, to examine that issue's effect. | |
| Sep 28, 2013 at 17:58 | comment | added | Eudora | Thanks so much @Wayne for all of your responses. We have historical data going back 3 to 4 years, but for business reasons, we only want to compare one year to the following year. The regions are very consistent and defined for each year (including the sites in each region). | |
| Sep 28, 2013 at 16:57 | history | edited | Wayne | CC BY-SA 3.0 |
deleted 120 characters in body
|
| Sep 28, 2013 at 16:44 | comment | added | Eudora | In the end, we want to make sure that the year over year sample contains approx. the same mix of sites (e.g. excluding sites that only responded a couple of times in one or the other of the samples). | |
| Sep 28, 2013 at 16:33 | comment | added | Eudora | They are supposed to be daily and the report is only for a single day of work (never a week to catch up for failing to respond). So each survey received is one day for one site (which we group into our own regions as well, and that is the level we want to sample, that the site responses by region are consistent year over year). Unfortunately, we have no way of enforcing that the sites respond. Some sites respond fairly consistently, while other sites are pretty intermittent. | |
| Sep 28, 2013 at 16:00 | comment | added | Wayne | This sounds more encouraging. Are the reports supposed to be daily and sometimes you actually get daily responses and other times it's more like the results from a whole week? Or are they supposed to be daily but sometimes they only report a single day in a week? | |
| Sep 28, 2013 at 15:59 | comment | added | Eudora | I guess what I am wondering is if it would be appropriate to check the distribution of the responses per site and possibly exclude some sites as outliers due to low responses (by each region I suppose). | |
| Sep 28, 2013 at 15:56 | comment | added | Eudora | The responses are really a productivity metric, basically how many orders were completed versus how many were placed. The surveys are sent to all offices (sites), so we do know which office and which regions are responding. The response rate from the sites can be vary greatly though. We would obviously like to include as many sites as possible, but some sites will responds 29 times in one month, where another site might only respond 5 times in that month. | |
| Sep 28, 2013 at 15:45 | history | answered | Wayne | CC BY-SA 3.0 |