I am collecting a lot of data from neurons and will be analyzing each neuron separately. Is it valid to pick the best of several models based on the AICc for each neuron and then use the ANOVA p-values from the best model? Or should should I only run the AICc on preliminary data and then use the best model analyze every neuron?
My impression was that it is only statistically valid to select the model in the preliminary experimental design phase, but I'm now having difficulty finding this explicitly stated. References would be greatly appreciated.