I have two questions that tie into one another (for context). I've been told to always check my data to see if it's normally distributed before doing any analysis, but if the data are associated with a variable that has more than 1 group/level (or multiple variables with many groups) then am I testing every single group for normality or the whole dataset altogether as one sample?
This brings me to my second question. I understand that a sample is a subset of a population, but at what point does 1 sample become many?
I know count data isn't normally distributed, but just as an example, if I went fishing in a pond, would the fish I catch be 1 sample of the fish in that pond for that 1 day, or could I call them multiple samples if I defined one group of fish my morning sample and another group of fish my afternoon sample? Would I test both groups for normality? Can samples be infinitely divisible into their own groups?
One non-technical conceptual answer to tie these together would be really helpful!