I have two datasets of daily irradiance measurements from a single site over a multiple year period. One takes readings every 15 minutes (A) and the other every 30 minutes (B). I trust the B dataset, and I want to test the accuracy of the A dataset compared to B.
Preferably, I want to use an interpolation function that fills in the 15 minute gaps between the B dataset. If that's not possible, I can also delete every other data entry in the A so that it will match the timestamps and be the same length as B.
Then I would like to use some statistical test to determine whether A is similar enough to B and accurate, or whether it is full of errors and trash.
The problems I see are that data for irradiance fluctuates over the seasons (i.e. more intense/higher irradiance values in summer while less in winter). Also the irradiance data goes to zero from ~6:30 pm to ~6:30 am the next day (sun doesn't shine at night, unless you're in Alaska lol ). So over half the values in my datasets are zero.
What's the best way to see if A is similar to B? I was thinking that I could, for example, pull all the irradiance values for 12pm each day, which should give me somewhat of a normal distribution, then perform a paired sample t-test on it. Then similarly do this for every hour/half hour of the day.
What are your thoughts? Thanks!!!