I'm trying to analyze a series of request on our web server. I have the latency of each request with the associated timestamp that the request was made.
What I suspect is that higher latencies occur when requests are clustered in time, but I'm not sure about what the timescale even is. It could be requests made within a 5s, 1s, or even 1ms window.
I put together a rudimentary python script to use a sliding window to calculate the request density and compare that with the current latency but even as I tweaked the window size between a few milliseconds and several seconds I couldn't see any obvious correlation.
Crucially, I think the problem is that I don't know what the time period of the latency/request density is, and therefore how big to make my window.
Am I barking up the wrong tree? Or does my method sound roughly correct, suggesting there is no correlation?
Some people have asked for sample data, so I've uploaded some here