0
$\begingroup$

I need to visualize very large time series data. I want to do something similar to one shown here: Zoomdata (that's where I got the term 'data sharpening').

Data example: every minute temperature data from thermostat.

I want to do web based viz and I think it should be pretty easy if I can get right kind of data from backend. Thus the question is, is it possible to do data sharpening using pandas or any other tools on large data?

$\endgroup$
1
$\begingroup$

I would use the groupby function for different timescales (min, hour, day, week, month, year, etc.) and use apply to average over the data. Or use max, or min, depending on what you want to see.

The timescales could be fed from the viz using a javascript control like a dropdown box.

You could also use the resample function on your groupby object.

| cite | improve this answer | |
$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.