0
votes
0answers
12 views

How to handle large .csv file in R? [migrated]

I have a large(>100,000) single column floating point time-series data. I want to find structural changes within the data with respect to time( in my case index). In-order to do that, I am using R ...
0
votes
0answers
4 views

Time in years(x axis) shows years in .5 interval - Time Series using R [migrated]

dsales1156ts<-ts(dsales1156,frequency=365,start=c(2011,6)) # This is my time series created with daily sales data when the first sale day is 6th January 2011. plot(dsales1156ts) The ...
1
vote
0answers
20 views

Are there any time-series visualization tools available for HDF5 files?

I have gigabytes of time-series data stored in HDF5 files and while there is the very basic visualization tool available in HDFViewer, I'm interested in knowing if there are rich visualization ...
0
votes
0answers
61 views

Method for detecting anomalies in timeseries?

I am exploring creating alerts for anomalies in a timeseries. Say that I have a graph like this: There are two anomalies here that I would wanted to be alerted on: First, on April 7th with there ...
1
vote
2answers
79 views

Ways to understand 2-dimensional time-series data

I'm working on 2D time series data where two attributes are depth and temperature. When I plotted depth-vs-temp curve and saw its variation over time, the fluctuation occurs at few places only. I'm ...
4
votes
0answers
29 views

“Average” line over irregular log series data

I have simulation data from 1000 runs, plotting some measurable (in this case convergence of the algorithm) as a function of simulation time. Each run produces a discrete set of points ...
0
votes
0answers
37 views

Plotting a comet like animation for multiple variables

I am trying to code a visualization with 4 variables ( Carbon emission, Energy consumption, population and year) The data set i have collected so far looks like this With C1990 representing Carbon ...
3
votes
1answer
53 views

Should plots for time series use a logarithmic scale for duration/time?

I was reading this tutorial on ggplot2 and was struck by a bit where it said that durations are typically best displayed along a logarithmic scale Is this an ...
4
votes
1answer
173 views

Time series prediction: visualising path uncertainty region

I am predicting a time series' future evolution and am evaluating the path uncertainty using bootstrapping. Is there a good way to visualise the uncertainty that goes beyond simply plotting a pair of ...
7
votes
2answers
199 views

What are good ways of plotting distributions over time using R?

I have ~400 individuals and >10k timepoints each (simulation results) I would like to be able to monitor as they change over the course of time. Plotting all individuals is too messy, plotting mean ...
3
votes
1answer
109 views

On properly setting up a control chart

Let me present to you the way I have being 'doing' control charts up until now. I have a series of $k$ samples of size $n$. I calculate the the sample means $\bar{x}_i$ and the grand mean ...
2
votes
2answers
152 views

Best way to visualize predictions from a linear model

Let's say I'm doing some predictive analytics and am trying to predict US GDP per month using a two or three month lag. After every month, I generate new predictions and am able to compare my ...
1
vote
0answers
138 views

How to visualize changes in time series variance

I am exploring a time series with the aim of detecting obvious changes in variance over time (I have little experience in time series analysis). The hypothesis is that the series has become more ...
0
votes
2answers
144 views

Data visualization: comparing two segments of a bipartite time series

Hopefully, this question will make sense to someone. I have a multi-valued continuous time series: $(x, y_1, y_2, y_3, y_4...y_n)$, where $x$ is the time axis. This time series can be divided into ...
0
votes
0answers
197 views

How to conduct an event study?

Could you please tell me how to conduct an event study? I have 60 companies and 16 events. I am computing the abnormal return within 20 days around the event study (-10,10). Should I do it for ...
4
votes
1answer
125 views

Chart for seeing trends, correlations, triggers and patterns

I've scraped a set of data, and I was wandering what the best way to start analyzing it was. My initial thoughts were to use a multi y axis graph, like this: The reason I was thinking about a ...
1
vote
1answer
87 views

Plotting the gap between two times

I have a (large) dataset where I know, for each observation, the departure and the arrival time of a worker (between 0 and 24, in decimal) : ...
3
votes
0answers
141 views

Method for calculating percentiles for a set of time series

I have a set of time series for a given quantity (e.g. CPU). The measurements are roughly evenly spaced, but the data points aren't synchronised between sets and some sets have missing measurements. ...
4
votes
2answers
448 views

Data visualization of average and standard deviation over a small time series

I am trying to find the best way to visualize the following data: I have values for 3 different times/dates, each time/date has the same 20 species. For each species I have the average height and ...
1
vote
2answers
992 views

Correlogram in R like in Stata?

In STATA I can create a "Correlogram" to find the appropriate lag order in case of time series. E.g. I know I can use the acf or Acf of the forecast package to calculate the ACF and PACF and to ...
3
votes
3answers
877 views

Omit 0 lag order in ACF plot

How can I omit the zero lag order in an acf plot? See this picture: generated by ...
4
votes
0answers
174 views

How to design good plots for multiple time series?

I have huge (about 100 000) set of time series. I need to show between 5 to 10 time series, chosen semi-randomly on one chart. Chart estate is very limited - plot for each time series is only 100px x ...
3
votes
1answer
206 views

Statistically describing/visualizing “non-overlap” in a large set of time-series data

Extensive edit of the original question while I've been able to refine my thoughts and write some better code. Consider data from two processes, each with can produce many, many time series curves ...
6
votes
2answers
381 views

How to view large time series data interactively?

I often deal with reasonable sized amount of time series data, 50-200 million doubles with associated time stamps and would like to visualize them dynamically. Is there existing software to do this ...
4
votes
1answer
247 views

Any alternatives for plotting (long) time series?

I'm looking for ways to visualize large time-series other then in traditional 2-axis line charts. More specifically, I hope to find a way that intuitively reveals patterns in the data such as the ...
1
vote
1answer
118 views

Gap in plot between forecasted and real data

I'm trying to plot forecast and real data on the same plot. But there is always gap between them on the image : I use for the forecasting following code: y=boardings[,1] ## Simple ...
17
votes
5answers
1k views

Ways to reduce high dimensional data for visualization

I'm working on a 2D physical simulation and I am collecting data in time at several points. These discrete points are along vertical lines, with multiple lines in the axial direction. This makes the ...
5
votes
2answers
220 views

Temporal trend visualizations for regions

I try to reproduce a plot which I found in a publication (Mayor-Fernández et al 2012) showing unemployment rates across time for several regions. It combines a heatmap (?), a time series plot (lower ...
4
votes
2answers
2k views

How to include an interaction term in GAM?

The following code evaluates the similarity between two time series: ...
6
votes
3answers
1k views

Are there references for plotting binary time series?

Does anyone know of recommendations/references for plotting binary time series data? Or categorical time series data? I'm looking at win/loss records, and it seems like there should be plots that ...
2
votes
0answers
64 views

Visualization of an ensemble of sequences

What are the standard techniques of plotting a statistical ensemble of sequences? I know the chaos game representation: H. Joel Jeffrey (1992), Chaos game visualization of sequences. Computers ...
0
votes
1answer
229 views

Visualizing PCA time series

I have the following experiment. My predictors are: Plant area, 6 types of plants, 5 time points and 12 replicates for class. Time points are not equally spaced. A normal plot of Area vs. time will ...
4
votes
3answers
1k views

Analysing over 300,000 rows in Excel to make pretty graphs

I'm doing a research module for my Computer Science degree, and for my topic, I have collected over 500,000 tweets using the Twitter Streaming API, using a ruby script to store them in a Mongo ...
0
votes
1answer
59 views

Detecting increases in twitter list activity

I'm trying to find more information on how to measure and detect increases in activity in twitter list activity. I have access to all the tweets produced by a list of users. The idea is to try to ...
1
vote
4answers
515 views

An approach to visualise/investigate multi-dimensional data

I'm attempting to analyse a large chunk of empiric measurements subject to two parametrised transformations. In essence, the functions take 3 'count' parameters - and returns a sequence of floats in ...
3
votes
2answers
401 views

How to display magnitude of change over time between two series?

Disclaimer: I know absolutely nothing about statistics. I've had trouble searching for answers to my question, as I don't have much knowledge about the terminology of statistics. I'm currently ...
2
votes
1answer
95 views

Smoothing function for displaying stacked lines without the smoothing introducing crossings

I'm displaying time-series data as a "stacked line" or "stacked area" chart. (E.g. with percentage data, data points at 10%, 20% and 30% are displayed at 10%, 30% and 60% on the chart.) Unsmoothed ...
3
votes
1answer
2k views

What does an ACF graph tell me that a PACF graph doesn't?

It seems like the PACF graph is more informative than an ACF graph. What information does one get from an ACF graph that can not be gleaned from a PACF graph. (ACF = Auto-correlation function, and ...
5
votes
2answers
307 views

What is an elegant way of visualising two time series with many data points?

I need to draw two time-series plots on a graph in R. The problem I am facing is as follows. Each plot has 200 data points, and therefore, the graph that I have ...
3
votes
2answers
196 views

Identifying oscillation in a time series

I asked this on the mathematics site, but now I think this is a better place. Sorry for the cross-post. Given any line graph, is there a reliable way to identify any sort of regular oscillation? ...
7
votes
2answers
558 views

Preferred methods for graphing time-series data to present “averages”?

I have data from a load test of a web site with several thousand data points spread out over roughly 30 minutes (the values are the response time of the site in milliseconds). The values are spread ...
9
votes
6answers
415 views

What's a good, generic name for chart of things by time of day?

We're creating a chart showing traffic by time of day over a given period. So the y-axis is traffic, the x-axis is midnight, 1am, 2am, etc. It could also be days of the week. What's the generic name ...
5
votes
1answer
558 views

How can I effectively summarize and visualize time series of employee activities?

I am managing many people entering data into a database. I have a log of user, date, time, table, and action that each person makes: ...
7
votes
3answers
636 views

Annotating graphs in R

This is more of a "how to use R" question than an actual hardcore statistics question, but I think the concentration of R masters here makes this a good forum for it. I'm refreshing a time series ...
6
votes
2answers
170 views

Visualizing activity frequency

Hello data analyst community. I have the following problem: Given a set of n units and a timeline in days. A unit may be active at a certain day to a certain degree (in range from 0.0 to 1.0). A ...
5
votes
1answer
1k views

Normalizing or detrending groups of samples

How do I detrend or normalize multiple series of data so that I can inter-compare between the series? Specifics below may not be appropriate for this forum. Please let me know and I can remove or ...
1
vote
2answers
171 views

Graphing low-end prices of goods in a market over time

I have a large sample of market data - that is the prices and amount of goods being sold by vendors at specific, but inconsistent, points in time. Assuming I am a buyer and the quality of the goods ...
8
votes
2answers
4k views

How do I vertically stack two graphs with the same x scale, but a different y scale in R?

Greetings, Currently I'm doing the following in R: ...
6
votes
3answers
533 views

Visualizing two scalar variables over time

What would be the best way to display changes in two scalar variables (x,y) over time (z), in one visualization? One idea that I had was to plot x and y both on the vertical axis, with z as the ...
7
votes
4answers
361 views

Good line color for “threshold” line in a time-series graph?

We're plotting time-series metrics in the context of network/server operations. The data has a 5-minute sample rate, and consists of things like CPU utilization, error rate, etc. We're adding a ...