Episode #125 of the Stack Overflow podcast is here. We talk Tilde Club and mechanical keyboards. Listen now

Questions tagged [data-visualization]

Constructing meaningful and useful graphical representations of data. (If your question is only about how to get particular software to produce a specific effect, then it is likely not on topic here.)

Filter by
Sorted by
Tagged with
0
votes
0answers
8 views

How to plot cost function against iterations?

I am new to coding in machine learning. I am trying to plot a graph for the gradient descent of a univariate function. ...
0
votes
1answer
12 views

the metrics that can be used to characterize and further compare different histogram [on hold]

There is a set of different data set, each of which corresponds to a histogram. Are there any metrics that can be used to characterize the shape of each histogram, and further compare different ...
1
vote
1answer
20 views

How to calculate / correct Standard Error or Confidence Intervals for bounded scales?

When conducting an experiment, often the data collected is interval or ratio, and as such unbounded. However, when attempting to make inferences about the population, reality often provides us with ...
0
votes
0answers
15 views

How can I plot this moderated moderation?

I used PROCESS Model 3 and returned a significant 3 way interaction (moderated moderation). My model is as follows: X: IV (2 levels, separate lines) Y: DV W: Relation (1st moderator, 2 levels, X ...
3
votes
1answer
303 views

Plot the contribution of each variable in a model

I'm looking to plot the contribution of each variable in a regression model incrementally, and display how that impacts accuracy and the residuals. Given the model $$ y \sim \text{trend} + \text{...
0
votes
0answers
14 views

How to adjust data labels to alluvium instead of axis for bump time series chart (R ggalluvial)? [on hold]

How can the data labels in this example be made to appear centered on the alluvia?: ...
0
votes
1answer
312 views

Optimal cut-off point with minimum sensitivity

I have a logistic regression model. I'm looking for a non-graphical way to find the optimal cut-off where sensitivity is above a threshold(say 0.95) and maximizes sensitivity+specificity. I don't have ...
0
votes
0answers
12 views

What is this kind of chart is this (shows flow of components from one group to another)? [duplicate]

I'd like to know the name for the following type of chart. I see it in the context of interactive charts related to fundraising or polling where components are shown to follow from one group to ...
15
votes
4answers
30k views

ACF and PACF Formula

I want to create a code for plotting ACF and PACF from time-series data. Just like this generated plot from minitab (below). I have tried to search the formula, but I still don't understand it well. ...
23
votes
3answers
5k views

Visualizing the calibration of predicted probability of a model

Suppose I have a predictive model that produces, for each instance, a probability for each class. Now I recognize that there are many ways to evaluate such a model if I want to use those ...
1
vote
1answer
238 views

How to qualitatively describe distribution shapes

I have a distribution which looks a bit binomial, though with a cutoff, i.e.: $P(x) = 0$ if $x \le 0$, rises to a bell-shaped peak at around $x=0.2%$, appears to tail off exponentially until an ...
2
votes
1answer
287 views

Visualise variance partitioning

I'm interested in visualising variance partitioning in the context of linear models. Say you run an linear regression that predicts peoples weight based on their height and age. How can you visualise ...
3
votes
1answer
34 views

How can we visualize a multiple regression with >2 independent variables?

An easy way to visualize a multiple regression with 2 independent variables is by a plane, as a plane is defined by 3 points that do not lie within the same line. So we have the Y-intercept, the X ...
0
votes
0answers
46 views

Batch-Norm makes the Decision Boundary more non-linear?

Consider a Neural Network and let $L$ be it's last layer or the output layer. Also suppose we're doing Binary Classification, hence the activation function for the last layer is $\sigma$, ie. $g^{[L]}(...
1
vote
0answers
28 views

Connection between Stochastic Neighbor Embedding and MDS

In the original SNE paper the authors mention a connection between the SNE objective function and an MDS-like stress function in the regime $\sigma_i \rightarrow \infty$, as follows. When $\sigma_i^...
2
votes
1answer
38 views

how to scale the density plot for my histogram

I have the histogram plot and I'd like to overlap it with density line for the same data. Importantly, I don't want to turn histogram into density values, but want to keep N (numbers) on y axis. Is ...
1
vote
0answers
48 views

Simple(st) BI use case for confidence/prediction ellipse visual

I noticed confidence ellipse visuals are not uncommon in scholarly journals, here is one concerning equity premiums. Here is the kind of confidence ellipse that I'm considering for visual reference: ...
30
votes
3answers
21k views

What distribution does my data follow?

Let us say that I have 1000 components and I have been collecting data on how many times these log a failure and each time they logged a failure, I am also keeping track of how long it took my team to ...
0
votes
1answer
31 views

Best visualization for distributions at multiple time steps

I have a set of discrete observations at multiple time points (~40) all of which are at similar scales i.e., between 0 and 10, and have been trying to determine the best visualization to show the ...
3
votes
2answers
269 views

Can I analyze or model a conditional correlation?

In my research I'm looking at the correlation between self-harm and aggression (both continuous). Now, I also have some variables (e.g. depressive symptoms; also continuous) which I do believe ...
2
votes
1answer
946 views

How can I create a scatterplot in R using the plot function to control for covariates?

I would like to know if it is possible to create a scatterplot while controlling for covariates, such as in partial correlation. I am using R software and my code is below for the basic scatterplot. ...
1
vote
1answer
143 views

Can we use Correlation coeffiecients in non linear case

So I am having a data of several variables (one is a dependent variable and the others are independent variables). I am not sure if the relation between each of these independent variables and the ...
1
vote
0answers
12 views

How can I leverage a pairwise scatter plot to help choose a machine learning model/classifier to distinguish the categories of iris flower?

This is a visualization of the Iris data as a pairwise scatter plot. The goal is to learn to distinguish three different kinds of iris flower, called setosa, versicolor and virginica. We can extract ...
-2
votes
0answers
23 views

How to plot minimum, maximum, and mean in r [migrated]

I've been reading how to plot points in r, but can't find anything that matches my problem. My data is a matrix; the rows start with a column called 'site' and it is followed by three columns ...
2
votes
1answer
35 views

Is there a better way to graph a ratio over time than directly graphing the ratio?

I want to compare how effective two potential solutions are, and I have "scores" for each solution such that I can graph the effectiveness of each solution over time by graphing the scores vs time for ...
5
votes
1answer
422 views

Calculating and plotting confidence interval for Theil-Sen estimator

I'm using Wilcox's R functions (specifically, regplot) to plot a Theil-Sen estimator with a single predictor. However, regplot ...
2
votes
0answers
67 views

Data compression for graph plotting [closed]

I am using Google Charts to plot a large data set. The database contains one record for every two seconds; five minutes' worth of data yields 150 records (data points) and the result is acceeptable. ...
1
vote
1answer
2k views

Repeated loess smoothing for time series data

I have 3 time series and I would like to determine if there are any common patterns in the data. Zuur mentioned in one of his books that a reasonably simple approach to test this is based on repeated ...
0
votes
1answer
33 views

visualisation of categorical variables

Can anyone help me how to plot/visualise 2-3 categorical variables all togehter at the same time. I have 4 different categorical variables each with 4 levels. I want to visualise the first 3 variables ...
2
votes
1answer
30 views

Strobiloid representation

I am working with household income and I would like to replicate the following strobiloids generated by Chauvel (2013): For what I understand here and from his explanation of the graph, he plots the ...
1
vote
1answer
20 views

My R plot of the F distribution doesn't seem right [closed]

In order to simulate two independent variables, so that $\beta=0$ in their linear regression model, I wrote the following code: ...
1
vote
0answers
80 views

How to plot a marginal histogram correctly? Why is my plot different to the one in a textbook?

Chapter 1 of "Machine Learning - A Probabilistic Perspective" by Kevin Patrick Murphy gives this figure (fig_1), and says this is a pairwise scatter plot on iris dataset. The diagonal plots the ...
2
votes
1answer
429 views

What is the physical significance of cumulative correlation coefficient?

Say, I have 2 parameters, and based on my dataset, I have iteratively calculated the correlation coefficients between them by taking the correlation of the first i terms, where i ranges from 1 to the ...
2
votes
1answer
425 views

First-layer Visualizations in a neural network

I am reading the lectures on "Convolutional Neural Networks for Visual Recognition", and in this lecture they deal with first layer visualization. As you can see in the figure below- this figure ...
3
votes
0answers
572 views

Why do my Feature Importance and Partial Dependence plots not agree?

I need some help understanding my partial dependence plots for features passed to a GradientBoostClassifier when comparing them to the feature importances. For some background, my goal here is to ...
6
votes
6answers
292 views

How can I visualize an ordinal variable predicting a continuous outcome?

What is the best way to visualize the relationship between an ordinal predictor and a continuous outcome? So far I have the below, but I feel like this is lacking... The way I modeled it is I ...
0
votes
1answer
28 views

How to best analyse distribution of distributions [closed]

How can one go by analyzing a distribution of distributions ? An example of such a dataset is as given in this question : What does "a distribution over distributions" mean? Suppose ...
0
votes
0answers
13 views

Profile weekly panel data containing multiple variables

I have 1 year data for multiple stores which is aggregated at a weekly level. So basically for each store, I have 52 data points and 8 variables/features. I want to cluster these stores into similar ...
1
vote
0answers
16 views

Plotting series of numbers while protecting privacy

I have 2 series of numbers e.g x=[1,3,4,6,9] y=[100,179,210,400,650]. I want to plot them and show that plot in a manuscript. However, these numbers represent some private information and hence I don'...
10
votes
1answer
425 views

Visualizing many left-skewed distributions

I have a series of left-skewed/heavy tailed distributions that I would like to show. There are 42 distributions across three factors (labeled as A, ...
2
votes
1answer
13 views

Visualized Imputation of 2D Sample Space With Saturation Corresponding to Confidence?

I want to visualize a 2D sample space imputed from a 2D scatter of measurements. Something like a 2D hexbin color histogram would work if it were enhanced in the ...
1
vote
0answers
11 views

How can I show 3D movement plus time in a plot?

I have a visualization of trajectories in 3D (movement within a building). Is there any visualization for plotting 3D movement plus time?
0
votes
0answers
21 views

How can I visualize and cluster weighted graphs in python?

On any ecommerce website, you have options to apply filters to filter out products. For example: So I have data of how many users applied what filters tuples on the website. Which is fetched from ...
0
votes
1answer
72 views

Why is the correlation of a variable and itself a histogram?

This post is visualizing the Wine dataset. You may have noticed that the figures along the diagonal look different. They are histograms of values of individual variables. We can see that the "Ash" ...
1
vote
1answer
805 views

Better way for linear relationship plot between two variables

I have got Demand, Temperature, and Price data. I would like to plot Demand against other two variables separately to see the linear relationship between them, but the I that I got is very ugly. I am ...
1
vote
1answer
139 views

What smoothing method to visualise changing Bernoulli success probability?

Suppose I am running an experiment that goes as follows: I am going to show participants in my experiment a picture, and I tel lthem to look at it for between 0 and 50 seconds. I ask each participant ...
1
vote
1answer
27 views

grid of colored squares data visualization [closed]

I am looking to represent something that is say, 998 for and 2 against as a grid of 998 green squares and two red squares. Is that a plot type, hopefully with an R package that does it? If you are ...
1
vote
2answers
39 views

Should you take a sample when doing EDA?

Suppose i have a large dataset, such that python graphing libraries are unable to handle. Is it a good idea to take a random sample? Specifically if it's a classification task, and where the target is ...
0
votes
0answers
15 views

Time value errors when plotting high frequency time-series dataset using multiple Levels of Detail

Good morning, I have a series of measurements which are of 50 Hz signals, measured at 200kHz. The reason for the high sampling frequency is to detect any harmonics in the 50 Hz signals. I am ...