All Questions
Tagged with data-visualization python
116 questions
17
votes
4
answers
3k
views
What is the best programmatic way for determining whether two variables are linearly or non-linearly or not even related
What is the best programmatic way for determining whether two predictor variables are linearly or non-linearly or not even related, maybe using any of the packages scipy/statsmodels or anything else ...
- 293
16
votes
3
answers
48k
views
How to plot data output of clustering?
I tried clustering a set of data (a set of marks) and got 2 clusters. I would like to graphically represent it. Bit confused about the representation, since I don't have the (x,y) coordinates.
Also ...
- 353
15
votes
2
answers
27k
views
Show average instead of median in boxplot [closed]
When plotting a boxplot with python matplotblib, the lines halfway the plot is the median of the distribution.
Is there a possibility to instead have the line at the average. Or to plot it next to it ...
- 2,068
13
votes
1
answer
37k
views
How to draw a scree plot in python? [closed]
I am using singular vector decomposition on a matrix and obtaining the U, S and Vt matrices. At this point, I am trying to choose a threshold for the number of dimensions to retain. I was suggested to ...
- 4,552
12
votes
8
answers
16k
views
Visualizing high dimensional data
I have samples of two classes which are vectors in high dimensional space and I want to plot them in 2D or 3D.
I know about dimensionality reduction techniques, but I need a really simple and easy to ...
11
votes
2
answers
4k
views
Visualizing multi-dimensional data (LSI) in 2D
I'm using latent semantic indexing to find similarities between documents (thanks, JMS!)
After dimension reduction, I've tried k-means clustering to group the documents into clusters, which works ...
- 4,027
9
votes
4
answers
4k
views
Visualize a continuous variable against a binary variable
I want to visualize a continuous variable, BMI index, against a binary variable, heart disease.
I want to check by visualization ...
- 91
9
votes
2
answers
6k
views
How would you visualize a segmented funnel? (and could you do it with Python?)
I saw this post on Moz which presented a segmented marketing funnel:
This kind of thing would have quite a bit of value in my job. What I have no idea is how to visualize raw data to show a ...
- 221
8
votes
0
answers
720
views
What does it mean to develop a proper implementation of the grammar of graphics? [closed]
I want to develop an implementation of the grammar of graphics in python, and I need to wrap my head around a few things. I am actually having some difficulties in understanding some of the book's ...
- 181
7
votes
4
answers
12k
views
How to visualize an evolution of a distribution in time?
Suppose you have a record of distribution for each day in some period. For example, some distribution which depends on a parameter which evolves over time. Suppose we have dozens or hundreds of days. ...
- 177
7
votes
3
answers
2k
views
Plotting binary vs. binary to identify relationship
What would be the best plot for binary vs. binary to identify the relationship between two variables?
Say I have a dataset like this.
...
- 115
7
votes
4
answers
4k
views
How to display magnitude of change over time between two series?
Disclaimer: I know absolutely nothing about statistics. I've had trouble searching for answers to my question, as I don't have much knowledge about the terminology of statistics.
I'm currently ...
- 235
7
votes
1
answer
882
views
Should we use measured vs. modelled or modelled vs. measured?
As a non-statistician, I am interested in understanding whether model evaluation should be conducted with the measured values on the x-axis and modelled (or predicted) values on the y-axis, or vice ...
- 73
6
votes
2
answers
4k
views
How to plot results from text mining (e.g. classification or clustering)?
In text classification and clustering, the number of features are normally big, e.g. I currently get are around 5,000 features which is already really small compared to many other text mining tasks. ...
- 1,201
6
votes
2
answers
177
views
Which OLS Regression Results are worth putting into an article? Does my example look right?
Yesterday, I set up a topic outlining the problem I am currently working on.
After receiving many interesting responses, I added linear regression to my results, following this suggestion.
My research ...
- 103
6
votes
1
answer
766
views
Minimizing number of questions of questionnaire from past binary responses
We have data from 600,000 users that describes whether they observe each of 80+ binary features. That is, our data are a 600,000 x 80 binary matrix with user-profile.
We know from inspection that ...
- 111
6
votes
1
answer
1k
views
Row Correlation Heatmap Pandas
I'm trying to find any relationship/patterns between a large number of rows in a dataset (~2000) and I'm thinking of using a correlation heatmap. However, after transforming the df using ...
- 61
5
votes
2
answers
243
views
Tournament Plotting: Who is good against whom?
I would like to get insight into who is good against whom. Imagine a tournament setting* of 40 contestants and you're interested in seeing who is good against who in the top 10: how could we make this ...
- 2,399
5
votes
1
answer
13k
views
Label on the y-axis in a normalised histogram
If you have a histogram with frequency on the y-axis and bins for different ranges of values on the x-axis, then it is reasonable that the label on the y-axis should be frequency. But if these ...
- 153
5
votes
1
answer
3k
views
Understanding power laws and log plots (Newman paper)
I'm trying to understand some of the plots in the paper Power laws, Pareto distributions and Zipf’s law by Newman.
Here is the figure in question:
In this paper he generates synthetic data that ...
- 697
5
votes
2
answers
2k
views
Visualization of random distribution with 3 variables
Suppose I have a joint distribution of three random variables $x,y,z$, $P(x,y,z)$. For simplicity, let's suppose those three rvs. are discrete. The distribution will be represented in Python as a 3-...
- 335
4
votes
1
answer
12k
views
Determine thresholds for test from ROC-curve
I'm trying to determine the threshold from my original variable from an ROC curve. I have generated the curve using the variable and outcome, and I have generated threshold data from sklearns ROC ...
- 41
4
votes
2
answers
2k
views
Practical applications of affinity propagation
I am learning about machine learning here.
They took a set of prices for specific companies on the stock market and graphed them:
I would like to know what are some practical applications of ...
- 153
4
votes
1
answer
19k
views
How to plot binary vs. categorical (nominal) data? [duplicate]
I am building a machine learning model for a binary classification task in Python/ Jupyter Notebook. I am currently in the "Exploratory data analysis" phase and try to create multiple plots/ ...
- 141
4
votes
1
answer
801
views
Tool to work with dataflow easier/more visual
I've written some Python code which does some (network) data analysis. It's mostly large data coming from SQL where I play around with statistics and algorithms.
However configuring the interplay ...
- 2,101
4
votes
4
answers
2k
views
Methods to extract signal from three very noisy time series of same event
I have three time series of same length, all containing magnitude measurements of the same event "A". But each time series is using a different method of measurement.
My goal is to merge the ...
- 91
3
votes
1
answer
5k
views
Plot the probability mass function
I am trying to plot the probability mass function of a sample of a discrete metric.
If it was continuous, I know that using pandas it would be as simple as calling:
...
- 551
3
votes
2
answers
697
views
What kind of chart can visualize individual points of data on a single axis?
My core problem is trying to visualize the workload of a customer support team throughout the week. Specifically, I want to see what the load looks like hour by hour on each day for each agent ...
- 171
3
votes
4
answers
583
views
How to Distinguish 22 Variables in a Stacked Bar Graph?
I have a tabular dataset that contains 75 samples (rows) and measures of 22 different human cell types (columns), like the following:
...
- 131
3
votes
2
answers
2k
views
Chart/visual for negative binomial regression
My wife is presenting a study at a conference poster session. She has a correlation of sorts [1] where kids' self-assessment of asthma ("I felt a lot better" or "I felt a little better or not better") ...
- 153
3
votes
1
answer
967
views
Generating volcano scatterplot
This might look a very silly question to many of you but please answer.
I am interested in generating a volcano plot for my dataset, which has four columns and all values are in log2. column 1 has ...
- 4,555
3
votes
3
answers
10k
views
Python: "Normalizing" kde, so it always lines up with histogram
In Python, I am attempting to find a way to plot/rescale kde's so that they match up with the histograms of the data that they are fitted to:
The above is a nice example of what I am going for, but ...
- 662
3
votes
2
answers
6k
views
Using Linear Regression on text data
I am trying to create a model that predicts an author's age.
I'm using (Nguyen et al, 2011) as my basis.
Using a Bag of Words Model I count the occurrences of words per Document (which are Posts from ...
3
votes
0
answers
2k
views
How to find whether the time series is seasonal and to find the period of seasonality if seasonal? [duplicate]
I need to find my time series data whether it is seasonal or not.
My actual time series plot is shown below, The data is of irregular hourly data from January 1st of 2018 to August 1st of 2018.
...
- 131
3
votes
0
answers
3k
views
What is the best way to Show a Correlation Matrix as a Cluster/Network Graph in Python? [closed]
I'm struggling because while I want to show the interrelationship of correlation between my fields, I realize that trying to plot nodes in terms of distance away from each other based on correlation ...
- 181
3
votes
0
answers
104
views
Regression for non-normal distributions [closed]
Firstly I apologize for being very green in statistics. I'm trying to plot a regression for what I believe to be a couple of non-normal distributions.
I have done some reading and I think that the ...
- 131
3
votes
1
answer
139
views
Better Visualization for Correlation Plots [duplicate]
I'm currently working on an analysis of correlated variables involving +20 variables. I can create correlation (triangle) plots and that is quite helpful but I am wondering what other kinds of data ...
- 161
3
votes
0
answers
4k
views
Multidimensional scaling using Python [closed]
I have 6,000 points for which I have all pairwise distances in a distance matrix. I want to get an idea whether these data were generated by a mixture of Gaussian distributions so I'm trying to get a ...
- 909
2
votes
2
answers
1k
views
best tool for plotting 3 3D lines in one plot
I'm trying to recreate an image using either R, Matlab or Python (the languages I know) but I'm having troubles finding a good library for the task.
The image I'd like to recreate is the one below. ...
- 65
2
votes
1
answer
154
views
Generating MLE in python - Problem witth the function [closed]
After my previous question (here) I tried to improve my work with this distribution. I'm using the parametrization $$f_X(x) = \frac{\theta^2 x^{\theta-1}(\gamma-\log(x))}{1+\theta\gamma} \mathbb{I}(0&...
- 197
2
votes
3
answers
752
views
How can I statistically test if the line in a graph is moving upwards, downwards or sideways? [closed]
I have a dataset that produces a line as shown in the picture below. I would like to statistically test when the line is moving upwards, downwards or sideways (not moving significantly). What would be ...
- 91
2
votes
1
answer
70
views
Visualizing Numerical Data with 2 Independent Variables on a Single Visualization
This is how my data looks like:
...
- 123
2
votes
2
answers
2k
views
Understanding the correlations in pairplots
I was using pairplots and I'm stuck in understanding the pair wise relation between those features that have vertical or horizontal lines in the pair plots.
(Image source - source)
The correlation ...
- 123
2
votes
1
answer
423
views
Problem regarding visualizing high dimensional data using PCA
I have 10000 samples, each of which has 100 features. To visualize this high dimensional sample, I use 2 component PCA. Here is a the result:
Here, results are colored based on a target value for ...
- 655
2
votes
1
answer
3k
views
How to Illustrate correlation in binary classification
I ran a correlation in a binary classification problem between one variable and the prediction to determine whether a linear correlation exists. The code:
...
- 121
2
votes
1
answer
720
views
What is the name for this time series rank plot?
from:https://2020.stateofjs.com/en-US/technologies/front-end-frameworks/
What is the name of this type of chart? How can I create the same chart in python ?
- 21
2
votes
1
answer
737
views
How to create a timeline to accurately visualize a time series with some missing dates?
I'm trying to solve a medical mystery using data visualization. But I'm not very experienced in handling statistical data. My data does not have rows for every day of the year, only for dates which ...
- 123
2
votes
2
answers
151
views
Is Venn diagram the best approach to represent specific operations on sets?
I would like to produce a visualization representing all these propositions:
The only idea which came to mind was a Venn diagram. Is it the proper approach? If yes which package (R or Python) would ...
- 249
2
votes
1
answer
3k
views
How to plot the OR function along with the decision boundary of a Perceptron?
I've written a small program that predicts correctly the OR function output. The problem is that when I try to plot the decision boundary, I don't know what to do. Should I plot the final weights?. ...
- 23
2
votes
1
answer
811
views
Can a 4D perceptron be plotted in 2 dimensions?
I am wondering if it is at all possible to plot a 4D perceptron line in 2D.
Obviously, it would be impossible to observe it with all of its original information, but is there a way for me to observe ...
- 23