All Questions
Tagged with data-visualization python
116 questions
0
votes
0
answers
14
views
Best Approach to Smooth ETA Transitions in Delivery Prediction Models
I'm working on displaying the ETA (Estimated Time of Arrival) for an item delivery using a predictive model that evolves over time. The issue I'm facing involves smoothing the transition between ...
- 23
1
vote
1
answer
110
views
GARCH diagnostics via standardized residuals: interpreting my findings
I have fit a GARCH(1,) model in Python, assuming the residuals are $t$ distributed. I am checking the standardized residuals. ARCH and Ljung-Box tests don't reject the null hypothesis. However, I am ...
- 131
6
votes
2
answers
177
views
Which OLS Regression Results are worth putting into an article? Does my example look right?
Yesterday, I set up a topic outlining the problem I am currently working on.
After receiving many interesting responses, I added linear regression to my results, following this suggestion.
My research ...
- 103
0
votes
0
answers
44
views
ANN uses python smote random oversampling
I did ANN classification using SMOTE random sampling in python but I found strange plot loss and accuracy results. This is my code:
...
- 47
2
votes
1
answer
154
views
Generating MLE in python - Problem witth the function [closed]
After my previous question (here) I tried to improve my work with this distribution. I'm using the parametrization $$f_X(x) = \frac{\theta^2 x^{\theta-1}(\gamma-\log(x))}{1+\theta\gamma} \mathbb{I}(0&...
- 197
1
vote
0
answers
42
views
Best approach to a line plot (or other type) whose lines consist of an average of 2 Y values [closed]
I am wondering the best approach to plot what I want.
I have 4 dataframes of data (2 types of data with 2 replicates for each type). To tis point, I've just been choosing he best replicate of each ...
- 11
1
vote
0
answers
87
views
How to visualize time series using PCA?
I have two multivariate data sets comprised of 100s of time series, one is the actual recorded data set of time series and the other is a synthetically generated data set based on the recorded one.
...
- 31
2
votes
1
answer
70
views
Visualizing Numerical Data with 2 Independent Variables on a Single Visualization
This is how my data looks like:
...
- 123
7
votes
1
answer
882
views
Should we use measured vs. modelled or modelled vs. measured?
As a non-statistician, I am interested in understanding whether model evaluation should be conducted with the measured values on the x-axis and modelled (or predicted) values on the y-axis, or vice ...
- 73
-1
votes
1
answer
1k
views
How to deal with high skewness and kurtosis
I have two dependent variables (soccer dataset) that I'm interested in. They have the following skewness and kurtosis:
Variable A: % of minutes played --> Skewness: 0.145 | Kurtosis: -1.03
...
- 63
1
vote
1
answer
72
views
Plotting ideas for large number of unique catagories
I have 209 unique categories within a column, is there a nice way to plot it ?
I am grouping the 209 unique categories with their respective cost column. How should I represent it visually ?
Below ...
- 23
2
votes
1
answer
383
views
Arima or Sarima model parameters
Given daily ticket data from feb 2022 to July 30 2022, I am trying to forecast tickets received. I am unsure on which model to use (Arima, Sarima,SSE) based on my data. I have attached a picture of ...
- 41
9
votes
4
answers
4k
views
Visualize a continuous variable against a binary variable
I want to visualize a continuous variable, BMI index, against a binary variable, heart disease.
I want to check by visualization ...
- 91
0
votes
0
answers
32
views
Create a synthetic dataset from the measures of spread
I have certain measures of spread (p50, p66, p75, p80, p90, p95, p98, p99, p99.9, p99.99, p100, Median, Mean, Min, Max)as my attributes. Can I regenerate a data distribution from these?
Use case: I ...
- 1
2
votes
2
answers
2k
views
Understanding the correlations in pairplots
I was using pairplots and I'm stuck in understanding the pair wise relation between those features that have vertical or horizontal lines in the pair plots.
(Image source - source)
The correlation ...
- 123
2
votes
1
answer
720
views
What is the name for this time series rank plot?
from:https://2020.stateofjs.com/en-US/technologies/front-end-frameworks/
What is the name of this type of chart? How can I create the same chart in python ?
- 21
0
votes
0
answers
83
views
Representing MAE and standard deviation for multiple models over multiple bins in python?
I have 21 regression models. I am plotting MAE and Standard deviation of models using a errorbar plot in python. However, if I bin the data (say 10 bins), and for each bin now I can calculate MAE, ...
- 101
1
vote
2
answers
318
views
Can we fit a regression model when the dependent variable is poorly correlated with the independent variables?
I have a requirement, I need to predict Y from 2 X_variables, I plotted two scattered plots ie Y vs X1, Y vs X2, As you can see the below pics, the plots are sparced. There is poor correlation between ...
1
vote
0
answers
262
views
Visualize multiple 2 sample t-tests
First time on cross validated - so if my question is not clear enough, please let me know.
I have 2 groups of websites - experimental and control. Each of these groups has many float variables I ...
- 111
1
vote
0
answers
37
views
Good data visualization to show the validity of the acquired p-value of the model through multiple sample simulations? [closed]
I have a python pandas DataFrame df:
...
- 11
4
votes
4
answers
2k
views
Methods to extract signal from three very noisy time series of same event
I have three time series of same length, all containing magnitude measurements of the same event "A". But each time series is using a different method of measurement.
My goal is to merge the ...
- 91
1
vote
0
answers
31
views
Name for non-normalized survival plot
Survival curves can be plotted with the y axis labeled in probability (i.e., an empirical complementary cumulative distribution function) or in actual counts without normalizing to 1. Is there a ...
- 121
1
vote
1
answer
1k
views
Build ROC curve with only labels and predictions
I built different models to approach the anomaly detection problem and I'd like to plot a ROC curve to see how do they perform on my datasets. Both the models are unsupervised neural networks and they ...
- 135
1
vote
0
answers
133
views
Visualising Gantt chart distribution
I perform $n$ simulations of operations planning. I can plot a gantt chart for each simulation, but I am interested in visualising the variability of the whole simulation set : I want a Gantt ...
- 1,817
4
votes
1
answer
19k
views
How to plot binary vs. categorical (nominal) data? [duplicate]
I am building a machine learning model for a binary classification task in Python/ Jupyter Notebook. I am currently in the "Exploratory data analysis" phase and try to create multiple plots/ ...
- 141
0
votes
0
answers
44
views
0
votes
0
answers
34
views
My KNN plot keeps creating parallel segments. Am I doing something wrong?
I am working on a project examining how counties recover following large storms. I suspect there is some degree of interaction in some of my variables, and want to use KNN to create a visual ...
- 41
1
vote
0
answers
46
views
Transforming y and x-axis
I have a model that predicts frequencies. True frequencies are close to 1 therefore the frequencies that predicted are mostly close to 1. Sample frequencies are:
...
- 111
7
votes
3
answers
2k
views
Plotting binary vs. binary to identify relationship
What would be the best plot for binary vs. binary to identify the relationship between two variables?
Say I have a dataset like this.
...
- 115
1
vote
0
answers
52
views
How to get coordinates when only pairwise distances are known? [duplicate]
I have $n$ points with pairwise distances known, $d_{i,j}: 0<i,j<n$. Their coordinates, $\vec{x}_i \in \mathbb{R}^k: 0 <i<n$, are unknown. I can set up $n^2 - n$ equations to solve for ...
- 218
0
votes
1
answer
42
views
Visually show the grouping of things based on relation
I'd like to visually show how certain IoT device's functionality is linked together through some sort of heat map or bubble graph (whichever is appropriate). I have a list of 50 devices, and each ...
- 121
17
votes
4
answers
3k
views
What is the best programmatic way for determining whether two variables are linearly or non-linearly or not even related
What is the best programmatic way for determining whether two predictor variables are linearly or non-linearly or not even related, maybe using any of the packages scipy/statsmodels or anything else ...
- 293
0
votes
0
answers
154
views
visualizing the scatterness of higher dimensional data using python
I have a set of unlabeled data $x \in \mathbb R^n$, and I want to visualize how scattered those points are using python. In dimension 2, we can just use plt.scatter which is quite straightforward. I ...
- 103
1
vote
0
answers
51
views
Crossing categorical features that are stored as integers
Newbie here.
I'm experimenting with the following dataset:
https://archive.ics.uci.edu/ml/datasets/Teaching+Assistant+Evaluation
Data Set Information:
The data consist of evaluations of teaching ...
- 111
0
votes
0
answers
69
views
Visualize multiple rejection reasons
Goal: Visualize why loans are rejected which can be due to multiple reasons. A loan is either rejected or accepted. Any rejection
is caused by one or more rejection reasons. There is a list of
...
- 333
2
votes
1
answer
811
views
Can a 4D perceptron be plotted in 2 dimensions?
I am wondering if it is at all possible to plot a 4D perceptron line in 2D.
Obviously, it would be impossible to observe it with all of its original information, but is there a way for me to observe ...
- 23
1
vote
1
answer
315
views
Ploting pdf of a continuous function
I want the plot the value of this list at x-axis and their probabilities at y-axis. I did not find any function in python that does so.
Since my data is continuous, i can't simply divide each number ...
- 21
2
votes
0
answers
17
views
Random forest visualization Python [duplicate]
For a dataset I ran a random forest model with sikit learn. When I checked important variables from RF , I was unable to understand the reason for choosing that variable as important. In my ...
- 131
0
votes
0
answers
287
views
Right skewed distribution of a continuous variable with outliers: replace outliers with mode or median of that column?
When I replace my outliers with the median value of that column/feature, my mode for that column/feature also changes. Is that correct?
- 33
2
votes
3
answers
752
views
How can I statistically test if the line in a graph is moving upwards, downwards or sideways? [closed]
I have a dataset that produces a line as shown in the picture below. I would like to statistically test when the line is moving upwards, downwards or sideways (not moving significantly). What would be ...
- 91
1
vote
1
answer
48
views
Training a neural network, I can't figure out my learning curves [closed]
I am cross validating a model, splitted in 5.
Then I plotted for each split, the loss and the val_loss by epochs.
I get something like that:
(source: imgsafe.org)
I found this plot disturbing.
Only ...
- 13
1
vote
0
answers
600
views
Betweenness Centrality giving different results with Package Igraph R vs Networkx Python (and Gephi) [closed]
Basically, I don't understand what is going on. When I calculate the normalized betweenness centrality with R using this function:
...
- 11
2
votes
1
answer
5k
views
How to plot multiple classifiers' ROC curves using scikitplot? [closed]
I have classified a data with multiple classes (not binary) by using several classifiers, and I would like to compare the performance of these classifiers by drawing their ROC curves using scikitplot.
...
- 507
0
votes
1
answer
145
views
the metrics that can be used to characterize and further compare different histogram [closed]
There is a set of different data set, each of which corresponds to a histogram. Are there any metrics that can be used to characterize the shape of each histogram, and further compare different ...
- 5,282
2
votes
1
answer
573
views
How to plot a marginal histogram correctly? Why is my plot different to the one in a textbook? [duplicate]
Chapter 1 of "Machine Learning - A Probabilistic Perspective" by Kevin Patrick Murphy gives this figure (fig_1),
and says
this is a pairwise scatter plot on iris dataset. The diagonal plots the ...
- 2,005
3
votes
0
answers
2k
views
How to find whether the time series is seasonal and to find the period of seasonality if seasonal? [duplicate]
I need to find my time series data whether it is seasonal or not.
My actual time series plot is shown below, The data is of irregular hourly data from January 1st of 2018 to August 1st of 2018.
...
- 131
2
votes
1
answer
423
views
Problem regarding visualizing high dimensional data using PCA
I have 10000 samples, each of which has 100 features. To visualize this high dimensional sample, I use 2 component PCA. Here is a the result:
Here, results are colored based on a target value for ...
- 655
1
vote
1
answer
90
views
How to crawl and visualize historical twitter data?
I am new to the field and trying to get some data from twitter for learning purposes, data visualization to be specific.
I want to see how the count of a certain topic (e.g. #WeTheNorth) changed over ...
- 111
1
vote
1
answer
3k
views
Visualising 2 Independent Variables and 1 Dependent Variable
I'm trying to come up with the best way to graphically display misfits from multiple geophysical inversion runs, where I am fixing two independent variables and analysing the misfit of each test. For ...
- 121
7
votes
4
answers
12k
views
How to visualize an evolution of a distribution in time?
Suppose you have a record of distribution for each day in some period. For example, some distribution which depends on a parameter which evolves over time. Suppose we have dozens or hundreds of days. ...
- 177