Questions tagged [histogram]
A histogram is a graphical representation of the frequencies of a continuous variable. The variable is divided into bins and a bar is drawn for each bin, proportional to its frequency in the data.
453
questions
0
votes
1answer
13 views
Computing mean and sd from a frequency histogram (in R)
On page 4 of this document, there is a frequency distribution (histogram) of some students' math scores.
You can access the exact same info. shown on page 4 of this document below (in ...
1
vote
0answers
21 views
Properties of the diff of a sorted uniformly generated set
I am studying a set of uniformly generated points, more concretely the distance between the points.
When the set is unsorted the histrogram shows it is normally distributed and that matches my ...
0
votes
0answers
17 views
How can I interpret a kernel density plot where x axis is the probability?
I am confused on how to interpret the kernel density estimation (kde) plot given below, which is of the predicted probabilities from my model for class 0 and class 1.
What conclusions can I draw from ...
0
votes
0answers
6 views
Plotting histogram for all features from dataframe [closed]
I wrote the following code to plot histograms of all the features in my dataframe dff.
My code snippet:
...
0
votes
0answers
20 views
Maximum-likelihood histogram from noisy data
Given a sequence of noisy observations $\{x_k\in\mathbb{R}\}$ and a set of thresholds $\{t_i\in\mathbb{R}\}$ we can bin the observations using the thresholds to create a histogram.
However, since we ...
0
votes
0answers
22 views
Approximating a distribution with an integer histogram
Given a distribution $f:[0,a)\rightarrow\mathbb{R}$, is there a simple algorithm by which to find a sequence $\{h_i\in\mathbb{N_0}\}$ such that $f(x)$ is approximated by $h_{floor(x)}$ as a histogram ...
1
vote
0answers
28 views
Reference for the rule of thumb $\sqrt{n}$ for the number of bins of an histogram
Does anyone have an idea where the rule of thumb $\sqrt{n}$ for the number of bins of an histogram come from? I need a reference to put in my article. I remember that rule from my college times, but ...
0
votes
0answers
41 views
Which statistical tests should I use for this data?
I have been given data from Kickstarter ( Kickstarter is a crowd funding platform that helps people garner funds for their business ideas). The data has about 15,000 rows and about 10 - 15 columns. ...
0
votes
0answers
14 views
How to sample biased distribution from another distribution?
I have a PSNR histogram distribution for 6k images and I want to sample a few images from this distribution.
But as you can see the distribution is right-skewed and the samples will less PSNR values ...
0
votes
1answer
33 views
Discerning differences in groups with millions of datapoints: is a GLM even valid?
I have a MASSIVE dataset of 22 million shrubs from a basin in the southwest US.
I have selected 2 response variables which are both positive continuous variables: Shrub Canopy Volume (cubic meters) &...
0
votes
0answers
10 views
Freedmans rule to find number of bins
I have a data set that is 30162 rows long. I am trying to split age into bins but I am struggling to understand the concept of the rule with my data set.
As a quick examples this is what I did:
<...
1
vote
1answer
30 views
Generating samples from a histogram
I don't quite know how to ask this question or what to search for but I'm certain this method has a name..
I have a uni variate binned distribution, something like x = { 0, 10 , 20 , 30,....} with ...
1
vote
1answer
32 views
Distribution of urns for non-uniform distribution
Let $X_1,\dots, X_n$ be i.i.d. random variables on a set $X$. Let $j$ be a uniformly random number from $1$ to $n$; define a new random variable
$$ Y(j) = \frac{\left\vert \{i: X_i=X_j\}\right\vert}{...
2
votes
1answer
39 views
Estimating mean values given a histogram (without using median point)
I have a list of stock trades made by US senators and the exact amount of money they spend on a trade is not disclosed, they only give a range of values. Below is the frequency table for the 8600 ...
1
vote
0answers
16 views
Non asymptotic error bound for$f(x)=\mathbb{E}[Y|X=x]$
I am considering the following model:
$(X_i,Y_i)_{i=1}^n$ are iid random pairs with $X_i\in[0,1]$ and $Y_i\in\mathbf{R}$. Let $f(x)=\mathbb{E}[Y|X=x]$. Consider an estimate $\hat{f}_n$ of $f$.
Under ...
3
votes
1answer
169 views
R histogram of p-values weird (uniform)?
I created a short Monte Carlo script to check how z-values from z-tests and their correspond when I change different parameters.
My script is the following. I have a "population" of normal ...
3
votes
1answer
24 views
Help on understanding these plots
I am very weak in the english language and I need to understand how I can describe my plots. It's the best way for me to learn, understand plots and memorize the phrases.
So my first question is, ...
1
vote
0answers
12 views
Visualizing historical commute times
I am looking for a visualization of travel times for a specific commute route (going from A to B, considering traffic of course), for example in a histogram. I would like to answer the question "how ...
0
votes
0answers
33 views
Kullback-Leibler Divergence for histograms: How to choose bin size?
So I have two set of data points. To be precise these are measurement of surface areas of some objects using two different methodologies (which could give a different object count and different areas)....
1
vote
0answers
27 views
How to compare the chi-square distance values obtained from comparing different histogram pairs?
I have a data sequence that is generated from a computer simulation (discrete event simulation). It is a simple sequence of a single state value, e.g., 10 11 12 11 12 13 ...15. It contains N number of ...
2
votes
1answer
73 views
How to generate random data, that's from Beta distribution with specific density function in R?
So, considering that $\theta = 2$ and density function is $f(x) = \theta x^{\theta - 1}, 0<x<1$ and $0$ anywhere else, how do I generate random data from this particular distribution?
Here is ...
0
votes
0answers
20 views
Create KDE based on Histogram using the weighted KDE approach
In Kernel density estimation with binned data a binned kernel estimator is defined as :
$g_n(x) = \frac{1}{nh} \sum_{j=-\infty}^{\infty} n_j K(\frac{x-t_j}{h})$
where $t_j$ denotes the centre of the ...
1
vote
1answer
36 views
Random Forest: Histograms for the Margins for Different Outcome Classes
I am working with random forests (in R).
Is there a way to plot a histogram of the margins of different response outcomes?
I have a categorical response variable with three outcomes, and I want to ...
0
votes
0answers
10 views
binwidths/no. of bins when overlaying two histograms
Should the binwidths for two histograms be same or no. of bins in both histograms be same when they are overlayed for comparison? or there is no correlation? I am comparing histogram of centrality for ...
1
vote
1answer
23 views
Similar histograms after removing mean and dividing with std
I have four time-series, of a physical quantity (heat flux). When I remove the mean value from my data points Xn = X - mean(X) and divide them with the standard deviation Xn' = Xn/std(Xn) the ...
0
votes
0answers
13 views
0
votes
1answer
50 views
Quantifying the similarity or overlap between two discrete probability histograms
I am trying to learn if there's a way to quantify how close two discrete histograms that represent probability distributions (normalized) are.
To give an example, I generate two lists of integers in ...
0
votes
0answers
19 views
Intersection vs Chi-Square for comparing histograms
I've seen lots of examples where chi-square works better. But is there any example of for ex. 3 non-similar histograms where Intersection results in the similarity of histograms but Chi-square results ...
0
votes
0answers
17 views
Binwidths/no. of bins for 2 histograms for overlaying them
Should the binwidths for two histograms be same or no. of bins in both histograms be same when they are overlayed for comparison? or there is no correlation?
I am comparing histogram of centrality for ...
2
votes
1answer
38 views
What to do when IQR returns 0 in Freedman-Diaconis' rule?
I want to discretize a pandas continuous column. For discretization, I'm using Freedman-Diaconis rule which computes the optimal number of bins which will be given input to KBinsDiscretizer. Freedman-...
0
votes
0answers
18 views
How can I find patterns in a histogram?
I'm into image classification and I'm using Local Binary Pattern Histogram(LBPH) method. Works great! Only bad thing is that it cannot handle complex pictures, like if the background changes. The walk ...
0
votes
0answers
28 views
Interpretation if my data is Gaussian
I have business data, which only occur from Monday to Friday.
To know if I can run statistical tests, I want to check if I have a Gaussian distribution. Therefore I am using a histogram and a qqplot:...
0
votes
1answer
25 views
Drawing histograms and how size of a bar influences probability?
This is a question concerning the width of the bar in a histogram. Let's say we have frequency distribution like this:
As far as I've learned when you define size of the bar for example 0.5, for each ...
0
votes
0answers
13 views
Random sampling into two samples
I had a question about random sampling to create two datasets. Say I have a dataset $D$, with $N$ rows and $M$ columns. Each column is a feature $X_{1},X_{2}...X_{N}$, and each feature has an ...
1
vote
2answers
106 views
Smoothing histograms with kernel methods
I have a problem where I can receive as output, multidimensional counts in "histogram" form. I can also adjust the size of the bins I receive (i.e., many or few bins). I want to smooth the data and ...
1
vote
1answer
32 views
What is the best way of presenting many Bar Chart plots
I used R programming to produce separate 30 Bar Chart plots. The x-axis scale is the same for the 30 plots (11 bins), but y-axis is different.
I want to present these results in a limited work of ...
3
votes
0answers
36 views
What methods are there for estimating distributions based on histograms?
I recently worked on a consulting project where a client wanted to estimate gamma and weibull distributions based purely on histograms rather than raw-data. I have never worked with problems like that ...
0
votes
0answers
19 views
A question about hypothesis testing on non normal distributions
I have a set of 20 distributions (4 sets of 5) none of them are normally distributed but all are qualitatively similar and all have ~700k data points.
The images below are a typical example.
First ...
0
votes
1answer
28 views
Distinighsing Between Groups on a Bimodal Varaible
I am working with the diamonds data set from the tidyverse package in R.
library(tidyverse)
View(diamonds)
When I plot a histogram of the price variable with 300 ...
0
votes
1answer
27 views
My histogram suggests my data is not normally distributed but the stats suggest it is, can i assume normality or not?
I am looking as likelihood to forgive and need to decide what correlation to use to apply this scale to attachment type.
My histogram shows a slight positive skew, but the test of normality (...
1
vote
1answer
250 views
Histograms: display a y-axis with a break in the range of values
I am plotting a histogram showing me the repartition of values of the variable dist_enrolled on a population. This variable takes very small values for 98% of students and can be very high for the ...
1
vote
1answer
166 views
Why density plot tails are beyond maximum and minimum values?
I am trying to interpret the tails of a density curve, which go beyond xlims(0 in this case). I understand that area under the curve between any two points represents the probability of that event.
...
0
votes
0answers
37 views
How to handle Histogram “Spike”
This dataset is motor insurance premiums for 4 insurers.
25K observations were made using different combinations of features (make, model, driver age, at fault accident, etc).
In this plot y-axis ...
0
votes
0answers
53 views
Measure of “Normalness”
My goal is to classify different portions of a signal. By dividing the signal to smaller windows and plotting the histogram of each division and fitting a normal distribution to the histograms, I ...
0
votes
0answers
31 views
The distribution of an $L_2$ distance between two histograms
I would like to compare two histograms $H_1$ and $H_2$ that I represent in the form of lists, both of length $n$, i.e. $H_1(1)$ is the height of the first histogram for the first data-point and so on. ...
0
votes
0answers
8 views
From one histogram, create a new histogram with just a single mean value?
Suppose I have a list of values that I can histogram and calculate descriptive statistics on such as mean, average, max, standard deviation, etc. Perhaps this histogram is bimodal or right skewed. Let’...
0
votes
1answer
15 views
the metrics that can be used to characterize and further compare different histogram [closed]
There is a set of different data set, each of which corresponds to a histogram. Are there any metrics that can be used to characterize the shape of each histogram, and further compare different ...
0
votes
2answers
127 views
Clustering using histograms
I need to find clusters in a very large amount of data (>2M data points), and I was looking for ways to speed up the usual algorithms, i.e. k-Means, DBSCAN, ...
Is there any major issue, especially ...
-1
votes
2answers
25 views
If I can identify anomalies and outliers with a histogram, why should I perform clustering techniques? How are they different?
I am trying to find outliers in a set of data. When I did the exploratory analysis, the outliers are clearly spotted in the histograms. Is clustering better than histograms? Do they provide more ...
1
vote
1answer
96 views
Gaps in histogram for geometric distribution
I'm attempting an assignment in which we're supposed to write a function to simulate a geometric distribution with $p=0.03$. While plotting a histograms for about $100000$ simulations of the function, ...
