Questions tagged [histogram]
A histogram is a graphical representation of the frequencies of a continuous variable. The variable is divided into bins and a bar is drawn for each bin, proportional to its frequency in the data.
423
questions
0
votes
1answer
21 views
Drawing histograms and how size of a bar influences probability?
This is a question concerning the width of the bar in a histogram. Let's say we have frequency distribution like this:
As far as I've learned when you define size of the bar for example 0.5, for each ...
0
votes
0answers
10 views
Random sampling into two samples
I had a question about random sampling to create two datasets. Say I have a dataset $D$, with $N$ rows and $M$ columns. Each column is a feature $X_{1},X_{2}...X_{N}$, and each feature has an ...
0
votes
0answers
15 views
Smoothing histograms with kernel methods
I have a problem where I can receive as output, multidimensional counts in "histogram" form. I can also adjust the size of the bins I receive (i.e., many or few bins). I want to smooth the data and ...
1
vote
1answer
30 views
What is the best way of presenting many Bar Chart plots
I used R programming to produce separate 30 Bar Chart plots. The x-axis scale is the same for the 30 plots (11 bins), but y-axis is different.
I want to present these results in a limited work of ...
3
votes
0answers
33 views
What methods are there for estimating distributions based on histograms?
I recently worked on a consulting project where a client wanted to estimate gamma and weibull distributions based purely on histograms rather than raw-data. I have never worked with problems like that ...
0
votes
0answers
18 views
A question about hypothesis testing on non normal distributions
I have a set of 20 distributions (4 sets of 5) none of them are normally distributed but all are qualitatively similar and all have ~700k data points.
The images below are a typical example.
First ...
0
votes
1answer
25 views
Distinighsing Between Groups on a Bimodal Varaible
I am working with the diamonds data set from the tidyverse package in R.
library(tidyverse)
View(diamonds)
When I plot a histogram of the price variable with 300 ...
0
votes
1answer
26 views
My histogram suggests my data is not normally distributed but the stats suggest it is, can i assume normality or not?
I am looking as likelihood to forgive and need to decide what correlation to use to apply this scale to attachment type.
My histogram shows a slight positive skew, but the test of normality (...
1
vote
1answer
67 views
Histograms: display a y-axis with a break in the range of values
I am plotting a histogram showing me the repartition of values of the variable dist_enrolled on a population. This variable takes very small values for 98% of students and can be very high for the ...
1
vote
1answer
72 views
Why density plot tails are beyond maximum and minimum values?
I am trying to interpret the tails of a density curve, which go beyond xlims(0 in this case). I understand that area under the curve between any two points represents the probability of that event.
...
0
votes
0answers
33 views
How to handle Histogram “Spike”
This dataset is motor insurance premiums for 4 insurers.
25K observations were made using different combinations of features (make, model, driver age, at fault accident, etc).
In this plot y-axis ...
0
votes
0answers
47 views
Measure of “Normalness”
My goal is to classify different portions of a signal. By dividing the signal to smaller windows and plotting the histogram of each division and fitting a normal distribution to the histograms, I ...
0
votes
0answers
26 views
The distribution of an $L_2$ distance between two histograms
I would like to compare two histograms $H_1$ and $H_2$ that I represent in the form of lists, both of length $n$, i.e. $H_1(1)$ is the height of the first histogram for the first data-point and so on. ...
0
votes
0answers
7 views
From one histogram, create a new histogram with just a single mean value?
Suppose I have a list of values that I can histogram and calculate descriptive statistics on such as mean, average, max, standard deviation, etc. Perhaps this histogram is bimodal or right skewed. Let’...
0
votes
1answer
13 views
the metrics that can be used to characterize and further compare different histogram [closed]
There is a set of different data set, each of which corresponds to a histogram. Are there any metrics that can be used to characterize the shape of each histogram, and further compare different ...
0
votes
2answers
43 views
Clustering using histograms
I need to find clusters in a very large amount of data (>2M data points), and I was looking for ways to speed up the usual algorithms, i.e. k-Means, DBSCAN, ...
Is there any major issue, especially ...
-1
votes
2answers
18 views
If I can identify anomalies and outliers with a histogram, why should I perform clustering techniques? How are they different?
I am trying to find outliers in a set of data. When I did the exploratory analysis, the outliers are clearly spotted in the histograms. Is clustering better than histograms? Do they provide more ...
1
vote
1answer
35 views
Gaps in histogram for geometric distribution
I'm attempting an assignment in which we're supposed to write a function to simulate a geometric distribution with $p=0.03$. While plotting a histograms for about $100000$ simulations of the function, ...
1
vote
0answers
38 views
Wikipedia's Article on the Histogram [duplicate]
Wikipedia's nice article on the histogram contains the following sentence:
"Using wider bins where the density of the underlying data points is low reduces noise due to sampling randomness; using ...
2
votes
1answer
247 views
how to scale the density plot for my histogram
I have the histogram plot and I'd like to overlap it with density line for the same data. Importantly, I don't want to turn histogram into density values, but want to keep N (numbers) on y axis.
Is ...
1
vote
0answers
100 views
How to plot a marginal histogram correctly? Why is my plot different to the one in a textbook?
Chapter 1 of "Machine Learning - A Probabilistic Perspective" by Kevin Patrick Murphy gives this figure (fig_1),
and says
this is a pairwise scatter plot on iris dataset. The diagonal plots the ...
0
votes
1answer
23 views
sum of probabilities doesn't match, using HistogramTools in R
I was using the package HistogramTools in R to create Histogram.
> H<-hist(1:100)
> sum(H$density)
[1] 0.1
Somehow the sum of the density is not 1, ...
0
votes
0answers
25 views
Upper limit on “unconstrained” histogram parts
I am wondering if there is a way to estimate upper limits on a histogram:
I have an observation with 200 measurements, those scatter around some value with some variance. For context, x is the light ...
0
votes
0answers
10 views
Understanding percentiles of child or constituent distirbutions
Consider an example where a user performs some operation on a web page and total time taken for that operation is some of 2 parts. I.e.,
Total time = Part1 time + Part2 time.
What we currently have ...
1
vote
0answers
38 views
How to compare 2 2-D histograms and get the probability of the 2 being the same / having samples drawn from the same/very similar distributions?
I was looking at this post describing methods of comparing histograms and in particular bin-to-bin comparison and cross-bin comparison and want to know how to use these to numerically evaluate how ...
2
votes
0answers
20 views
A comparison of the global optimal binwidth and local optimal binwidth of the histogram estimator
Suppose we have $X_1, \dots, X_n$ to be an i.i.d sample with unknown pdf $f(x)$ and cdf $F(x)$, and define $\hat{f} (x)$ to be the histogram estimator. We also define its Mean Integrated Square Error ...
2
votes
2answers
297 views
good number of bins for logarithmic bin width
I was wondering how to estimate a good number of bins for my histogram.
I know quite certainly that my data is well approximated by a LogNormal distribution. Previous studies have used logarithmic ...
0
votes
0answers
43 views
How histograms help in understanding data and what roles do they play in selecting features before creating a model
I am new to machine learning and what ever I study related to it has an advice that we should understand the data and select features wisely before start creating the model. For this they demonstrate ...
0
votes
0answers
9 views
Strange results when computing the HOG and histogram intersection similarity
I am trying to re-implement algorithms mentioned in this paper to measure the "naturalness" of one synthetic image, given a real image. The algorithm seems straightforward, basically we have two ...
0
votes
1answer
39 views
Compare distribution to given shapes to find the most similar
I have a multiple comparison problem between some thousands of correlation distributions and given shapes.
I have computed pair-wise correlation for a given set of gene expresion data, and I have ...
0
votes
0answers
25 views
Approximate a density function from sampled data
Let
$(E,\mathcal E,\mu)$ be a measure space
$E_0\in\mathcal E$ with $\mu(E_0)\in(0,\infty)$ and $\mathcal E_0\subseteq\left.\mathcal E\right|_{E_0}$ be finite and disjoint with $$E_0=\biguplus\...
0
votes
0answers
17 views
Transform right skewed distribution to normal [duplicate]
My datasets histogram is the following:
It contains a lot of zeros, that is why the high bar around zero. How can I transform this to a normal distribution? My problem is that the high bar coming ...
0
votes
1answer
24 views
histogram starting point
I would like to ask something about histograms. I have a dataset containing only positive values. How can I get a histogram in spss25 with first range beginning a negative number? What does it mean?
0
votes
2answers
82 views
Kernel Density Estimation - Physical Interpretation?
I just read this article about the motivation for KDE. From what I understand, you are using Gaussian probability density distributions for each datapoint and then, depending on the selected kernel ...
3
votes
2answers
606 views
How to describe a bar graph?
What are some words for describing the overall shape of a bar graph for a nominal variable? The word "uniform" might apply when the bars are roughly the same height, but what can be said about other ...
1
vote
1answer
33 views
Meaning of Graph from tensorBoard
Can someone please help me to interpret the graph from tensorBoard. I have attached the screenshot herewith.
0
votes
0answers
3 views
Comparing which histogram has overall low cost
Let's say there are two histograms which basically is constructed from array of numbers which is measured by, repeatedly performing a task by two different methods and individual numbers are time ...
3
votes
3answers
1k views
Python: “Normalizing” kde, so it always lines up with histogram
In Python, I am attempting to find a way to plot/rescale kde's so that they match up with the histograms of the data that they are fitted to:
The above is a nice example of what I am going for, but ...
0
votes
0answers
28 views
p-value histogram of two-sample poisson tests on simulated data
I have two vectors (a and b), which are each a sample of n = 10000 from the poisson distribution with lambda = 10.
...
0
votes
1answer
64 views
Which regression model for percentage data with many zeros and ones?
I am analysing the share of a tree species at different forest locations. The data I am using is in percentage of the total species composition and I am modelling it based on the climatic probability ...
0
votes
1answer
71 views
Assumption multiple regression: normality of residuals
I want to run a multiple regression analysis for a given dataset in SPSS.
However, the dataset violates the assumption of normality of residuals, as depicted in the picture. The values for the ...
0
votes
0answers
31 views
How do I divide a density/frequency plot?
I have a frequency plot, which is essentially a smooth histogram. There are three very clear features (divided with a line by eye). Please note, there are two groups, male and female. The data used to ...
3
votes
1answer
55 views
When to stack histograms?
I'm working on a personal data analysis project, and I'm comparing the frequency count of survivors of a particular natural disaster, between males and females. I want to use these histogram(s) to ...
0
votes
0answers
24 views
How to find a threshold based on overlapping the histograms of two classes?
I want to perform thresholding to post-process the test data. I averaged the pixel intensity histograms of normal and abnormal cell images (grayscale, 8-bit, 256 * 256 images), overlapped them to ...
2
votes
1answer
48 views
Checking normality for a t-test
I am following stats courses at the moment and I am a bit confused about performing a t-test. I know that a t-test assumes normality and enough sample size. In the course I am attending, the ...
5
votes
2answers
153 views
name for histogram of nominal p-values under the null
To evaluate a statistical test or means of generating frequentist confidence intervals, it makes sense to repeatedly simulate data for which the null is true and then compute the nominal p-value, and ...
1
vote
1answer
91 views
How can I make a Kolmogorov-Smirnov test to check if my data distribution is exponential?
I made a histogram of my data, and the fitting line,
but from some reason the fitting line doesn't fit to my graph.
How can I make it fit to it?
How can I check if my data distribution is exponential?...
0
votes
1answer
26 views
How to find emprical PDF by using the normalized histogram?
first of all, thank you for your time, here is my question;
Is it possible to find emprical PDF by using normalized histogram?
I am trying to learn discrete event simulation and what I see is there ...
8
votes
2answers
166 views
What is this “phenomenon” called?
Below is a histogram of some data, the bins are integers the other parameters are irrelevant.
As you can see there seems to be two separate but overlapping normal distributions for odd and even ...
0
votes
0answers
42 views
Histogram equalization
I'm trying to equalize the following histogram:
I tried histogram equalization, but that didn't seem to work the way I wanted. I got something likes this:
Which is equally distributed everywhere. ...
