Questions tagged [histogram]
A histogram is a graphical representation of the frequencies of a continuous variable. The variable is divided into bins and a bar is drawn for each bin, proportional to its frequency in the data.
409
questions
0
votes
1answer
7 views
the metrics that can be used to characterize and further compare different histogram
There is a set of different data set, each of which corresponds to a histogram. Are there any metrics that can be used to characterize the shape of each histogram, and further compare different ...
0
votes
1answer
12 views
Clustering using histograms
I need to find clusters in a very large amount of data (>2M data points), and I was looking for ways to speed up the usual algorithms, i.e. k-Means, DBSCAN, ...
Is there any major issue, especially ...
-1
votes
2answers
12 views
If I can identify anomalies and outliers with a histogram, why should I perform clustering techniques? How are they different?
I am trying to find outliers in a set of data. When I did the exploratory analysis, the outliers are clearly spotted in the histograms. Is clustering better than histograms? Do they provide more ...
1
vote
1answer
26 views
Gaps in histogram for geometric distribution
I'm attempting an assignment in which we're supposed to write a function to simulate a geometric distribution with $p=0.03$. While plotting a histograms for about $100000$ simulations of the function, ...
1
vote
0answers
37 views
Wikipedia's Article on the Histogram [duplicate]
Wikipedia's nice article on the histogram contains the following sentence:
"Using wider bins where the density of the underlying data points is low reduces noise due to sampling randomness; using ...
2
votes
1answer
38 views
how to scale the density plot for my histogram
I have the histogram plot and I'd like to overlap it with density line for the same data. Importantly, I don't want to turn histogram into density values, but want to keep N (numbers) on y axis.
Is ...
1
vote
0answers
80 views
How to plot a marginal histogram correctly? Why is my plot different to the one in a textbook?
Chapter 1 of "Machine Learning - A Probabilistic Perspective" by Kevin Patrick Murphy gives this figure (fig_1),
and says
this is a pairwise scatter plot on iris dataset. The diagonal plots the ...
0
votes
1answer
15 views
sum of probabilities doesn't match, using HistogramTools in R
I was using the package HistogramTools in R to create Histogram.
> H<-hist(1:100)
> sum(H$density)
[1] 0.1
Somehow the sum of the density is not 1, ...
0
votes
0answers
24 views
Upper limit on “unconstrained” histogram parts
I am wondering if there is a way to estimate upper limits on a histogram:
I have an observation with 200 measurements, those scatter around some value with some variance. For context, x is the light ...
0
votes
0answers
9 views
Understanding percentiles of child or constituent distirbutions
Consider an example where a user performs some operation on a web page and total time taken for that operation is some of 2 parts. I.e.,
Total time = Part1 time + Part2 time.
What we currently have ...
1
vote
0answers
25 views
How to compare 2 2-D histograms and get the probability of the 2 being the same / having samples drawn from the same/very similar distributions?
I was looking at this post describing methods of comparing histograms and in particular bin-to-bin comparison and cross-bin comparison and want to know how to use these to numerically evaluate how ...
2
votes
0answers
19 views
A comparison of the global optimal binwidth and local optimal binwidth of the histogram estimator
Suppose we have $X_1, \dots, X_n$ to be an i.i.d sample with unknown pdf $f(x)$ and cdf $F(x)$, and define $\hat{f} (x)$ to be the histogram estimator. We also define its Mean Integrated Square Error ...
2
votes
2answers
81 views
good number of bins for logarithmic bin width
I was wondering how to estimate a good number of bins for my histogram.
I know quite certainly that my data is well approximated by a LogNormal distribution. Previous studies have used logarithmic ...
0
votes
0answers
27 views
How histograms help in understanding data and what roles do they play in selecting features before creating a model
I am new to machine learning and what ever I study related to it has an advice that we should understand the data and select features wisely before start creating the model. For this they demonstrate ...
0
votes
0answers
6 views
Strange results when computing the HOG and histogram intersection similarity
I am trying to re-implement algorithms mentioned in this paper to measure the "naturalness" of one synthetic image, given a real image. The algorithm seems straightforward, basically we have two ...
0
votes
1answer
14 views
Compare distribution to given shapes to find the most similar
I have a multiple comparison problem between some thousands of correlation distributions and given shapes.
I have computed pair-wise correlation for a given set of gene expresion data, and I have ...
0
votes
0answers
24 views
Approximate a density function from sampled data
Let
$(E,\mathcal E,\mu)$ be a measure space
$E_0\in\mathcal E$ with $\mu(E_0)\in(0,\infty)$ and $\mathcal E_0\subseteq\left.\mathcal E\right|_{E_0}$ be finite and disjoint with $$E_0=\biguplus\...
0
votes
0answers
16 views
Transform right skewed distribution to normal [duplicate]
My datasets histogram is the following:
It contains a lot of zeros, that is why the high bar around zero. How can I transform this to a normal distribution? My problem is that the high bar coming ...
0
votes
1answer
19 views
histogram starting point
I would like to ask something about histograms. I have a dataset containing only positive values. How can I get a histogram in spss25 with first range beginning a negative number? What does it mean?
0
votes
2answers
37 views
Kernel Density Estimation - Physical Interpretation?
I just read this article about the motivation for KDE. From what I understand, you are using Gaussian probability density distributions for each datapoint and then, depending on the selected kernel ...
3
votes
2answers
114 views
How to describe a bar graph?
What are some words for describing the overall shape of a bar graph for a nominal variable? The word "uniform" might apply when the bars are roughly the same height, but what can be said about other ...
1
vote
1answer
25 views
Meaning of Graph from tensorBoard
Can someone please help me to interpret the graph from tensorBoard. I have attached the screenshot herewith.
0
votes
0answers
3 views
Comparing which histogram has overall low cost
Let's say there are two histograms which basically is constructed from array of numbers which is measured by, repeatedly performing a task by two different methods and individual numbers are time ...
3
votes
3answers
577 views
Python: “Normalizing” kde, so it always lines up with histogram
In Python, I am attempting to find a way to plot/rescale kde's so that they match up with the histograms of the data that they are fitted to:
The above is a nice example of what I am going for, but ...
0
votes
0answers
26 views
p-value histogram of two-sample poisson tests on simulated data
I have two vectors (a and b), which are each a sample of n = 10000 from the poisson distribution with lambda = 10.
...
0
votes
1answer
47 views
Which regression model for percentage data with many zeros and ones?
I am analysing the share of a tree species at different forest locations. The data I am using is in percentage of the total species composition and I am modelling it based on the climatic probability ...
0
votes
1answer
48 views
Assumption multiple regression: normality of residuals
I want to run a multiple regression analysis for a given dataset in SPSS.
However, the dataset violates the assumption of normality of residuals, as depicted in the picture. The values for the ...
0
votes
0answers
29 views
How do I divide a density/frequency plot?
I have a frequency plot, which is essentially a smooth histogram. There are three very clear features (divided with a line by eye). Please note, there are two groups, male and female. The data used to ...
3
votes
1answer
53 views
When to stack histograms?
I'm working on a personal data analysis project, and I'm comparing the frequency count of survivors of a particular natural disaster, between males and females. I want to use these histogram(s) to ...
0
votes
0answers
23 views
How to find a threshold based on overlapping the histograms of two classes?
I want to perform thresholding to post-process the test data. I averaged the pixel intensity histograms of normal and abnormal cell images (grayscale, 8-bit, 256 * 256 images), overlapped them to ...
2
votes
1answer
46 views
Checking normality for a t-test
I am following stats courses at the moment and I am a bit confused about performing a t-test. I know that a t-test assumes normality and enough sample size. In the course I am attending, the ...
5
votes
2answers
132 views
name for histogram of nominal p-values under the null
To evaluate a statistical test or means of generating frequentist confidence intervals, it makes sense to repeatedly simulate data for which the null is true and then compute the nominal p-value, and ...
1
vote
1answer
41 views
How can I make a Kolmogorov-Smirnov test to check if my data distribution is exponential?
I made a histogram of my data, and the fitting line,
but from some reason the fitting line doesn't fit to my graph.
How can I make it fit to it?
How can I check if my data distribution is exponential?...
0
votes
1answer
22 views
How to find emprical PDF by using the normalized histogram?
first of all, thank you for your time, here is my question;
Is it possible to find emprical PDF by using normalized histogram?
I am trying to learn discrete event simulation and what I see is there ...
8
votes
2answers
132 views
What is this “phenomenon” called?
Below is a histogram of some data, the bins are integers the other parameters are irrelevant.
As you can see there seems to be two separate but overlapping normal distributions for odd and even ...
0
votes
0answers
38 views
Histogram equalization
I'm trying to equalize the following histogram:
I tried histogram equalization, but that didn't seem to work the way I wanted. I got something likes this:
Which is equally distributed everywhere. ...
0
votes
0answers
30 views
problems in plotting decimal value distribution with bin width normalization in r using hist()
I am plotting data distribuiton.
I get the expected plot with data which are only integer numbers. But I didn't get appropriate plot for decimal data sets.
The code with integer numbers data as ...
2
votes
0answers
21 views
Can I draw a histogram of the mean sample distribution (n=30) sampling from my dataset (n=200)?
I would like to test whether my data reasonably satisfies the normality assumption necessary to apply a t-test.
My understanding is that, to apply a t-test, the distribution itself does not need to ...
1
vote
2answers
63 views
differentially private release of histograms (non-negative valued queries)
Two practical questions arise when releasing differentially private histograms/counts via addition of Laplace/Gaussian noise:
1) Is the result of noise addition truncated/rounded (since we know that ...
2
votes
2answers
169 views
Visualization of the number of transitions between states [closed]
I am currently developing a Markov model for ordinal data. In order to proceed with the modeling, I would like to check the distribution of the number of transitions per individual in my data set.
...
1
vote
1answer
88 views
downsampling a kde / combining kde and histogram
I'm calculating a KDE of one parameter (y, particle density) in bins of another parameter (x, distance from the origin). At ...
1
vote
0answers
14 views
Constructing an appropriate null hypothesis?
I have a collection of 20 2D surfaces embedded in 3D. The mean curvature of each surface has been sampled.
The number of samples per surface varies from ~700,000 to ~20,000,000. The choice of ...
1
vote
2answers
108 views
Why use histogram to illustrated probability distribution
Forgive me I am a newbie of random variables. I saw a lot of course which introduce the Discrete Random Variables which always be illustrated with a histogram or ...
3
votes
1answer
55 views
How to quantify the agreement between the same parameter from two different data sets
I am looking at Arctic ice thickness from two different Earth-orbiting satellites A and B. I'm interested in quantifying how well these two datasets agree, but I'm struggling over what parameters to ...
0
votes
0answers
20 views
Histogram of Subtraction of Underlying Values
I have histograms produced from two sets of data recording. One of background noise of values $X$ and another $Z$ with a signal of values $Y$ present such that $Z = X + Y$.
How can I estimate a ...
3
votes
1answer
47 views
Sparkline type visualisation of demographics in papers (introducing new 'non-standard' visuals)
It seems typical to include only basic statistics on subject demographics within papers (i.e. mean, max and min). It seems to me that having a knowledge of the actual distribution would be provide ...
0
votes
0answers
13 views
how to calculate the difference between multiple distribution(or frequency list)
Here is the scenario:
I have a dataset, which contains list of data points, each point has F features(i.e. float numbers) and a category(there are C categories).
I want to compare the difference of ...
1
vote
1answer
88 views
What does a p value histogram that is “normally” distributed mean?
Let's say I performed 100 tests and and want to correct for multiple comparisons. Before I do so, I plot the unaltered p values in a histogram to see what the distribution looks like.
If the null ...
1
vote
2answers
86 views
How to approximate histogram(f(x)) from histogram(x)?
I have a histogram of a variable x, and I would like to get the histogram of f(x). Let's just say the transformation function is ...
1
vote
0answers
417 views
K-Nearest-Neighbor classification with only distance/similarity matrices, is it possible?
I want to classify histograms/distributions using K-Nearest-Neighbor. I can measure distances/dissimilarities between the distributions (using euclidean distance, kullback-leibler divergence...), thus ...
