The Stack Overflow podcast is back! Listen to an interview with our new CEO.

Questions tagged [histogram]

A histogram is a graphical representation of the frequencies of a continuous variable. The variable is divided into bins and a bar is drawn for each bin, proportional to its frequency in the data.

Filter by
Sorted by
Tagged with
0
votes
1answer
7 views

the metrics that can be used to characterize and further compare different histogram

There is a set of different data set, each of which corresponds to a histogram. Are there any metrics that can be used to characterize the shape of each histogram, and further compare different ...
0
votes
1answer
12 views

Clustering using histograms

I need to find clusters in a very large amount of data (>2M data points), and I was looking for ways to speed up the usual algorithms, i.e. k-Means, DBSCAN, ... Is there any major issue, especially ...
-1
votes
2answers
12 views

If I can identify anomalies and outliers with a histogram, why should I perform clustering techniques? How are they different?

I am trying to find outliers in a set of data. When I did the exploratory analysis, the outliers are clearly spotted in the histograms. Is clustering better than histograms? Do they provide more ...
1
vote
1answer
26 views

Gaps in histogram for geometric distribution

I'm attempting an assignment in which we're supposed to write a function to simulate a geometric distribution with $p=0.03$. While plotting a histograms for about $100000$ simulations of the function, ...
1
vote
0answers
37 views

Wikipedia's Article on the Histogram [duplicate]

Wikipedia's nice article on the histogram contains the following sentence: "Using wider bins where the density of the underlying data points is low reduces noise due to sampling randomness; using ...
2
votes
1answer
38 views

how to scale the density plot for my histogram

I have the histogram plot and I'd like to overlap it with density line for the same data. Importantly, I don't want to turn histogram into density values, but want to keep N (numbers) on y axis. Is ...
1
vote
0answers
80 views

How to plot a marginal histogram correctly? Why is my plot different to the one in a textbook?

Chapter 1 of "Machine Learning - A Probabilistic Perspective" by Kevin Patrick Murphy gives this figure (fig_1), and says this is a pairwise scatter plot on iris dataset. The diagonal plots the ...
0
votes
1answer
15 views

sum of probabilities doesn't match, using HistogramTools in R

I was using the package HistogramTools in R to create Histogram. > H<-hist(1:100) > sum(H$density) [1] 0.1 Somehow the sum of the density is not 1, ...
0
votes
0answers
24 views

Upper limit on “unconstrained” histogram parts

I am wondering if there is a way to estimate upper limits on a histogram: I have an observation with 200 measurements, those scatter around some value with some variance. For context, x is the light ...
0
votes
0answers
9 views

Understanding percentiles of child or constituent distirbutions

Consider an example where a user performs some operation on a web page and total time taken for that operation is some of 2 parts. I.e., Total time = Part1 time + Part2 time. What we currently have ...
1
vote
0answers
25 views

How to compare 2 2-D histograms and get the probability of the 2 being the same / having samples drawn from the same/very similar distributions?

I was looking at this post describing methods of comparing histograms and in particular bin-to-bin comparison and cross-bin comparison and want to know how to use these to numerically evaluate how ...
2
votes
0answers
19 views

A comparison of the global optimal binwidth and local optimal binwidth of the histogram estimator

Suppose we have $X_1, \dots, X_n$ to be an i.i.d sample with unknown pdf $f(x)$ and cdf $F(x)$, and define $\hat{f} (x)$ to be the histogram estimator. We also define its Mean Integrated Square Error ...
2
votes
2answers
81 views

good number of bins for logarithmic bin width

I was wondering how to estimate a good number of bins for my histogram. I know quite certainly that my data is well approximated by a LogNormal distribution. Previous studies have used logarithmic ...
0
votes
0answers
27 views

How histograms help in understanding data and what roles do they play in selecting features before creating a model

I am new to machine learning and what ever I study related to it has an advice that we should understand the data and select features wisely before start creating the model. For this they demonstrate ...
0
votes
0answers
6 views

Strange results when computing the HOG and histogram intersection similarity

I am trying to re-implement algorithms mentioned in this paper to measure the "naturalness" of one synthetic image, given a real image. The algorithm seems straightforward, basically we have two ...
0
votes
1answer
14 views

Compare distribution to given shapes to find the most similar

I have a multiple comparison problem between some thousands of correlation distributions and given shapes. I have computed pair-wise correlation for a given set of gene expresion data, and I have ...
0
votes
0answers
24 views

Approximate a density function from sampled data

Let $(E,\mathcal E,\mu)$ be a measure space $E_0\in\mathcal E$ with $\mu(E_0)\in(0,\infty)$ and $\mathcal E_0\subseteq\left.\mathcal E\right|_{E_0}$ be finite and disjoint with $$E_0=\biguplus\...
0
votes
0answers
16 views

Transform right skewed distribution to normal [duplicate]

My datasets histogram is the following: It contains a lot of zeros, that is why the high bar around zero. How can I transform this to a normal distribution? My problem is that the high bar coming ...
0
votes
1answer
19 views

histogram starting point

I would like to ask something about histograms. I have a dataset containing only positive values. How can I get a histogram in spss25 with first range beginning a negative number? What does it mean?
0
votes
2answers
37 views

Kernel Density Estimation - Physical Interpretation?

I just read this article about the motivation for KDE. From what I understand, you are using Gaussian probability density distributions for each datapoint and then, depending on the selected kernel ...
3
votes
2answers
114 views

How to describe a bar graph?

What are some words for describing the overall shape of a bar graph for a nominal variable? The word "uniform" might apply when the bars are roughly the same height, but what can be said about other ...
1
vote
1answer
25 views

Meaning of Graph from tensorBoard

Can someone please help me to interpret the graph from tensorBoard. I have attached the screenshot herewith.
0
votes
0answers
3 views

Comparing which histogram has overall low cost

Let's say there are two histograms which basically is constructed from array of numbers which is measured by, repeatedly performing a task by two different methods and individual numbers are time ...
3
votes
3answers
577 views

Python: “Normalizing” kde, so it always lines up with histogram

In Python, I am attempting to find a way to plot/rescale kde's so that they match up with the histograms of the data that they are fitted to: The above is a nice example of what I am going for, but ...
0
votes
0answers
26 views

p-value histogram of two-sample poisson tests on simulated data

I have two vectors (a and b), which are each a sample of n = 10000 from the poisson distribution with lambda = 10. ...
0
votes
1answer
47 views

Which regression model for percentage data with many zeros and ones?

I am analysing the share of a tree species at different forest locations. The data I am using is in percentage of the total species composition and I am modelling it based on the climatic probability ...
0
votes
1answer
48 views

Assumption multiple regression: normality of residuals

I want to run a multiple regression analysis for a given dataset in SPSS. However, the dataset violates the assumption of normality of residuals, as depicted in the picture. The values for the ...
0
votes
0answers
29 views

How do I divide a density/frequency plot?

I have a frequency plot, which is essentially a smooth histogram. There are three very clear features (divided with a line by eye). Please note, there are two groups, male and female. The data used to ...
3
votes
1answer
53 views

When to stack histograms?

I'm working on a personal data analysis project, and I'm comparing the frequency count of survivors of a particular natural disaster, between males and females. I want to use these histogram(s) to ...
0
votes
0answers
23 views

How to find a threshold based on overlapping the histograms of two classes?

I want to perform thresholding to post-process the test data. I averaged the pixel intensity histograms of normal and abnormal cell images (grayscale, 8-bit, 256 * 256 images), overlapped them to ...
2
votes
1answer
46 views

Checking normality for a t-test

I am following stats courses at the moment and I am a bit confused about performing a t-test. I know that a t-test assumes normality and enough sample size. In the course I am attending, the ...
5
votes
2answers
132 views

name for histogram of nominal p-values under the null

To evaluate a statistical test or means of generating frequentist confidence intervals, it makes sense to repeatedly simulate data for which the null is true and then compute the nominal p-value, and ...
1
vote
1answer
41 views

How can I make a Kolmogorov-Smirnov test to check if my data distribution is exponential?

I made a histogram of my data, and the fitting line, but from some reason the fitting line doesn't fit to my graph. How can I make it fit to it? How can I check if my data distribution is exponential?...
0
votes
1answer
22 views

How to find emprical PDF by using the normalized histogram?

first of all, thank you for your time, here is my question; Is it possible to find emprical PDF by using normalized histogram? I am trying to learn discrete event simulation and what I see is there ...
8
votes
2answers
132 views

What is this “phenomenon” called?

Below is a histogram of some data, the bins are integers the other parameters are irrelevant. As you can see there seems to be two separate but overlapping normal distributions for odd and even ...
0
votes
0answers
38 views

Histogram equalization

I'm trying to equalize the following histogram: I tried histogram equalization, but that didn't seem to work the way I wanted. I got something likes this: Which is equally distributed everywhere. ...
0
votes
0answers
30 views

problems in plotting decimal value distribution with bin width normalization in r using hist()

I am plotting data distribuiton. I get the expected plot with data which are only integer numbers. But I didn't get appropriate plot for decimal data sets. The code with integer numbers data as ...
2
votes
0answers
21 views

Can I draw a histogram of the mean sample distribution (n=30) sampling from my dataset (n=200)?

I would like to test whether my data reasonably satisfies the normality assumption necessary to apply a t-test. My understanding is that, to apply a t-test, the distribution itself does not need to ...
1
vote
2answers
63 views

differentially private release of histograms (non-negative valued queries)

Two practical questions arise when releasing differentially private histograms/counts via addition of Laplace/Gaussian noise: 1) Is the result of noise addition truncated/rounded (since we know that ...
2
votes
2answers
169 views

Visualization of the number of transitions between states [closed]

I am currently developing a Markov model for ordinal data. In order to proceed with the modeling, I would like to check the distribution of the number of transitions per individual in my data set. ...
1
vote
1answer
88 views

downsampling a kde / combining kde and histogram

I'm calculating a KDE of one parameter (y, particle density) in bins of another parameter (x, distance from the origin). At ...
1
vote
0answers
14 views

Constructing an appropriate null hypothesis?

I have a collection of 20 2D surfaces embedded in 3D. The mean curvature of each surface has been sampled. The number of samples per surface varies from ~700,000 to ~20,000,000. The choice of ...
1
vote
2answers
108 views

Why use histogram to illustrated probability distribution

Forgive me I am a newbie of random variables. I saw a lot of course which introduce the Discrete Random Variables which always be illustrated with a histogram or ...
3
votes
1answer
55 views

How to quantify the agreement between the same parameter from two different data sets

I am looking at Arctic ice thickness from two different Earth-orbiting satellites A and B. I'm interested in quantifying how well these two datasets agree, but I'm struggling over what parameters to ...
0
votes
0answers
20 views

Histogram of Subtraction of Underlying Values

I have histograms produced from two sets of data recording. One of background noise of values $X$ and another $Z$ with a signal of values $Y$ present such that $Z = X + Y$. How can I estimate a ...
3
votes
1answer
47 views

Sparkline type visualisation of demographics in papers (introducing new 'non-standard' visuals)

It seems typical to include only basic statistics on subject demographics within papers (i.e. mean, max and min). It seems to me that having a knowledge of the actual distribution would be provide ...
0
votes
0answers
13 views

how to calculate the difference between multiple distribution(or frequency list)

Here is the scenario: I have a dataset, which contains list of data points, each point has F features(i.e. float numbers) and a category(there are C categories). I want to compare the difference of ...
1
vote
1answer
88 views

What does a p value histogram that is “normally” distributed mean?

Let's say I performed 100 tests and and want to correct for multiple comparisons. Before I do so, I plot the unaltered p values in a histogram to see what the distribution looks like. If the null ...
1
vote
2answers
86 views

How to approximate histogram(f(x)) from histogram(x)?

I have a histogram of a variable x, and I would like to get the histogram of f(x). Let's just say the transformation function is ...
1
vote
0answers
417 views

K-Nearest-Neighbor classification with only distance/similarity matrices, is it possible?

I want to classify histograms/distributions using K-Nearest-Neighbor. I can measure distances/dissimilarities between the distributions (using euclidean distance, kullback-leibler divergence...), thus ...