Questions tagged [histogram]

A histogram is a graphical representation of the frequencies of a continuous variable. The variable is divided into bins and a bar is drawn for each bin, proportional to its frequency in the data.

Filter by
Sorted by
Tagged with
2 votes
1 answer
44 views

Is my data normally distributed? (QQ plot and histogram analysis)

I am trying to create a regression model for prediction. I need to generate prediction/confidence intervals for my model. I am trying to decide whether to use a quantile regression or linear ...
2 votes
1 answer
740 views

How to evaluate a histogram?

Let's say I have the histogram above which reports performances of some neural networks. The y axis is the bin size, while the x axis is the error, so low errors = high performance. Out of these 15 ...
0 votes
0 answers
17 views

Chi-square distribution, Chi-square distance

I am trying to use chi-square distance to find the similarity between two PDFs. My data is chi-square distributed. though the chi-square distance works well but my question is can I use the jensen-...
0 votes
0 answers
20 views

ROC curve not forming the usual shape

I have a situation where I have 4 histograms on the same plot - let's say for example these are the weights of 4 different animals: lions, tigers, wolves and deer. I am trying to classify new data by ...
0 votes
1 answer
66 views

How to analyse a right skewed dataset

I am trying to analyse several heavily right skewed datasets in order to determine their mode. The story behind the sets is that they are calculations of performance data from marketing posts. The ...
0 votes
0 answers
28 views

How limited is my dataset?

So I have multiple datasets which are all histograms and cannot be linked. The topic of the data is quite complex so for example imagine I was surveying different qualities between men and women. The ...
5 votes
1 answer
173 views

Outlier/anomaly detection on histograms

So, the idea is that I have many histograms, each one representing results for something. So, I have histogram_1 for object_1, histogram_2 for object_2,...,histogram_20 for object_20. How can throw ...
0 votes
0 answers
20 views

Should you descale features like histogram before running them through MLP? [closed]

I have signal data from which I compute a histogram, I have N channels so I get N histograms as a result in python. E.g. here is the example of signal data: ...
0 votes
0 answers
24 views

Mean squared error in 2D, divide by pixel area or not?

I am comparing 2D histograms using mean squared error (MSE, mean of the squared differences). These histograms have varying pixel or bin sizes. I want to compare the MSE results across these different ...
7 votes
1 answer
4k views

Violin plot or bean plot? What are the advantages of each?

I would like to represent my data in the most informative way. As successors of the boxplot, I have found violin plots as well as beanplots. What are the advantages of each plot? A violin plot could ...
3 votes
2 answers
60 views

Why does my probability plot not agree with my histogram?

I am trying to determine the best distribution to characterize a dataset. My dataset visually looks like Cauchy distribution would be a good fit, so I used python to fit a Cauchy distribution to my ...
3 votes
2 answers
867 views

inferring heavy-tail distribution from finite sample of histogram data

I have some data in the form of bins and counts. Here is one complete non-truncated example: ...
15 votes
2 answers
2k views

How to estimate the third quartile of binned data?

Is there any technical trick to determine the third quartile if it belongs to an open interval which contains more that one fourth of the population (so I can't close the interval and use the standard ...
0 votes
1 answer
25 views

How to convert units of KDE into physical units

I have a sample of people's heights. If I histogram it, I would usually divide by the bin width, so that my result becomes independent of my bin width, and I would label the axis something like (...
0 votes
0 answers
18 views

Is it any meaningful taking the histogram of many histograms?

So I’m working on pixel-level assessment of chest x-ray images from the NIH Chest X-ray dataset. The diseases labels on the images are a set of z different categories (i.e. Pneumonia, effusion, etc…). ...
-1 votes
1 answer
27 views

Calculate mean of sample size based on relative frequency in histogram [duplicate]

I have the following data of number of vouchers redeemed : How can i calculate the mean value of total vouchers?
-1 votes
0 answers
22 views

Find mean value of total N with only relative frequency and mid point histogram [duplicate]

I have the following data of number of vouchers redeemed : How can i calculate the mean value of total vouchers?
1 vote
1 answer
776 views

Compare distribution to given shapes to find the most similar

I have a multiple comparison problem between some thousands of correlation distributions and given shapes. I have computed pair-wise correlation for a given set of gene expresion data, and I have ...
0 votes
0 answers
11 views

Comparing groups when each member provides multiple datapoints per visit

First timer - apologies for the length of the question and any incorrect use of terminology... I wish to compare two groups in a longitudinal study where there is a small 'n' (4 or 5 in each group). ...
0 votes
0 answers
24 views

Mean squared error of 2 distributions when there are many zero values

I am comparing two (2-D) distributions using mean squared error. I take the difference between distributions, square them, average them and multiply them by the area of a pixel/bin. These ...
3 votes
3 answers
344 views

Discrete data: Graphs and skewness

I am studying an introductory course in statistics, Essentials of Statistics. The author mentioned that histograms are used to represent the frequency distribution of a continuous data. Then directly, ...
3 votes
1 answer
49 views

Probability for a bin in a binned histogram

This question is very basic, but I cannot figure the error in my thinking. According to the author of the book "Pattern Recognition and Machine Learning", we can get the Probability ...
3 votes
1 answer
3k views

Rank histogram (or Talagrand Diagram) of precipitation data

Given a dataset of lines containing 6 wind forecast values plus 1 observed (actual) value in each like: ...
2 votes
1 answer
2k views

What is the purpose of multiplying by the difference between the midpoints of two bins in this recipe?

While browsing for information on how I might plot a fitted normal curve over a histogram, I found the following: http://www.statmethods.net/graphs/density.html There is a line I don't fully ...
2 votes
2 answers
284 views

downsampling a kde / combining kde and histogram

I'm calculating a KDE of one parameter (y, particle density) in bins of another parameter (x, distance from the origin). At ...
0 votes
0 answers
37 views

Selecting the optimal bandwidth in kernel density estimation

I have a question regarding kernel density estimation. At the moment I have a set of sample date $V$, where for each $v \in V$ I have an associated standard deviation $\sigma_v$ (some measurements ...
1 vote
2 answers
43 views

Histogram vs Bar Graph [closed]

I have data for number of patients used to collect the data in a hospital for each day. I want to display them as a graphical representation of number of patients used to collect the data for each ...
0 votes
0 answers
20 views

Estimating the Probability in a statistical analysis

I am carrying out a statistical analysis where I run the simulation (Matlab) 5000 times, to get 5000 results. The objective is to estimate the probability of having a result that is less than or equal ...
2 votes
2 answers
194 views

Displaying distributions of data with a high number of features

I have data of two different groups. From each data, I have say 100 samples, each sample having 20 features. I want to display the distribution of each of the two datasets. Now I have some very ...
0 votes
0 answers
3 views

What metric is best fitted for comparing encodings?

I am trying to compare two distributions, that each correspond to different numerical encodings, e.g. compare fp32 encodings to various other encodings on a same set of values. However I do not know ...
0 votes
0 answers
11 views

Detecting Mean differences on streaming data

Im taking online measurements on highly skewed real valued data of two possibly unrelated distributions. The precision is low, which means small values tend to come in duplicates, while large values ...
7 votes
3 answers
2k views

Error Bars for Histogram with Uncertain Data

Context I have a set of data points $\{x_1, \dots, x_N \}$ along with the respective measurement uncertainties $\{\epsilon_1, \dots, \epsilon_N\}$ in them ($N \approx 100$). These data are basically ...
1 vote
2 answers
116 views

Histogram of a Sample with Overlay of Population Density

To familiarize myself with histograms and probability density functions, I decided to sample various distributions, plot samples' histograms and their corresponding probability distribution functions. ...
1 vote
0 answers
17 views

Empirical distribution for feature binning

In paper "A simple yet effective baseline for non-attributed graph classification" (https://arxiv.org/pdf/1811.03508.pdf) authors use empirical distribution for feature binning. Precisely, ...
3 votes
2 answers
411 views

What to do when IQR returns 0 in Freedman-Diaconis' rule?

I want to discretize a pandas continuous column. For discretization, I'm using Freedman-Diaconis rule which computes the optimal number of bins which will be given input to KBinsDiscretizer. Freedman-...
2 votes
1 answer
28 views

Infer (supposed) Poissonian probability from data

Suppose to count the drops of rain in a square meter in 15 seconds, producing 16 observations: 40, 20, 24, 15, 23, 12, 39, 26, 29, 33, 16, 36, 17, 32, 40, 15. What is the probability of counting 28 ...
1 vote
0 answers
25 views

How to adjust for the baseline difference between groups for a histogram

I have data from an experiment that tested responses to stimuli in females and males. I measured baseline for both groups prior to presenting the stimuli. The baseline for males is higher than for ...
3 votes
1 answer
31 views

Is there a way to identify key points of change in length-frequency (histogram) data through statistical means?

I am performing a length-frequency analysis (read: histogram) of data in fishes. This is a common way in which fish biologists analyze life history data in fishes. An example of the data is as follows....
2 votes
1 answer
379 views

How do I overlap a Poisson distribution with a histogram

I expect to get a Poisson distribution over my histogram but as I can see from the graph, I get a straight line. Would really appreciate insight.
0 votes
1 answer
95 views

Should histograms be normalized first before fitting them?

Assume I have some data that follow a power law and I would like to estimate the exponent $a$. An obvious way to do so is to bin the data and then fit the power law to the histogram. However I found ...
8 votes
2 answers
432 views

Inverse transform method, theoretical graph not matching sample

Suppose a density function is $$f_X(x)=\left\{\begin{aligned}\frac{1}{(1+x)^2} & \quad x \ge 0 \\ 0 & \quad \text{otherwise.}\end{aligned}\right.$$ I am trying to write an algorithm to ...
1 vote
2 answers
322 views

Why are rating distributions 'smoother' when there are more players?

Consider the following rating distributions by variant/time control on lichess. The bullet, blitz and rapid rating distributions look very, well, 'smooth' (or holomorphic/analytic or harmonic or ...
0 votes
0 answers
33 views

How do you estimate the mode of a histogram with logarithmic bin width?

For the purpose of estimating the median and other quantiles, I summarize samples in a histogram whose bins grow logarithmically in width. For example, to guarantee a 1% worst case absolute relative ...
1 vote
2 answers
57 views

Mann-Whitney U test on "histogram-compressed" data?

I want to perform a very large number of Mann-Whitney U-tests between many groups from data that I will get in from a database. I would prefer to use a pre-implemented version of this test. I think ...
0 votes
1 answer
98 views

Do my data follow normal distribution? and what does it mean if not? Can I have to peaks?

I have to understand if my graphs follow the normal distribution but I don't know. Can they have two peaks like two columns? Are they normal or not? what it means if they are not normal? The aim is to ...
1 vote
2 answers
66 views

Shape of a Histogram with Equally Likely Outcomes

In a large class of introductory Statistics students, the professor has each student toss a coin 16 times and calculate the proportion of his or her tosses that were heads. The students then report ...
0 votes
0 answers
67 views

Approximation of a polynomial via histogram

Note: I originally tried to pose this question generally, without discussing the specific type of stochastic process. I hope that this can still be an interesting question generally. Assume that we ...
0 votes
0 answers
18 views

How to aggregate time-bucketed values across a set

I am trying to perform some analysis over a dataset of multiple projects. This dataset has multiple months of data for every single project. Because projects occur at different times and have ...
5 votes
1 answer
1k views

Bhattacharyya distance for three histograms

There is a paper “Auto White Balance Based on the Similarity of Chromaticity Histograms” mention about automatic white balance. One of the key point of this algorithm is how to measure the similarity ...
0 votes
0 answers
19 views

Histogram where the bin heights take values into account

In a regular histogram the bin heights reflect the density of observations/data within them. Therefore, the areas of the bins on the chart reflect the quantity of observations they cover. They are for ...

1
2 3 4 5
11