# Questions tagged [histogram]

A histogram is a graphical representation of the frequencies of a continuous variable. The variable is divided into bins and a bar is drawn for each bin, proportional to its frequency in the data.

537 questions
Filter by
Sorted by
Tagged with
9 views

### How do I make sklearn.ensemble.GradientBoostingRegressor non-random? [closed]

I am experimenting with sklearn.ensemble.GradientBoostingRegressor and finding that my results are sensitive to the parameter "random_state". I understand that this learning algorithm can be ...
• 656
19 views

### Comparison of two histogram with increasing range scale

I have a requirement of comparing two histograms. It is a distribution of buckets of time frames and each bucket has finite no. of entries. An example of the histogram: buckets - [2, 4, 8, 16, 32, 64, ...
14 views

### How should I interpret the random variables in this histogram?

I'm currently trying to eyeball the type of distribution of this histogram to properly specify the family of distribution to use for a generalised linear model in python. I'm pretty sure it's a gamma ...
23 views

### Measuring distance between two continuous distributions using their discrete approximations

I need to compute the distance between two continuous distributions. However, I have no idea as to what kind of distributions they are. I have a discrete approximation of the distributions. That is, ...
8 views

### Writing a 2D and above histogram estimator, what bins are returned?

I am working with the optidigits data from UCI repository, so I have 10 classes (10 single digits). If I apply PCA to the training digits and reduce it to 2 dimensions, and I plot those as x and y and ...
42 views

### Compare 2 binned non-parametric histograms with hypothesis test

According to this guy here: https://towardsdatascience.com/how-to-compare-two-distributions-in-practice-8c676904a285 and the following papers he mentions inside his article, and more specifically the ...
443 views

### Is there a name for a distribution where I can take log of its histogram and get back the same histogram?

I am imagining some data distribution where taking the log over and over again yields a distribution that has the exact same shape.
6 views

### Analyzing distribution of vector samples

I have a neural network that can be well trained with CNN features from AlexNet (a neural network that is pretrained for image recognition). I have obtained these CNN features from previous studies ...
• 385
25 views

### Create statistic to judge moisture distribution 'quality'

I am working with an agricultural dryer that gradually dries grain. During each drying run, many data are taken, including information about the moisture content distribution. The moisture content ...
• 123
99 views

### Two approaches for Fitting Beta-distribution to Histogram of Survey Response. Which one is better?

We have data from a survey in which participants are asked about the probability that an event takes place. The question is probabilistic and asks the respondents to assign probabilities to pre-...
139 views

### Is my data normally distributed? (QQ plot and histogram analysis) [duplicate]

I am trying to create a regression model for prediction. I need to generate prediction/confidence intervals for my model. I am trying to decide whether to use a quantile regression or linear ...
• 195
93 views

### Chi-square distribution, Chi-square distance

I am trying to use chi-square distance to find the similarity between two PDFs. My data is chi-square distributed. though the chi-square distance works well but my question is can I use the jensen-...
105 views

### How to analyse a right skewed dataset

I am trying to analyse several heavily right skewed datasets in order to determine their mode. The story behind the sets is that they are calculations of performance data from marketing posts. The ...
• 103
29 views

### How limited is my dataset?

So I have multiple datasets which are all histograms and cannot be linked. The topic of the data is quite complex so for example imagine I was surveying different qualities between men and women. The ...
470 views

### Outlier/anomaly detection on histograms

So, the idea is that I have many histograms, each one representing results for something. So, I have histogram_1 for object_1, histogram_2 for object_2,...,histogram_20 for object_20. How can throw ...
56 views

### Mean squared error in 2D, divide by pixel area or not?

I am comparing 2D histograms using mean squared error (MSE, mean of the squared differences). These histograms have varying pixel or bin sizes. I want to compare the MSE results across these different ...
179 views

### Why does my probability plot not agree with my histogram?

I am trying to determine the best distribution to characterize a dataset. My dataset visually looks like Cauchy distribution would be a good fit, so I used python to fit a Cauchy distribution to my ...
• 41
81 views

### How to convert units of KDE into physical units

I have a sample of people's heights. If I histogram it, I would usually divide by the bin width, so that my result becomes independent of my bin width, and I would label the axis something like (...
• 173
24 views

### Is it any meaningful taking the histogram of many histograms?

So I’m working on pixel-level assessment of chest x-ray images from the NIH Chest X-ray dataset. The diseases labels on the images are a set of z different categories (i.e. Pneumonia, effusion, etc…). ...
22 views

### Find mean value of total N with only relative frequency and mid point histogram [duplicate]

I have the following data of number of vouchers redeemed : How can i calculate the mean value of total vouchers?
76 views

### Calculate mean of sample size based on relative frequency in histogram [duplicate]

I have the following data of number of vouchers redeemed : How can i calculate the mean value of total vouchers?
16 views

### Comparing groups when each member provides multiple datapoints per visit

First timer - apologies for the length of the question and any incorrect use of terminology... I wish to compare two groups in a longitudinal study where there is a small 'n' (4 or 5 in each group). ...
30 views

### Mean squared error of 2 distributions when there are many zero values

I am comparing two (2-D) distributions using mean squared error. I take the difference between distributions, square them, average them and multiply them by the area of a pixel/bin. These ...
• 11
408 views

### Probability for a bin in a binned histogram

This question is very basic, but I cannot figure the error in my thinking. According to the author of the book "Pattern Recognition and Machine Learning", we can get the Probability ...
• 321
110 views

### Selecting the optimal bandwidth in kernel density estimation

I have a question regarding kernel density estimation. At the moment I have a set of sample date $V$, where for each $v \in V$ I have an associated standard deviation $\sigma_v$ (some measurements ...
22 views

### Estimating the Probability in a statistical analysis

I am carrying out a statistical analysis where I run the simulation (Matlab) 5000 times, to get 5000 results. The objective is to estimate the probability of having a result that is less than or equal ...
• 143
1 vote
64 views

### Histogram vs Bar Graph [closed]

I have data for number of patients used to collect the data in a hospital for each day. I want to display them as a graphical representation of number of patients used to collect the data for each ...
• 13
3 views

### What metric is best fitted for comparing encodings?

I am trying to compare two distributions, that each correspond to different numerical encodings, e.g. compare fp32 encodings to various other encodings on a same set of values. However I do not know ...
11 views

### Detecting Mean differences on streaming data

Im taking online measurements on highly skewed real valued data of two possibly unrelated distributions. The precision is low, which means small values tend to come in duplicates, while large values ...
1 vote
56 views

### Empirical distribution for feature binning

In paper "A simple yet effective baseline for non-attributed graph classification" (https://arxiv.org/pdf/1811.03508.pdf) authors use empirical distribution for feature binning. Precisely, ...
• 229
1 vote
425 views

### Histogram of a Sample with Overlay of Population Density

To familiarize myself with histograms and probability density functions, I decided to sample various distributions, plot samples' histograms and their corresponding probability distribution functions. ...
• 121
43 views

### Infer (supposed) Poissonian probability from data

Suppose to count the drops of rain in a square meter in 15 seconds, producing 16 observations: 40, 20, 24, 15, 23, 12, 39, 26, 29, 33, 16, 36, 17, 32, 40, 15. What is the probability of counting 28 ...
• 153
1 vote
42 views

### How to adjust for the baseline difference between groups for a histogram

I have data from an experiment that tested responses to stimuli in females and males. I measured baseline for both groups prior to presenting the stimuli. The baseline for males is higher than for ...
58 views

### Is there a way to identify key points of change in length-frequency (histogram) data through statistical means?

I am performing a length-frequency analysis (read: histogram) of data in fishes. This is a common way in which fish biologists analyze life history data in fishes. An example of the data is as follows....
• 191
1k views

### How do I overlap a Poisson distribution with a histogram

I expect to get a Poisson distribution over my histogram but as I can see from the graph, I get a straight line. Would really appreciate insight.
• 21
394 views

### Should histograms be normalized first before fitting them?

Assume I have some data that follow a power law and I would like to estimate the exponent $a$. An obvious way to do so is to bin the data and then fit the power law to the histogram. However I found ...
• 105
570 views

### Inverse transform method, theoretical graph not matching sample

Suppose a density function is f_X(x)=\left\{\begin{aligned}\frac{1}{(1+x)^2} & \quad x \ge 0 \\ 0 & \quad \text{otherwise.}\end{aligned}\right. I am trying to write an algorithm to ...
• 113
1 vote
101 views

### Mann-Whitney U test on "histogram-compressed" data?

I want to perform a very large number of Mann-Whitney U-tests between many groups from data that I will get in from a database. I would prefer to use a pre-implemented version of this test. I think ...
1 vote
147 views

### Shape of a Histogram with Equally Likely Outcomes

In a large class of introductory Statistics students, the professor has each student toss a coin 16 times and calculate the proportion of his or her tosses that were heads. The students then report ...
• 353
143 views

### Do my data follow normal distribution? and what does it mean if not? Can I have to peaks?

I have to understand if my graphs follow the normal distribution but I don't know. Can they have two peaks like two columns? Are they normal or not? what it means if they are not normal? The aim is to ...
77 views

### Approximation of a polynomial via histogram

Note: I originally tried to pose this question generally, without discussing the specific type of stochastic process. I hope that this can still be an interesting question generally. Assume that we ...
1 vote
345 views

### Why are rating distributions 'smoother' when there are more players?

Consider the following rating distributions by variant/time control on lichess. The bullet, blitz and rapid rating distributions look very, well, 'smooth' (or holomorphic/analytic or harmonic or ...
• 2,260
28 views

### Histogram where the bin heights take values into account

In a regular histogram the bin heights reflect the density of observations/data within them. Therefore, the areas of the bins on the chart reflect the quantity of observations they cover. They are for ...
29 views

### Departure from uniformity histogram

Let us consider the histogram of a random variable. It is uniform up to a certain value $\bar{x}$, while beyond it a growth is present,as shown in the figure. I would like to obtain an estimate of the ...
1 vote
193 views

### Interpretting overlapping histogram

I obtained the following histogram when performing data analysis. This histogram refers to the duration of cab trips in the NYC taxi dataset. The histogram clearly shows two overlapping populations ...
1 vote
44 views

### Estimate the number of ranges that overlap

I am a CS major and I am dealing with this problem about finding the join estimation for overlapping ranges. Imagine that you have two tables (sets) with ranges ex. integers ([2,10), [5, 20)) and you ...
• 11
3k views

### Poisson Distribution fit with large counts (Python) [closed]

I'm trying to fit a dataset to a Poisson distribution, but have probably messed up the parameters somewhere along the way. My data consists of 112 10 minute intervals where radiation hits a detector ...
1 vote
203 views

### How are regression lines calculated for 2D histograms?

I've been looking into how to fit a line to a 2D histogram and have come across different pieces of information which I can't quite piece together. To show what I mean, I want to achieve something ...
• 245
121 views

### Negative KL divergence for train_test_split in sklearn for y_train and y_val

So, I am trying to understand if I have fair split of my train and val sets using train_test_split of sklearn, so I decided to run the KL divergence and JS div tests and I get the following results. ...
• 514