Questions tagged [histogram]

A histogram is a graphical representation of the frequencies of a continuous variable. The variable is divided into bins and a bar is drawn for each bin, proportional to its frequency in the data.

Filter by
Sorted by
Tagged with
0 votes
0 answers
9 views

How do I make sklearn.ensemble.GradientBoostingRegressor non-random? [closed]

I am experimenting with sklearn.ensemble.GradientBoostingRegressor and finding that my results are sensitive to the parameter "random_state". I understand that this learning algorithm can be ...
  • 656
0 votes
0 answers
19 views

Comparison of two histogram with increasing range scale

I have a requirement of comparing two histograms. It is a distribution of buckets of time frames and each bucket has finite no. of entries. An example of the histogram: buckets - [2, 4, 8, 16, 32, 64, ...
0 votes
0 answers
14 views

How should I interpret the random variables in this histogram?

I'm currently trying to eyeball the type of distribution of this histogram to properly specify the family of distribution to use for a generalised linear model in python. I'm pretty sure it's a gamma ...
2 votes
0 answers
23 views

Measuring distance between two continuous distributions using their discrete approximations

I need to compute the distance between two continuous distributions. However, I have no idea as to what kind of distributions they are. I have a discrete approximation of the distributions. That is, ...
0 votes
0 answers
8 views

Writing a 2D and above histogram estimator, what bins are returned?

I am working with the optidigits data from UCI repository, so I have 10 classes (10 single digits). If I apply PCA to the training digits and reduce it to 2 dimensions, and I plot those as x and y and ...
0 votes
0 answers
42 views

Compare 2 binned non-parametric histograms with hypothesis test

According to this guy here: https://towardsdatascience.com/how-to-compare-two-distributions-in-practice-8c676904a285 and the following papers he mentions inside his article, and more specifically the ...
6 votes
2 answers
443 views

Is there a name for a distribution where I can take log of its histogram and get back the same histogram?

I am imagining some data distribution where taking the log over and over again yields a distribution that has the exact same shape.
0 votes
0 answers
6 views

Analyzing distribution of vector samples

I have a neural network that can be well trained with CNN features from AlexNet (a neural network that is pretrained for image recognition). I have obtained these CNN features from previous studies ...
  • 385
2 votes
1 answer
25 views

Create statistic to judge moisture distribution 'quality'

I am working with an agricultural dryer that gradually dries grain. During each drying run, many data are taken, including information about the moisture content distribution. The moisture content ...
0 votes
1 answer
99 views

Two approaches for Fitting Beta-distribution to Histogram of Survey Response. Which one is better?

We have data from a survey in which participants are asked about the probability that an event takes place. The question is probabilistic and asks the respondents to assign probabilities to pre-...
2 votes
1 answer
139 views

Is my data normally distributed? (QQ plot and histogram analysis) [duplicate]

I am trying to create a regression model for prediction. I need to generate prediction/confidence intervals for my model. I am trying to decide whether to use a quantile regression or linear ...
  • 195
0 votes
0 answers
93 views

Chi-square distribution, Chi-square distance

I am trying to use chi-square distance to find the similarity between two PDFs. My data is chi-square distributed. though the chi-square distance works well but my question is can I use the jensen-...
  • 1
0 votes
1 answer
105 views

How to analyse a right skewed dataset

I am trying to analyse several heavily right skewed datasets in order to determine their mode. The story behind the sets is that they are calculations of performance data from marketing posts. The ...
0 votes
0 answers
29 views

How limited is my dataset?

So I have multiple datasets which are all histograms and cannot be linked. The topic of the data is quite complex so for example imagine I was surveying different qualities between men and women. The ...
6 votes
1 answer
470 views

Outlier/anomaly detection on histograms

So, the idea is that I have many histograms, each one representing results for something. So, I have histogram_1 for object_1, histogram_2 for object_2,...,histogram_20 for object_20. How can throw ...
0 votes
0 answers
56 views

Mean squared error in 2D, divide by pixel area or not?

I am comparing 2D histograms using mean squared error (MSE, mean of the squared differences). These histograms have varying pixel or bin sizes. I want to compare the MSE results across these different ...
4 votes
2 answers
179 views

Why does my probability plot not agree with my histogram?

I am trying to determine the best distribution to characterize a dataset. My dataset visually looks like Cauchy distribution would be a good fit, so I used python to fit a Cauchy distribution to my ...
  • 41
0 votes
1 answer
81 views

How to convert units of KDE into physical units

I have a sample of people's heights. If I histogram it, I would usually divide by the bin width, so that my result becomes independent of my bin width, and I would label the axis something like (...
  • 173
0 votes
0 answers
24 views

Is it any meaningful taking the histogram of many histograms?

So I’m working on pixel-level assessment of chest x-ray images from the NIH Chest X-ray dataset. The diseases labels on the images are a set of z different categories (i.e. Pneumonia, effusion, etc…). ...
-1 votes
0 answers
22 views

Find mean value of total N with only relative frequency and mid point histogram [duplicate]

I have the following data of number of vouchers redeemed : How can i calculate the mean value of total vouchers?
-1 votes
1 answer
76 views

Calculate mean of sample size based on relative frequency in histogram [duplicate]

I have the following data of number of vouchers redeemed : How can i calculate the mean value of total vouchers?
0 votes
0 answers
16 views

Comparing groups when each member provides multiple datapoints per visit

First timer - apologies for the length of the question and any incorrect use of terminology... I wish to compare two groups in a longitudinal study where there is a small 'n' (4 or 5 in each group). ...
0 votes
0 answers
30 views

Mean squared error of 2 distributions when there are many zero values

I am comparing two (2-D) distributions using mean squared error. I take the difference between distributions, square them, average them and multiply them by the area of a pixel/bin. These ...
3 votes
1 answer
408 views

Probability for a bin in a binned histogram

This question is very basic, but I cannot figure the error in my thinking. According to the author of the book "Pattern Recognition and Machine Learning", we can get the Probability ...
  • 321
0 votes
0 answers
110 views

Selecting the optimal bandwidth in kernel density estimation

I have a question regarding kernel density estimation. At the moment I have a set of sample date $V$, where for each $v \in V$ I have an associated standard deviation $\sigma_v$ (some measurements ...
0 votes
0 answers
22 views

Estimating the Probability in a statistical analysis

I am carrying out a statistical analysis where I run the simulation (Matlab) 5000 times, to get 5000 results. The objective is to estimate the probability of having a result that is less than or equal ...
1 vote
2 answers
64 views

Histogram vs Bar Graph [closed]

I have data for number of patients used to collect the data in a hospital for each day. I want to display them as a graphical representation of number of patients used to collect the data for each ...
  • 13
0 votes
0 answers
3 views

What metric is best fitted for comparing encodings?

I am trying to compare two distributions, that each correspond to different numerical encodings, e.g. compare fp32 encodings to various other encodings on a same set of values. However I do not know ...
0 votes
0 answers
11 views

Detecting Mean differences on streaming data

Im taking online measurements on highly skewed real valued data of two possibly unrelated distributions. The precision is low, which means small values tend to come in duplicates, while large values ...
1 vote
0 answers
56 views

Empirical distribution for feature binning

In paper "A simple yet effective baseline for non-attributed graph classification" (https://arxiv.org/pdf/1811.03508.pdf) authors use empirical distribution for feature binning. Precisely, ...
  • 229
1 vote
2 answers
425 views

Histogram of a Sample with Overlay of Population Density

To familiarize myself with histograms and probability density functions, I decided to sample various distributions, plot samples' histograms and their corresponding probability distribution functions. ...
  • 121
2 votes
1 answer
43 views

Infer (supposed) Poissonian probability from data

Suppose to count the drops of rain in a square meter in 15 seconds, producing 16 observations: 40, 20, 24, 15, 23, 12, 39, 26, 29, 33, 16, 36, 17, 32, 40, 15. What is the probability of counting 28 ...
  • 153
1 vote
0 answers
42 views

How to adjust for the baseline difference between groups for a histogram

I have data from an experiment that tested responses to stimuli in females and males. I measured baseline for both groups prior to presenting the stimuli. The baseline for males is higher than for ...
3 votes
1 answer
58 views

Is there a way to identify key points of change in length-frequency (histogram) data through statistical means?

I am performing a length-frequency analysis (read: histogram) of data in fishes. This is a common way in which fish biologists analyze life history data in fishes. An example of the data is as follows....
2 votes
1 answer
1k views

How do I overlap a Poisson distribution with a histogram

I expect to get a Poisson distribution over my histogram but as I can see from the graph, I get a straight line. Would really appreciate insight.
  • 21
0 votes
1 answer
394 views

Should histograms be normalized first before fitting them?

Assume I have some data that follow a power law and I would like to estimate the exponent $a$. An obvious way to do so is to bin the data and then fit the power law to the histogram. However I found ...
  • 105
8 votes
2 answers
570 views

Inverse transform method, theoretical graph not matching sample

Suppose a density function is $$f_X(x)=\left\{\begin{aligned}\frac{1}{(1+x)^2} & \quad x \ge 0 \\ 0 & \quad \text{otherwise.}\end{aligned}\right.$$ I am trying to write an algorithm to ...
  • 113
1 vote
2 answers
101 views

Mann-Whitney U test on "histogram-compressed" data?

I want to perform a very large number of Mann-Whitney U-tests between many groups from data that I will get in from a database. I would prefer to use a pre-implemented version of this test. I think ...
1 vote
2 answers
147 views

Shape of a Histogram with Equally Likely Outcomes

In a large class of introductory Statistics students, the professor has each student toss a coin 16 times and calculate the proportion of his or her tosses that were heads. The students then report ...
  • 353
0 votes
1 answer
143 views

Do my data follow normal distribution? and what does it mean if not? Can I have to peaks?

I have to understand if my graphs follow the normal distribution but I don't know. Can they have two peaks like two columns? Are they normal or not? what it means if they are not normal? The aim is to ...
0 votes
0 answers
77 views

Approximation of a polynomial via histogram

Note: I originally tried to pose this question generally, without discussing the specific type of stochastic process. I hope that this can still be an interesting question generally. Assume that we ...
1 vote
2 answers
345 views

Why are rating distributions 'smoother' when there are more players?

Consider the following rating distributions by variant/time control on lichess. The bullet, blitz and rapid rating distributions look very, well, 'smooth' (or holomorphic/analytic or harmonic or ...
  • 2,260
0 votes
0 answers
28 views

Histogram where the bin heights take values into account

In a regular histogram the bin heights reflect the density of observations/data within them. Therefore, the areas of the bins on the chart reflect the quantity of observations they cover. They are for ...
0 votes
1 answer
29 views

Departure from uniformity histogram

Let us consider the histogram of a random variable. It is uniform up to a certain value $\bar{x}$, while beyond it a growth is present,as shown in the figure. I would like to obtain an estimate of the ...
1 vote
0 answers
193 views

Interpretting overlapping histogram

I obtained the following histogram when performing data analysis. This histogram refers to the duration of cab trips in the NYC taxi dataset. The histogram clearly shows two overlapping populations ...
1 vote
0 answers
44 views

Estimate the number of ranges that overlap

I am a CS major and I am dealing with this problem about finding the join estimation for overlapping ranges. Imagine that you have two tables (sets) with ranges ex. integers ([2,10), [5, 20)) and you ...
  • 11
2 votes
1 answer
3k views

Poisson Distribution fit with large counts (Python) [closed]

I'm trying to fit a dataset to a Poisson distribution, but have probably messed up the parameters somewhere along the way. My data consists of 112 10 minute intervals where radiation hits a detector ...
1 vote
2 answers
203 views

How are regression lines calculated for 2D histograms?

I've been looking into how to fit a line to a 2D histogram and have come across different pieces of information which I can't quite piece together. To show what I mean, I want to achieve something ...
0 votes
0 answers
121 views

Negative KL divergence for train_test_split in sklearn for y_train and y_val

So, I am trying to understand if I have fair split of my train and val sets using train_test_split of sklearn, so I decided to run the KL divergence and JS div tests and I get the following results. ...
17 votes
7 answers
8k views

Could any equation have predicted the results of this simulation?

Suppose there is a coin that has a 5% chance of landing on HEADS and a 95% chance of landing on TAILS. Based on a computer simulation, I want to find out the following : The average number of flips ...
  • 7,030

1
2 3 4 5
11