Questions tagged [histogram]
A histogram is a graphical representation of the frequencies of a continuous variable. The variable is divided into bins and a bar is drawn for each bin, proportional to its frequency in the data.
537
questions
0
votes
0
answers
9
views
How do I make sklearn.ensemble.GradientBoostingRegressor non-random? [closed]
I am experimenting with sklearn.ensemble.GradientBoostingRegressor and finding that my results are sensitive to the parameter "random_state". I understand that this learning algorithm can be ...
- 656
0
votes
0
answers
19
views
Comparison of two histogram with increasing range scale
I have a requirement of comparing two histograms. It is a distribution of buckets of time frames and each bucket has finite no. of entries.
An example of the histogram:
buckets - [2, 4, 8, 16, 32, 64, ...
0
votes
0
answers
14
views
How should I interpret the random variables in this histogram?
I'm currently trying to eyeball the type of distribution of this histogram to properly specify the family of distribution to use for a generalised linear model in python. I'm pretty sure it's a gamma ...
- 13
2
votes
0
answers
23
views
Measuring distance between two continuous distributions using their discrete approximations
I need to compute the distance between two continuous distributions. However, I have no idea as to what kind of distributions they are. I have a discrete approximation of the distributions. That is, ...
- 149
0
votes
0
answers
8
views
Writing a 2D and above histogram estimator, what bins are returned?
I am working with the optidigits data from UCI repository, so I have 10 classes (10 single digits).
If I apply PCA to the training digits and reduce it to 2 dimensions, and I plot those as x and y and ...
0
votes
0
answers
42
views
Compare 2 binned non-parametric histograms with hypothesis test
According to this guy here: https://towardsdatascience.com/how-to-compare-two-distributions-in-practice-8c676904a285 and the following papers he mentions inside his article, and more specifically the ...
- 137
6
votes
2
answers
443
views
Is there a name for a distribution where I can take log of its histogram and get back the same histogram?
I am imagining some data distribution where taking the log over and over again yields a distribution that has the exact same shape.
- 63
0
votes
0
answers
6
views
Analyzing distribution of vector samples
I have a neural network that can be well trained with CNN features from AlexNet (a neural network that is pretrained for image recognition).
I have obtained these CNN features from previous studies ...
- 385
2
votes
1
answer
25
views
Create statistic to judge moisture distribution 'quality'
I am working with an agricultural dryer that gradually dries grain. During each drying run, many data are taken, including information about the moisture content distribution. The moisture content ...
- 123
0
votes
1
answer
99
views
Two approaches for Fitting Beta-distribution to Histogram of Survey Response. Which one is better?
We have data from a survey in which participants are asked about the probability that an event takes place. The question is probabilistic and asks the respondents to assign probabilities to pre-...
- 125
2
votes
1
answer
139
views
Is my data normally distributed? (QQ plot and histogram analysis) [duplicate]
I am trying to create a regression model for prediction. I need to generate prediction/confidence intervals for my model.
I am trying to decide whether to use a quantile regression or linear ...
- 195
0
votes
0
answers
93
views
Chi-square distribution, Chi-square distance
I am trying to use chi-square distance to find the similarity between two PDFs. My data is chi-square distributed. though the chi-square distance works well but my question is can I use the jensen-...
- 1
0
votes
1
answer
105
views
How to analyse a right skewed dataset
I am trying to analyse several heavily right skewed datasets in order to determine their mode.
The story behind the sets is that they are calculations of performance data from marketing posts. The ...
- 103
0
votes
0
answers
29
views
How limited is my dataset?
So I have multiple datasets which are all histograms and cannot be linked. The topic of the data is quite complex so for example imagine I was surveying different qualities between men and women. The ...
6
votes
1
answer
470
views
Outlier/anomaly detection on histograms
So, the idea is that I have many histograms, each one representing results for something. So, I have histogram_1 for object_1, histogram_2 for object_2,...,histogram_20 for object_20. How can throw ...
- 137
0
votes
0
answers
56
views
Mean squared error in 2D, divide by pixel area or not?
I am comparing 2D histograms using mean squared error (MSE, mean of the squared differences). These histograms have varying pixel or bin sizes. I want to compare the MSE results across these different ...
4
votes
2
answers
179
views
Why does my probability plot not agree with my histogram?
I am trying to determine the best distribution to characterize a dataset. My dataset visually looks like Cauchy distribution would be a good fit, so I used python to fit a Cauchy distribution to my ...
- 41
0
votes
1
answer
81
views
How to convert units of KDE into physical units
I have a sample of people's heights. If I histogram it, I would usually divide by the bin width, so that my result becomes independent of my bin width, and I would label the axis something like (...
- 173
0
votes
0
answers
24
views
Is it any meaningful taking the histogram of many histograms?
So I’m working on pixel-level assessment of chest x-ray images from the NIH Chest X-ray dataset. The diseases labels on the images are a set of z different categories (i.e. Pneumonia, effusion, etc…). ...
-1
votes
0
answers
22
views
Find mean value of total N with only relative frequency and mid point histogram [duplicate]
I have the following data of number of vouchers redeemed :
How can i calculate the mean value of total vouchers?
- 7
-1
votes
1
answer
76
views
Calculate mean of sample size based on relative frequency in histogram [duplicate]
I have the following data of number of vouchers redeemed :
How can i calculate the mean value of total vouchers?
- 7
0
votes
0
answers
16
views
Comparing groups when each member provides multiple datapoints per visit
First timer - apologies for the length of the question and any incorrect use of terminology...
I wish to compare two groups in a longitudinal study where there is a small 'n' (4 or 5 in each group). ...
0
votes
0
answers
30
views
Mean squared error of 2 distributions when there are many zero values
I am comparing two (2-D) distributions using mean squared error. I take the difference between distributions, square them, average them and multiply them by the area of a pixel/bin. These ...
- 11
3
votes
1
answer
408
views
Probability for a bin in a binned histogram
This question is very basic, but I cannot figure the error in my thinking. According to the author of the book "Pattern Recognition and Machine Learning", we can get the Probability ...
- 321
0
votes
0
answers
110
views
Selecting the optimal bandwidth in kernel density estimation
I have a question regarding kernel density estimation.
At the moment I have a set of sample date $V$, where for each $v \in V$ I have an associated standard deviation $\sigma_v$ (some measurements ...
- 1
0
votes
0
answers
22
views
Estimating the Probability in a statistical analysis
I am carrying out a statistical analysis where I run the simulation (Matlab) 5000 times, to get 5000 results. The objective is to estimate the probability of having a result that is less than or equal ...
- 143
1
vote
2
answers
64
views
Histogram vs Bar Graph [closed]
I have data for number of patients used to collect the data in a hospital for each day. I want to display them as a graphical representation of number of patients used to collect the data for each ...
- 13
0
votes
0
answers
3
views
What metric is best fitted for comparing encodings?
I am trying to compare two distributions, that each correspond to different numerical encodings, e.g. compare fp32 encodings to various other encodings on a same set of values.
However I do not know ...
0
votes
0
answers
11
views
Detecting Mean differences on streaming data
Im taking online measurements on highly skewed real valued data of two possibly unrelated distributions.
The precision is low, which means small values tend to come in duplicates, while large values ...
- 101
1
vote
0
answers
56
views
Empirical distribution for feature binning
In paper "A simple yet effective baseline for non-attributed graph classification" (https://arxiv.org/pdf/1811.03508.pdf) authors use empirical distribution for feature binning. Precisely, ...
- 229
1
vote
2
answers
425
views
Histogram of a Sample with Overlay of Population Density
To familiarize myself with histograms and probability density functions, I decided to sample various distributions, plot samples' histograms and their corresponding probability distribution functions.
...
- 121
2
votes
1
answer
43
views
Infer (supposed) Poissonian probability from data
Suppose to count the drops of rain in a square meter in 15 seconds,
producing 16 observations: 40, 20, 24, 15, 23, 12, 39, 26, 29, 33, 16,
36, 17, 32, 40, 15.
What is the probability of counting 28 ...
- 153
1
vote
0
answers
42
views
How to adjust for the baseline difference between groups for a histogram
I have data from an experiment that tested responses to stimuli in females and males. I measured baseline for both groups prior to presenting the stimuli. The baseline for males is higher than for ...
- 11
3
votes
1
answer
58
views
Is there a way to identify key points of change in length-frequency (histogram) data through statistical means?
I am performing a length-frequency analysis (read: histogram) of data in fishes. This is a common way in which fish biologists analyze life history data in fishes. An example of the data is as follows....
- 191
2
votes
1
answer
1k
views
How do I overlap a Poisson distribution with a histogram
I expect to get a Poisson distribution over my histogram but as I can see from the graph, I get a straight line. Would really appreciate insight.
- 21
0
votes
1
answer
394
views
Should histograms be normalized first before fitting them?
Assume I have some data that follow a power law and I would like to estimate the exponent $a$. An obvious way to do so is to bin the data and then fit the power law to the histogram. However I found ...
- 105
8
votes
2
answers
570
views
Inverse transform method, theoretical graph not matching sample
Suppose a density function is
$$f_X(x)=\left\{\begin{aligned}\frac{1}{(1+x)^2} & \quad x \ge 0 \\ 0 & \quad \text{otherwise.}\end{aligned}\right.$$
I am trying to write an algorithm to ...
- 113
1
vote
2
answers
101
views
Mann-Whitney U test on "histogram-compressed" data?
I want to perform a very large number of Mann-Whitney U-tests between many groups from data that I will get in from a database.
I would prefer to use a pre-implemented version of this test.
I think ...
- 11
1
vote
2
answers
147
views
Shape of a Histogram with Equally Likely Outcomes
In a large class of introductory Statistics students, the professor has each student toss a coin 16 times and calculate the proportion of his or her tosses that were heads. The students then report ...
- 353
0
votes
1
answer
143
views
Do my data follow normal distribution? and what does it mean if not? Can I have to peaks?
I have to understand if my graphs follow the normal distribution but I don't know.
Can they have two peaks like two columns?
Are they normal or not?
what it means if they are not normal?
The aim is to ...
0
votes
0
answers
77
views
Approximation of a polynomial via histogram
Note: I originally tried to pose this question generally, without discussing the specific type of stochastic process. I hope that this can still be an interesting question generally.
Assume that we ...
1
vote
2
answers
345
views
Why are rating distributions 'smoother' when there are more players?
Consider the following rating distributions by variant/time control on lichess.
The bullet, blitz and rapid rating distributions look very, well, 'smooth' (or holomorphic/analytic or harmonic or ...
- 2,260
0
votes
0
answers
28
views
Histogram where the bin heights take values into account
In a regular histogram the bin heights reflect the density of observations/data within them. Therefore, the areas of the bins on the chart reflect the quantity of observations they cover. They are for ...
0
votes
1
answer
29
views
Departure from uniformity histogram
Let us consider the histogram of a random variable. It is uniform up to a certain value $\bar{x}$, while beyond it a growth is present,as shown in the figure. I would like to obtain an estimate of the ...
- 11
1
vote
0
answers
193
views
Interpretting overlapping histogram
I obtained the following histogram when performing data analysis. This histogram refers to the duration of cab trips in the NYC taxi dataset.
The histogram clearly shows two overlapping populations ...
1
vote
0
answers
44
views
Estimate the number of ranges that overlap
I am a CS major and I am dealing with this problem about finding the join estimation for overlapping ranges.
Imagine that you have two tables (sets) with ranges ex. integers ([2,10), [5, 20)) and you ...
- 11
2
votes
1
answer
3k
views
Poisson Distribution fit with large counts (Python) [closed]
I'm trying to fit a dataset to a Poisson distribution, but have probably messed up the parameters somewhere along the way.
My data consists of 112 10 minute intervals where radiation hits a detector ...
1
vote
2
answers
203
views
How are regression lines calculated for 2D histograms?
I've been looking into how to fit a line to a 2D histogram and have come across different pieces of information which I can't quite piece together. To show what I mean, I want to achieve something ...
- 245
0
votes
0
answers
121
views
Negative KL divergence for train_test_split in sklearn for y_train and y_val
So, I am trying to understand if I have fair split of my train and val sets using train_test_split of sklearn, so I decided to run the KL divergence and JS div tests and I get the following results. ...
- 514
17
votes
7
answers
8k
views
Could any equation have predicted the results of this simulation?
Suppose there is a coin that has a 5% chance of landing on HEADS and a 95% chance of landing on TAILS. Based on a computer simulation, I want to find out the following :
The average number of flips ...
- 7,030