Questions tagged [histogram]
A histogram is a graphical representation of the frequencies of a continuous variable. The variable is divided into bins and a bar is drawn for each bin, proportional to its frequency in the data.
2
votes
3answers
48 views
Python: “Normalizing” kde, so it always lines up with histogram
In Python, I am attempting to find a way to plot/rescale kde's so that they match up with the histograms of the data that they are fitted to:
The above is a nice example of what I am going for, but ...
0
votes
0answers
18 views
p-value histogram of two-sample poisson tests on simulated data
I have two vectors (a and b), which are each a sample of n = 10000 from the poisson distribution with lambda = 10.
...
0
votes
0answers
14 views
probability distribution of two-dimensional samples [closed]
Let's say, I have n samples that have the dimension of p-by-q (drawn from a continuous probability distribution). Here, p is the number of features $(X_1,...,X_p)$, and q is the sequential time vector ...
0
votes
0answers
29 views
Which regression model for percentage data with many zeros and ones?
I am analysing the share of a tree species at different forest locations. The data I am using is in percentage of the total species composition and I am modelling it based on the climatic probability ...
0
votes
0answers
16 views
Detecting intentionally misreported data
I have a dataset containing many intentionally misreported observations. Because I know the base pattern of systematic misreporting I would like to use a systematic procedure to identify and discard ...
0
votes
1answer
38 views
Assumption multiple regression: normality of residuals
I want to run a multiple regression analysis for a given dataset in SPSS.
However, the dataset violates the assumption of normality of residuals, as depicted in the picture. The values for the ...
0
votes
0answers
25 views
How do I divide a density/frequency plot?
I have a frequency plot, which is essentially a smooth histogram. There are three very clear features (divided with a line by eye). Please note, there are two groups, male and female. The data used to ...
3
votes
1answer
47 views
When to stack histograms?
I'm working on a personal data analysis project, and I'm comparing the frequency count of survivors of a particular natural disaster, between males and females. I want to use these histogram(s) to ...
0
votes
0answers
15 views
How to find a threshold based on overlapping the histograms of two classes?
I want to perform thresholding to post-process the test data. I averaged the pixel intensity histograms of normal and abnormal cell images (grayscale, 8-bit, 256 * 256 images), overlapped them to ...
2
votes
1answer
41 views
Checking normality for a t-test
I am following stats courses at the moment and I am a bit confused about performing a t-test. I know that a t-test assumes normality and enough sample size. In the course I am attending, the ...
3
votes
2answers
73 views
name for histogram of nominal p-values under the null
To evaluate a statistical test or means of generating frequentist confidence intervals, it makes sense to repeatedly simulate data for which the null is true and then compute the nominal p-value, and ...
1
vote
1answer
33 views
How can I make a Kolmogorov-Smirnov test to check if my data distribution is exponential?
I made a histogram of my data, and the fitting line,
but from some reason the fitting line doesn't fit to my graph.
How can I make it fit to it?
How can I check if my data distribution is exponential?...
0
votes
1answer
20 views
How to find emprical PDF by using the normalized histogram?
first of all, thank you for your time, here is my question;
Is it possible to find emprical PDF by using normalized histogram?
I am trying to learn discrete event simulation and what I see is there ...
8
votes
2answers
124 views
What is this “phenomenon” called?
Below is a histogram of some data, the bins are integers the other parameters are irrelevant.
As you can see there seems to be two separate but overlapping normal distributions for odd and even ...
0
votes
0answers
28 views
Histogram equalization
I'm trying to equalize the following histogram:
I tried histogram equalization, but that didn't seem to work the way I wanted. I got something likes this:
Which is equally distributed everywhere. ...
0
votes
0answers
17 views
problems in plotting decimal value distribution with bin width normalization in r using hist()
I am plotting data distribuiton.
I get the expected plot with data which are only integer numbers. But I didn't get appropriate plot for decimal data sets.
The code with integer numbers data as ...
2
votes
0answers
17 views
Can I draw a histogram of the mean sample distribution (n=30) sampling from my dataset (n=200)?
I would like to test whether my data reasonably satisfies the normality assumption necessary to apply a t-test.
My understanding is that, to apply a t-test, the distribution itself does not need to ...
0
votes
1answer
38 views
differentially private release of histograms (non-negative valued queries)
Two practical questions arise when releasing differentially private histograms/counts via addition of Laplace/Gaussian noise:
1) Is the result of noise addition truncated/rounded (since we know that ...
2
votes
2answers
159 views
Visualization of the number of transitions between states [closed]
I am currently developing a Markov model for ordinal data. In order to proceed with the modeling, I would like to check the distribution of the number of transitions per individual in my data set.
...
1
vote
1answer
61 views
downsampling a kde / combining kde and histogram
I'm calculating a KDE of one parameter (y, particle density) in bins of another parameter (x, distance from the origin). At ...
1
vote
0answers
12 views
Constructing an appropriate null hypothesis?
I have a collection of 20 2D surfaces embedded in 3D. The mean curvature of each surface has been sampled.
The number of samples per surface varies from ~700,000 to ~20,000,000. The choice of ...
1
vote
2answers
72 views
Why use histogram to illustrated probability distribution
Forgive me I am a newbie of random variables. I saw a lot of course which introduce the Discrete Random Variables which always be illustrated with a histogram or ...
3
votes
1answer
43 views
How to quantify the agreement between the same parameter from two different data sets
I am looking at Arctic ice thickness from two different Earth-orbiting satellites A and B. I'm interested in quantifying how well these two datasets agree, but I'm struggling over what parameters to ...
0
votes
0answers
15 views
Histogram of Subtraction of Underlying Values
I have histograms produced from two sets of data recording. One of background noise of values $X$ and another $Z$ with a signal of values $Y$ present such that $Z = X + Y$.
How can I estimate a ...
2
votes
0answers
32 views
Sparkline type visualisation of demographics in papers (introducing new 'non-standard' visuals)
It seems typical to include only basic statistics on subject demographics within papers (i.e. mean, max and min). It seems to me that having a knowledge of the actual distribution would be provide ...
0
votes
0answers
12 views
how to calculate the difference between multiple distribution(or frequency list)
Here is the scenario:
I have a dataset, which contains list of data points, each point has F features(i.e. float numbers) and a category(there are C categories).
I want to compare the difference of ...
1
vote
1answer
59 views
What does a p value histogram that is “normally” distributed mean?
Let's say I performed 100 tests and and want to correct for multiple comparisons. Before I do so, I plot the unaltered p values in a histogram to see what the distribution looks like.
If the null ...
1
vote
2answers
69 views
How to approximate histogram(f(x)) from histogram(x)?
I have a histogram of a variable x, and I would like to get the histogram of f(x). Let's just say the transformation function is ...
1
vote
0answers
282 views
K-Nearest-Neighbor classification with only distance/similarity matrices, is it possible?
I want to classify histograms/distributions using K-Nearest-Neighbor. I can measure distances/dissimilarities between the distributions (using euclidean distance, kullback-leibler divergence...), thus ...
1
vote
3answers
91 views
How long is a distribution considered normal?
I have a dataset of metric distances ($n=5800$) and plotted those as a histogram. My initial thought was that this distribution looks normal. But after performing a Shapiro Wilk test and plotting the ...
1
vote
1answer
307 views
Histogram and probability mass function
I have a dataset of a discrete random variable. My question is: Is the normed histogram(I divide the frequencies by the total number of samples) and the PMF is the same quantity? It seems they are. Is ...
0
votes
0answers
28 views
Tukey’s rule for outlier analysis: What does it mean when the HIGH is below the mean?
Hi as you know the upper boundary of Tukey's rule is
Upper Range = Q3 + (1.5 * IQR)
however recently I came across something that does not make sense to me. ...
1
vote
1answer
238 views
Scott's and Freedman–Diaconis rules of the thumb for selecting bin width - disatvantages
Scott's and Freedman–Diaconis rules of the thumb are based on the following formula:
In the article here it is stated that:
While these appear to be useful estimates for unimodal densities
...
0
votes
0answers
42 views
Averaging Histograms
I am currently running experiments which include measuring concentrations throughout an environment, producing a histogram as such:
Which shows the percentage of positions which have oxygen ...
2
votes
0answers
62 views
How to aggregate histograms for density estimation
Within a very large sensor network, each node does take measurements derived from a fixed number of samples taken at a high frequency from an instrument. The number of measurements send to an ...
0
votes
0answers
87 views
How to estimate a histogram for two correlated input parameters when the resulting histogram is known?
Let's assume there are two (slightly correlated) parameters (A and B).
Both parameters are rated with discrete values (range: 1-5).
The sum of the two parameter-ratings gives the cumulative-rating (A+...
3
votes
1answer
123 views
Why is “using counts of a frequency table as data” for a histogram a “mistake”?
The textbook, The Practice of Statistics, states the following as a "common mistake" when making histograms:
Don't use counts (in a frequency table) or percents (in a relative frequency table) as ...
1
vote
1answer
54 views
y-axis ticks of distribution plot
Can I know what are the ticks at y axis mean?
I created a distribution plot of titanic['Age'] data from.Kaggle Titanic Data
How to learn more about distribution of age column from the dataset from ...
2
votes
3answers
349 views
A question about Histogram-to-distribution transformation
I have done a simulation with 1 million runs on Matlab. I have got a histogram for this. Using Matlab command hist(X), (where X is the 1 million samples as results ...
1
vote
0answers
14 views
Why do we subtract the $cdf_{min}$ in this step of histogram equalisation?
In my question I am referring to histogram equalisation as it is described in the wikipedia article in this example here.
Given an grey image $I$ of size $M \times N$, in histogram equalisation one ...
0
votes
0answers
19 views
Can I use PCA to correlate the brightess of an object with some other attribute?
I'm trying to correlate the color of a blood sample with how high the glucose is in that sample. My original intuition was to look at a histogram of each color channel (RGB) to see where they peak, ...
2
votes
2answers
216 views
Choosing center of histogram bins for fitting
I have a bimodal distribution, and if plotted with Mathematica it looks like this:
Now, the lowest value from the actual data is 8196 and 690720, but as seen in the plot, Mathematica lets the data ...
1
vote
0answers
22 views
Relative frequency question
I am a new user here, and I need some help getting started with the following question:
The textbook answers are a. $19$ and b. $20$. How do I begin this question? I am a beginner in statistics. :)
...
1
vote
0answers
175 views
95% confidence interval error bars of normalized histogram
I have observational data from a satellite and I am studying a certain phenomenon. I have locational data of these phenomena (let's call this data set A). I have divided the data into histogram bins ...
2
votes
1answer
302 views
SVM classification on distance matrix
How can I do an SVM classification when I only have a distance matrix (pairwise matrix)?
Edited: I want to classify my data in two groups: healthy and sick. My original data are histograms (which are ...
1
vote
0answers
26 views
How to analyze size frequency data from over 70 sites
When I started my PhD, I had virtually no prep-time. My advisor needed me in the field and told me to go grab samples. As such, my planning wasn't the best, so sorry if this is a completely terrible ...
0
votes
0answers
98 views
For a histogram, is there any standard rule about how large the min and max bin should be (underflow bin and overflow bin)?
Working with several large datasets in excel, about N=900. I would like to divide the data into a number of categories corresponding to low, med, high etc. for this biological variable. Histograms ...
2
votes
1answer
79 views
What is a “Nominal Type Histogram” and “Shuffling Invariant Property”?
I'm reading this paper about comparing histograms ["Comprehensive Survey on Distance/Similarity Measures between Probability Density
Functions" by Sung-Hyuk Cha] that writes in the introduction:
...
3
votes
1answer
366 views
What is histogram classifier and how to use it? [closed]
This question is about the assignment on my ML course..
I have been given two continuous data in a normal distribution and predict the values of both for class labels(m/f) in 2 steps:
build a ...
2
votes
1answer
853 views
Outlier detection for skewed data
I have a dataset as below:
4.8856
4.8914
4.9125
4.9338
4.9563
4.993
4.9947
4.9947
4.995
5.2932
4.981
4.981
4.981
4.982
4.982
4.982
4.982
4.983
4.983
4.984
4.984
...
